-- Logs begin at Mon 2022-07-11 10:33:24 UTC, end at Mon 2022-07-11 11:45:55 UTC. -- Jul 11 11:04:18.616262 dv-cinder-848429-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 11 11:04:18.624656 dv-cinder-848429-2-smb devstack@keystone.service[80507]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 11 11:04:18.627236 dv-cinder-848429-2-smb devstack@keystone.service[80507]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 11 11:04:18 2022] *** Jul 11 11:04:18.627236 dv-cinder-848429-2-smb devstack@keystone.service[80507]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 11 11:04:18.627236 dv-cinder-848429-2-smb devstack@keystone.service[80507]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 11 11:04:18.627236 dv-cinder-848429-2-smb devstack@keystone.service[80507]: nodename: dv-cinder-848429-2-smb Jul 11 11:04:18.627236 dv-cinder-848429-2-smb devstack@keystone.service[80507]: machine: x86_64 Jul 11 11:04:18.627236 dv-cinder-848429-2-smb devstack@keystone.service[80507]: clock source: unix Jul 11 11:04:18.627236 dv-cinder-848429-2-smb devstack@keystone.service[80507]: pcre jit disabled Jul 11 11:04:18.627236 dv-cinder-848429-2-smb devstack@keystone.service[80507]: detected number of CPU cores: 4 Jul 11 11:04:18.627236 dv-cinder-848429-2-smb devstack@keystone.service[80507]: current working directory: / Jul 11 11:04:18.627236 dv-cinder-848429-2-smb devstack@keystone.service[80507]: detected binary path: /usr/bin/uwsgi-core Jul 11 11:04:18.627236 dv-cinder-848429-2-smb devstack@keystone.service[80507]: your processes number limit is 47680 Jul 11 11:04:18.627236 dv-cinder-848429-2-smb devstack@keystone.service[80507]: your memory page size is 4096 bytes Jul 11 11:04:18.627236 dv-cinder-848429-2-smb devstack@keystone.service[80507]: detected max file descriptor number: 2048 Jul 11 11:04:18.627236 dv-cinder-848429-2-smb devstack@keystone.service[80507]: lock engine: pthread robust mutexes Jul 11 11:04:18.627236 dv-cinder-848429-2-smb devstack@keystone.service[80507]: thunder lock: enabled Jul 11 11:04:18.627236 dv-cinder-848429-2-smb devstack@keystone.service[80507]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 11 11:04:18.627236 dv-cinder-848429-2-smb devstack@keystone.service[80507]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 11 11:04:18.672965 dv-cinder-848429-2-smb devstack@keystone.service[80507]: Python main interpreter initialized at 0x55e81cfbb9c0 Jul 11 11:04:18.672965 dv-cinder-848429-2-smb devstack@keystone.service[80507]: python threads support enabled Jul 11 11:04:18.672965 dv-cinder-848429-2-smb devstack@keystone.service[80507]: your server socket listen backlog is limited to 100 connections Jul 11 11:04:18.672965 dv-cinder-848429-2-smb devstack@keystone.service[80507]: your mercy for graceful operations on workers is 90 seconds Jul 11 11:04:18.673329 dv-cinder-848429-2-smb devstack@keystone.service[80507]: mapped 403077 bytes (393 KB) for 2 cores Jul 11 11:04:18.673408 dv-cinder-848429-2-smb devstack@keystone.service[80507]: *** Operational MODE: preforking *** Jul 11 11:04:18.673658 dv-cinder-848429-2-smb devstack@keystone.service[80507]: *** uWSGI is running in multiple interpreter mode *** Jul 11 11:04:18.673658 dv-cinder-848429-2-smb devstack@keystone.service[80507]: spawned uWSGI master process (pid: 80507) Jul 11 11:04:18.673893 dv-cinder-848429-2-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 11 11:04:18.675822 dv-cinder-848429-2-smb devstack@keystone.service[80507]: spawned uWSGI worker 1 (pid: 80521, cores: 1) Jul 11 11:04:18.675822 dv-cinder-848429-2-smb devstack@keystone.service[80507]: spawned uWSGI worker 2 (pid: 80522, cores: 1) Jul 11 11:04:18.675822 dv-cinder-848429-2-smb devstack@keystone.service[80507]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 11 11:04:24.142062 dv-cinder-848429-2-smb devstack@keystone.service[80522]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 11:04:24.142062 dv-cinder-848429-2-smb devstack@keystone.service[80522]: from cryptography.utils import int_from_bytes Jul 11 11:04:24.142906 dv-cinder-848429-2-smb devstack@keystone.service[80522]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 11:04:24.142906 dv-cinder-848429-2-smb devstack@keystone.service[80522]: from cryptography.utils import int_from_bytes Jul 11 11:04:24.166177 dv-cinder-848429-2-smb devstack@keystone.service[80521]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 11:04:24.166177 dv-cinder-848429-2-smb devstack@keystone.service[80521]: from cryptography.utils import int_from_bytes Jul 11 11:04:24.170620 dv-cinder-848429-2-smb devstack@keystone.service[80521]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 11:04:24.170620 dv-cinder-848429-2-smb devstack@keystone.service[80521]: from cryptography.utils import int_from_bytes Jul 11 11:04:24.192255 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 11:04:24.192471 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 11:04:24.192689 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] command line args: [] {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 11:04:24.193016 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 11:04:24.193218 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ================================================================================ {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 11:04:24.193553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] admin_token = **** {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.193856 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] config_dir = [] {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.194091 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.194300 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] config_source = [] {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.194517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] debug = True {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.194740 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.195232 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.195377 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.195699 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.196082 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.196266 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] list_limit = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.196476 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] log_config_append = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.196780 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.196929 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] log_dir = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.197103 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] log_file = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.197342 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.197675 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.203325 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.203325 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.203325 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.203325 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.203325 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.203325 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.203325 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.204127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.204127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.204127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.204127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.204127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.204127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.204127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.204127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] publish_errors = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.204127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.205086 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.205086 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.205086 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.205086 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.205086 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] standard_threads = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.205086 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.205086 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.205086 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.205086 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] use_journal = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.206102 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] use_json = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.206102 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] use_stderr = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.206102 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] use_syslog = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.206102 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.206102 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.206102 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.206102 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.206102 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.206102 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.207049 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.207049 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.207049 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.207049 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.207049 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.207049 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.207049 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.207796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.207796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.207796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.208138 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.208138 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.208405 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.208606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.208851 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.209088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.209884 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.210246 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.210502 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.210751 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.210984 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.211216 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.211447 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.211682 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.211930 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.212177 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.212409 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.212641 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.212888 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.213136 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.213374 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.213622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.213877 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.214114 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.214350 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.214581 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.214812 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.215041 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.215270 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.215511 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.215760 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.215989 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.216227 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.216459 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.216695 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.216930 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.217179 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.217411 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.217649 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.217907 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.218146 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.218382 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.218511 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 11:04:24.218636 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 11:04:24.218750 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.218863 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] command line args: [] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 11:04:24.218981 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.219103 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 11:04:24.219217 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.219329 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ================================================================================ {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 11:04:24.219442 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.219560 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] admin_token = **** {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.219682 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.219807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] config_dir = [] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.219928 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.220042 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.220162 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.220283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] config_source = [] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.220283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] debug = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.220511 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.220626 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.220772 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.220893 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.221008 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.221120 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.221241 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.221356 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.221475 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.221590 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.221702 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.221917 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] list_limit = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.221917 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] log_config_append = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.222142 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.222255 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.222368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.222480 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] log_dir = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.222604 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.222728 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] log_file = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.222966 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.223127 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.223249 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.223363 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.223484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.223599 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.223711 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.223825 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.223825 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.224055 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.224177 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.224292 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.224404 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.224517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.224635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.224756 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.225438 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.225562 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.225676 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.225977 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.226107 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.226222 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.226344 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.226466 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.226587 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.226707 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.226707 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.226919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.227044 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.227189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.227314 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.227314 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.227528 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.227651 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.227766 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] publish_errors = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.227863 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.227963 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.228068 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.228164 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.228264 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.228368 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.228478 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.228574 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.228685 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.228782 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.228870 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.228988 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] standard_threads = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.229129 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.229251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.229356 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.229459 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.229459 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.229646 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.229746 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] use_journal = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.233940 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.234090 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] use_json = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.234090 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] use_stderr = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.234275 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.234354 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] use_syslog = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.234431 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.234503 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:04:24.234573 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.234648 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.234728 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] auth.external = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.234800 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.234869 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.234938 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.235008 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.235086 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.235158 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.235232 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.235304 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] auth.password = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.235379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.235450 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] auth.token = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.235527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.235599 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.235668 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.235738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.235862 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.235939 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.236017 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.236090 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.236160 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.236229 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.236299 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.236368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.236445 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.236518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.236588 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.236658 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] credential.caching = True {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.236733 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.236810 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.236888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.236961 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.237031 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.237106 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.237178 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.237248 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.237248 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.237455 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.237525 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.237601 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.237678 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.237754 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.237866 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.237952 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.238035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.238117 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.238189 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.238265 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.238265 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.238450 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.238534 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.238607 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.238678 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.238747 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.238817 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.238898 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.238977 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.239055 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.239130 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.239201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] federation.caching = True {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.239271 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.239351 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.239424 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.239494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.239569 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.239641 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.239711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.239788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.239860 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.239930 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.240067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.240141 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.240232 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.240307 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.240413 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.240485 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.240773 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.240856 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.240935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.241015 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.241088 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.241159 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.241234 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.241311 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] identity.caching = True {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.241383 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.241460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.241532 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.241602 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.241673 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.241743 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.241861 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.241950 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.242024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.242095 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.242170 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.242243 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.242313 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.242391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.242463 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.242533 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.242603 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.242673 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.242742 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.242820 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.242892 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.242962 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.243031 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.243101 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.243170 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.243270 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.243400 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.243486 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.243566 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.243678 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.243757 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.243829 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.243900 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.243980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.244053 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.244124 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.244195 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.244271 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.244356 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.244430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.244506 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.244585 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.244665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.244738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.244809 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.244888 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.244966 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.245039 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.245150 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.245231 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.245422 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.245509 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.245700 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.245797 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.245963 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.246041 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.246209 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.246298 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.246453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.246531 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.246685 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.246762 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.246917 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.247074 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.247149 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.247221 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.247379 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.247456 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.247612 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.247697 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.247838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.247923 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.248074 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.248160 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.248308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.248397 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.248545 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.248623 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.248777 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.248854 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.249008 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.249095 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.249241 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.249319 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.249488 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.249570 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.249720 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.249821 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.249973 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.250054 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.250209 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.250292 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.250451 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.250531 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.250686 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.250763 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.250919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.250997 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.251151 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.251230 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.251386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.user = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.251503 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.251635 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.251727 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.251910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.252043 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.252174 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.252301 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.252301 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.252541 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.252675 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.252802 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.252934 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.253102 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.253233 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.253359 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.253493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.253630 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.253630 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.253868 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.253943 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.254021 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.254107 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.254181 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.254252 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.254322 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] auth.external = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.254392 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.254462 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.254608 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.254688 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.254853 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.254932 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.255097 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] auth.password = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.255174 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.255328 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] auth.token = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.255408 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.255559 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.255635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.255790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.255867 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.256048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.256151 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.256287 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.256377 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.256522 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.256611 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.256755 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.256888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.257006 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.257120 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.257235 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] credential.caching = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.257348 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.257474 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.257589 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.257703 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.257884 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.258053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.258173 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.258297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.258413 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.258529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.258644 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.258755 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.258853 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.258957 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.259055 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.259151 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.259246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.259342 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.259443 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.259550 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.259649 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.259753 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.259931 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] resource.caching = True {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.260036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.260174 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.260287 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.260421 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.260527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.260656 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.260759 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.260903 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.261022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.261127 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] federation.caching = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.261222 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.261357 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.261467 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.261603 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.261715 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.261877 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.261982 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.262079 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.262173 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.266376 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] role.caching = True {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.266491 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.266491 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.266622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] role.driver = sql {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.266622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.266766 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.266846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.266919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.266990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.267061 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.267132 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.267203 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.267281 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.267354 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.267430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.267504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity.caching = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.267574 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.267645 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.267727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.267801 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.267871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.267942 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.268012 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.268083 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.268210 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.268288 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.268360 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.268431 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.268431 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.268558 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.268558 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.268695 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.268695 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.268827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.268899 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.268975 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.269055 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.269128 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.269199 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.269275 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.269348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.269418 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.269496 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.269569 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.269641 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.269711 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.269851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.269929 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.270013 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.270088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.270158 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.270229 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.270299 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.270377 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.270455 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.270528 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.270599 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.270670 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.270741 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.270888 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.270963 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.271036 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.271107 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.271178 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.271249 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.271332 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.271406 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.271477 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.271547 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.271618 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.272262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.272385 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] token.caching = True {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.272463 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.272535 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.272669 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.272839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.272914 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.272995 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.273069 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.273140 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.273211 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.273282 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.273282 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.273417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.273491 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.273561 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.273632 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.273703 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.273703 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.273921 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.274001 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.274073 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.274073 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.274199 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.274270 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.274348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.274348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.274477 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.274547 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.274617 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.274617 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.274750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.274823 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.274894 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.274894 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.275021 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.275133 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.275221 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] database.connection = **** {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.275381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.275472 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.275617 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.275696 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.275859 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.275937 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.276095 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.276180 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.276325 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.276403 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.276563 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.276640 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.276800 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.276879 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.277035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.277113 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.277280 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.277357 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.277513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.277591 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.277756 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.277883 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.277995 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.278097 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.278245 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.278327 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.278479 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.278558 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.278711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.278791 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.278941 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.279020 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.279168 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.279246 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.279402 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.279481 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.279562 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 11:04:24.279636 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.279879 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.280125 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.280369 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.280600 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.280842 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.281077 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.281312 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.281547 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.281793 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.282040 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.282286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.282522 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.282774 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.283003 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.283246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.283479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.283712 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.283946 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.284294 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.284475 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.284707 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.284941 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.285180 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] resource.caching = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.285428 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.285674 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.285935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.286196 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.286446 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.286681 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.286927 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.287162 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.288118 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.288338 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] role.caching = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.288588 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] role.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.288821 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.289070 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.289317 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.289565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.289835 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.290084 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.290329 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.290574 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.290820 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.291051 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.291296 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.291543 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.291800 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.292047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.292446 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.292679 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.292926 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.293174 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.293421 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.293666 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.293935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.294189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.294439 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.294677 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.294921 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.295152 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.295385 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.295635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.295895 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.296142 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.296378 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.296611 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.296839 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.297073 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] token.caching = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.297355 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.297602 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.297885 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.298144 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.298392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.298629 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.298870 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.299110 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.299356 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.299590 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.299844 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.300079 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.300328 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.300576 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.300803 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.301045 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.301346 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.301605 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.connection = **** {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.301874 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.302122 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.302358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.302597 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.302906 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.303189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.303426 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.303660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.303904 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.304139 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.304382 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.304616 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.304865 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.305097 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.305339 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.305568 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.305831 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.306065 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:04:24.306235 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 11:04:24.310793 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.314455 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.314455 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.322490 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.333653 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.333910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.334654 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.343014 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.351059 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.351290 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.361729 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.361980 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.497161 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.498628 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.550414 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.550645 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.551243 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.551480 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.618757 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.618956 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.619051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.619190 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.619347 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.619433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.619509 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.619609 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.619692 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.619823 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.619907 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.620090 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.648007 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.648216 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.648357 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.648455 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.648535 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.648657 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.648757 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.648869 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.648961 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.649080 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.649160 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.649293 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.649375 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.649511 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.670160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.671180 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.683543 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.683827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.684058 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.684158 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.684279 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.684363 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.684495 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.684577 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.684710 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.684793 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.684924 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.685006 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.685192 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.685411 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:04:24.706947 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.707069 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.707152 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 11:04:24.707258 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 11:04:24.707484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.707584 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.707686 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 11:04:24.707768 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 11:04:24.707956 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.708216 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.708306 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.708473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.708554 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.708730 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.708808 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.709023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.720149 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.720425 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.720656 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.720738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.720959 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.721055 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.721236 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.721525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.729750 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.730746 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.733029 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.733308 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.733590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.733896 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.734091 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.734173 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.734375 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.734458 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.734660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.734741 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.734933 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.735022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.735201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.735281 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.735464 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.735549 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.735727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.735819 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.736057 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.736330 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.736606 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.736878 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.762973 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.764604 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.764700 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.764883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.766299 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.766586 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.770160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.770441 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.770836 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.772096 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.772489 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.772781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.778143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.778425 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.780297 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.780584 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.782887 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.783174 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.783455 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.783739 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.784015 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.784290 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.784560 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.784828 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.785166 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.785452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.785736 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.786041 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.786320 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.786598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.786871 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.787143 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.804820 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.805089 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.807128 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.807412 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.810043 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.812300 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.813707 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.814024 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.816043 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.816351 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.819213 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.821635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.822868 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.825355 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.826522 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.826822 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.827115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.827405 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.827688 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.827966 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.829089 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.829393 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.829690 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.830004 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.830310 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.830595 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.847804 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.848084 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.848348 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.848622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.851613 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.851898 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.852171 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.852450 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.857137 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.858877 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.859150 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.860478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.862243 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.862362 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.862524 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.862640 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.862921 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.863200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.863476 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.865844 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.866128 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.866414 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.866702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.866986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.876921 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.877203 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.877482 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.877780 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.878075 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.879688 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.879980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.880456 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.880745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.881073 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.881374 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.881663 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.881976 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.882258 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.898565 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.901890 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.902200 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.905191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.905492 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.906966 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.908609 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.908846 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.908928 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.909165 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.910489 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.912348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.913133 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.913426 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.917107 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.918744 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.920786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.922012 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.922303 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.922457 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.922695 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.922980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.925686 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.926004 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.926301 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.926583 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.932249 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.932785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.933065 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.936259 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.936552 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.936837 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.940988 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.941284 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.941546 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.941849 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.942123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.942511 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.942796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.943076 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.943356 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.943655 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.943930 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.944193 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.944457 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.944739 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.944880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:04:24.945136 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.945422 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.945700 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.946001 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.946291 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.946588 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.946869 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.947247 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.947524 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.947798 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.948065 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.948343 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.948615 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:04:24.982960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e81cfbb9c0 pid: 80522 (default app) Jul 11 11:04:24.986339 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43d31d-cd15-476d-84f0-5cdf5c0ef6a4 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:24.986632 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43d31d-cd15-476d-84f0-5cdf5c0ef6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:24.986911 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43d31d-cd15-476d-84f0-5cdf5c0ef6a4 None None] PATH_INFO: `/v3` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:24.987632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e81cfbb9c0 pid: 80521 (default app) Jul 11 11:04:24.991630 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Mon Jul 11 11:04:24 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:04:33.762902 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5a59e-f2e0-449e-bc43-f2b2fcc1f74e None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:33.763285 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5a59e-f2e0-449e-bc43-f2b2fcc1f74e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:33.763501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5a59e-f2e0-449e-bc43-f2b2fcc1f74e None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:33.767875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:04:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:04:33.774224 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4cfbb-91f0-4d68-9504-e37ddb6d8db1 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:33.774616 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4cfbb-91f0-4d68-9504-e37ddb6d8db1 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:33.774779 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4cfbb-91f0-4d68-9504-e37ddb6d8db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:33.844616 dv-cinder-848429-2-smb devstack@keystone.service[80522]: INFO dbcounter [None req-13f4cfbb-91f0-4d68-9504-e37ddb6d8db1 None None] Registered counter for database keystone Jul 11 11:04:33.866663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG oslo_db.sqlalchemy.engines [None req-13f4cfbb-91f0-4d68-9504-e37ddb6d8db1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80522) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 11:04:33.872740 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writer thread running {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 11:04:34.049111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG passlib.handlers.bcrypt [None req-13f4cfbb-91f0-4d68-9504-e37ddb6d8db1 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80522) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 11 11:04:34.049527 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG passlib.handlers.bcrypt [None req-13f4cfbb-91f0-4d68-9504-e37ddb6d8db1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80522) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 11 11:04:34.104140 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-13f4cfbb-91f0-4d68-9504-e37ddb6d8db1 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:04:34.105742 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-13f4cfbb-91f0-4d68-9504-e37ddb6d8db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:04:34.228114 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:04:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 11 11:04:34.406144 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5a59e-f2e0-449e-bc43-f2b2fcc1f74e None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:34.476679 dv-cinder-848429-2-smb devstack@keystone.service[80521]: INFO dbcounter [None req-91d5a59e-f2e0-449e-bc43-f2b2fcc1f74e None None] Registered counter for database keystone Jul 11 11:04:34.496165 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG oslo_db.sqlalchemy.engines [None req-91d5a59e-f2e0-449e-bc43-f2b2fcc1f74e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80521) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 11:04:34.502298 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writer thread running {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 11:04:34.620711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5a59e-f2e0-449e-bc43-f2b2fcc1f74e None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:34.624954 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c0b85-52eb-46e9-adff-36fccc17867b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:34.625615 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c0b85-52eb-46e9-adff-36fccc17867b admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:34.625938 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c0b85-52eb-46e9-adff-36fccc17867b admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:34.626214 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c0b85-52eb-46e9-adff-36fccc17867b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:34.634330 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c0b85-52eb-46e9-adff-36fccc17867b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:34.686594 dv-cinder-848429-2-smb devstack@keystone.service[80521]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fd4c0b85-52eb-46e9-adff-36fccc17867b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 11 11:04:34.686884 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c0b85-52eb-46e9-adff-36fccc17867b admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:34.696415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Mon Jul 11 11:04:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 11:04:34.702458 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4cfbb-91f0-4d68-9504-e37ddb6d8db1 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:34.717433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4cfbb-91f0-4d68-9504-e37ddb6d8db1 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:34.721963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9415bbd-5f4c-464b-bc6b-9c6a6e0ac6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:34.723087 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9415bbd-5f4c-464b-bc6b-9c6a6e0ac6ef admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:34.723386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9415bbd-5f4c-464b-bc6b-9c6a6e0ac6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:34.729398 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9415bbd-5f4c-464b-bc6b-9c6a6e0ac6ef admin admin] PATH_INFO: `/v3/projects/88f214658e46461082860991a2c6d4f3` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:34.729398 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9415bbd-5f4c-464b-bc6b-9c6a6e0ac6ef admin admin] RBAC: Authorizing `identity:get_project(project_id=88f214658e46461082860991a2c6d4f3)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:34.779603 dv-cinder-848429-2-smb devstack@keystone.service[80522]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c9415bbd-5f4c-464b-bc6b-9c6a6e0ac6ef admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 11 11:04:34.780134 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9415bbd-5f4c-464b-bc6b-9c6a6e0ac6ef admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:34.784748 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Mon Jul 11 11:04:34 2022] GET /identity/v3/projects/88f214658e46461082860991a2c6d4f3 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:04:36.798488 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59643fe-470a-4b94-81e4-cdedbc43ecde None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:36.798951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59643fe-470a-4b94-81e4-cdedbc43ecde None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:36.799036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59643fe-470a-4b94-81e4-cdedbc43ecde None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:36.804099 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:04:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:04:36.809675 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f636bb-9a08-40c8-bf04-db1b34557d11 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:36.810090 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f636bb-9a08-40c8-bf04-db1b34557d11 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:36.810286 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f636bb-9a08-40c8-bf04-db1b34557d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:36.830008 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-a2f636bb-9a08-40c8-bf04-db1b34557d11 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:04:36.831575 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-a2f636bb-9a08-40c8-bf04-db1b34557d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:04:36.840526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:04:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 11 11:04:36.863134 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59643fe-470a-4b94-81e4-cdedbc43ecde None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:36.875815 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59643fe-470a-4b94-81e4-cdedbc43ecde None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:36.880028 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04184be6-ab43-438e-a33d-59d1ff39ad67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:36.880674 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04184be6-ab43-438e-a33d-59d1ff39ad67 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:36.881611 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04184be6-ab43-438e-a33d-59d1ff39ad67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:36.881997 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04184be6-ab43-438e-a33d-59d1ff39ad67 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:36.889660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04184be6-ab43-438e-a33d-59d1ff39ad67 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:36.891480 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04184be6-ab43-438e-a33d-59d1ff39ad67 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:36.900229 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Mon Jul 11 11:04:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 11:04:36.905561 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f636bb-9a08-40c8-bf04-db1b34557d11 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:36.914909 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f636bb-9a08-40c8-bf04-db1b34557d11 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:36.919363 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a036642-f711-450c-a94d-537b826d406e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:36.920228 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a036642-f711-450c-a94d-537b826d406e admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:36.920521 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a036642-f711-450c-a94d-537b826d406e admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:36.920804 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a036642-f711-450c-a94d-537b826d406e admin admin] PATH_INFO: `/v3/users/d07257ebe5bd4aaa947d43762dac11d9` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:36.922240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a036642-f711-450c-a94d-537b826d406e admin admin] RBAC: Authorizing `identity:get_user(user_id=d07257ebe5bd4aaa947d43762dac11d9)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:36.924059 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a036642-f711-450c-a94d-537b826d406e admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:36.925619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Mon Jul 11 11:04:36 2022] GET /identity/v3/users/d07257ebe5bd4aaa947d43762dac11d9 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:04:39.021423 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde3684-edd3-4e92-9007-14319a78ce4c None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:39.022031 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde3684-edd3-4e92-9007-14319a78ce4c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:39.022155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde3684-edd3-4e92-9007-14319a78ce4c None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:39.023520 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:04:39.028707 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21e1f7-87ec-42c3-9fc9-77fb8b10e725 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:39.029110 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21e1f7-87ec-42c3-9fc9-77fb8b10e725 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:39.029274 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21e1f7-87ec-42c3-9fc9-77fb8b10e725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:39.046068 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-6d21e1f7-87ec-42c3-9fc9-77fb8b10e725 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:04:39.047252 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-6d21e1f7-87ec-42c3-9fc9-77fb8b10e725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:04:39.127658 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 6/11] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:04:39.150670 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde3684-edd3-4e92-9007-14319a78ce4c None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:39.151367 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4933dd-e0ca-45ca-915b-fc3cd760a798 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:39.151665 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4933dd-e0ca-45ca-915b-fc3cd760a798 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:39.151950 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4933dd-e0ca-45ca-915b-fc3cd760a798 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:39.153318 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 7/12] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:04:39.158289 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b39bbd-ade2-4b3c-a273-fe5a597e4c6e None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:39.158588 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b39bbd-ade2-4b3c-a273-fe5a597e4c6e None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:39.158875 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b39bbd-ade2-4b3c-a273-fe5a597e4c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:39.176057 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-83b39bbd-ade2-4b3c-a273-fe5a597e4c6e None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:04:39.177274 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-83b39bbd-ade2-4b3c-a273-fe5a597e4c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:04:39.194329 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:39.247541 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 8/13] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:04:39.269275 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b39bbd-ade2-4b3c-a273-fe5a597e4c6e None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:39.295740 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde3684-edd3-4e92-9007-14319a78ce4c None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:39.329461 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b81379-29a2-4591-ad22-0108b354b4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:39.330293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b81379-29a2-4591-ad22-0108b354b4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:39.330575 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b81379-29a2-4591-ad22-0108b354b4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:39.330854 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b81379-29a2-4591-ad22-0108b354b4d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:39.342343 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b81379-29a2-4591-ad22-0108b354b4d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:04:39.354525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-d0b81379-29a2-4591-ad22-0108b354b4d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:04:39.354525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:04:39.354525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:04:39.354525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:04:39.354525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:04:39.354525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:04:39.354525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:04:39.354525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:04:39.354525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:04:39.354525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:04:39.354525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:04:39.354525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:04:39.354525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:04:39.354525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:04:39.354525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:04:39.354525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:04:39.355373 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:04:39.355373 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:04:39.355373 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:04:39.355373 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:04:39.355373 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:04:39.355373 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:04:39.355373 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:04:39.355373 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:04:39.355373 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:04:39.355373 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:04:39.355373 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:04:39.355373 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:04:39.355373 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:04:39.355373 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:04:39.355373 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:04:39.355373 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:04:39.357856 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:04:39.357856 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:04:39.357856 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:04:39.357856 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:04:39.357856 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:04:39.357856 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:04:39.357856 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:04:39.357856 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:04:39.357856 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:04:39.357856 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:04:39.357856 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:04:39.357856 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:04:39.357856 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 6/14] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:04:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:04:39.361587 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b81379-29a2-4591-ad22-0108b354b4d0 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:39.374382 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b39bbd-ade2-4b3c-a273-fe5a597e4c6e None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:39.396163 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:39.411941 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e7834-639b-409b-b83a-59768c4f5599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:39.413318 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e7834-639b-409b-b83a-59768c4f5599 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:39.413621 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e7834-639b-409b-b83a-59768c4f5599 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:39.413950 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e7834-639b-409b-b83a-59768c4f5599 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:39.435409 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:39.466866 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b81379-29a2-4591-ad22-0108b354b4d0 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:39.482372 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e7834-639b-409b-b83a-59768c4f5599 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:39.483844 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e7834-639b-409b-b83a-59768c4f5599 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:39.500013 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57d58b-12d4-4be4-8ed2-5a82d1c971e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:39.500688 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57d58b-12d4-4be4-8ed2-5a82d1c971e1 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:39.500974 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57d58b-12d4-4be4-8ed2-5a82d1c971e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:39.501252 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57d58b-12d4-4be4-8ed2-5a82d1c971e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:39.502037 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57d58b-12d4-4be4-8ed2-5a82d1c971e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:04:39.502348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57d58b-12d4-4be4-8ed2-5a82d1c971e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:39.503720 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57d58b-12d4-4be4-8ed2-5a82d1c971e1 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:39.515605 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 7/15] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:04:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:04:39.521043 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57d58b-12d4-4be4-8ed2-5a82d1c971e1 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:39.581666 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 9/16] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:04:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 11:04:39.587363 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e7834-639b-409b-b83a-59768c4f5599 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:39.613772 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:39.619680 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57d58b-12d4-4be4-8ed2-5a82d1c971e1 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:39.638150 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:39.654043 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d74a02-ace0-4390-9012-95399e2f6267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:39.654917 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d74a02-ace0-4390-9012-95399e2f6267 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:39.655202 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d74a02-ace0-4390-9012-95399e2f6267 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:39.655478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d74a02-ace0-4390-9012-95399e2f6267 None admin] PATH_INFO: `/v3/users/d07257ebe5bd4aaa947d43762dac11d9` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:39.657087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d74a02-ace0-4390-9012-95399e2f6267 None admin] RBAC: Authorizing `identity:get_user(user_id=d07257ebe5bd4aaa947d43762dac11d9)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:39.658639 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d74a02-ace0-4390-9012-95399e2f6267 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:39.660459 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 8/17] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:04:39 2022] GET /identity/v3/users/d07257ebe5bd4aaa947d43762dac11d9 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:04:39.665746 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d74a02-ace0-4390-9012-95399e2f6267 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:39.685858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e7834-639b-409b-b83a-59768c4f5599 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:39.719004 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceea6c7-5ee1-4ecf-84cc-a71d9288bf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:39.719789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceea6c7-5ee1-4ecf-84cc-a71d9288bf97 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:39.720078 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceea6c7-5ee1-4ecf-84cc-a71d9288bf97 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:39.720350 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceea6c7-5ee1-4ecf-84cc-a71d9288bf97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:39.731529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceea6c7-5ee1-4ecf-84cc-a71d9288bf97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:39.733008 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceea6c7-5ee1-4ecf-84cc-a71d9288bf97 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:39.753658 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-fceea6c7-5ee1-4ecf-84cc-a71d9288bf97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:04:39.753658 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:04:39.753658 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:04:39.753658 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:04:39.753658 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:04:39.753658 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:04:39.753658 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:04:39.753658 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:04:39.753658 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:04:39.753658 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:04:39.753658 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:04:39.753658 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:04:39.753658 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:04:39.753658 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:04:39.753658 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:04:39.754500 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:04:39.754500 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:04:39.754500 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:04:39.754500 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:04:39.754500 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:04:39.754500 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:04:39.754500 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:04:39.754500 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:04:39.754500 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:04:39.754500 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:04:39.754500 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:04:39.754500 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:04:39.754500 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:04:39.754500 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:04:39.754500 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:04:39.754500 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:04:39.754500 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:04:39.755276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:04:39.755276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:04:39.755276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:04:39.755276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:04:39.755276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 10/18] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:04:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:04:39.761971 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceea6c7-5ee1-4ecf-84cc-a71d9288bf97 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:39.767087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d74a02-ace0-4390-9012-95399e2f6267 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:39.801464 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a519b-a1b3-4179-ba34-13b25d34b94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:39.802286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a519b-a1b3-4179-ba34-13b25d34b94e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:39.803105 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a519b-a1b3-4179-ba34-13b25d34b94e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:39.803373 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a519b-a1b3-4179-ba34-13b25d34b94e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:39.804641 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a519b-a1b3-4179-ba34-13b25d34b94e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:39.806092 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a519b-a1b3-4179-ba34-13b25d34b94e None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:39.807956 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 9/19] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:04:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:04:39.813490 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a519b-a1b3-4179-ba34-13b25d34b94e None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:39.845290 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:39.862992 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceea6c7-5ee1-4ecf-84cc-a71d9288bf97 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:39.865328 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:39.895396 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589be8c-e122-4bc5-859a-bb81ebcc69a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:39.896056 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589be8c-e122-4bc5-859a-bb81ebcc69a8 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:39.896890 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589be8c-e122-4bc5-859a-bb81ebcc69a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:39.897174 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589be8c-e122-4bc5-859a-bb81ebcc69a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:39.897936 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589be8c-e122-4bc5-859a-bb81ebcc69a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:04:39.898245 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589be8c-e122-4bc5-859a-bb81ebcc69a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:39.899643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589be8c-e122-4bc5-859a-bb81ebcc69a8 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:39.915754 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a519b-a1b3-4179-ba34-13b25d34b94e None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:39.917191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 11/20] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:04:39.951947 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1e2e6-f14e-42ce-9b28-eb1feb21abb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:39.952630 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1e2e6-f14e-42ce-9b28-eb1feb21abb9 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:39.952916 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1e2e6-f14e-42ce-9b28-eb1feb21abb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:39.953197 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1e2e6-f14e-42ce-9b28-eb1feb21abb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:39.954083 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e1e2e6-f14e-42ce-9b28-eb1feb21abb9 None admin] RBAC: Adding query filter params (role.id=736e70deba004b9289c2fed43eb107f7, scope.domain.id=default, user.id=d07257ebe5bd4aaa947d43762dac11d9) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:04:39.954405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e1e2e6-f14e-42ce-9b28-eb1feb21abb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:39.955880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e1e2e6-f14e-42ce-9b28-eb1feb21abb9 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:39.965682 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 10/21] 10.222.0.23 () {56 vars in 1322 bytes} [Mon Jul 11 11:04:39 2022] GET /identity/v3/role_assignments?user.id=d07257ebe5bd4aaa947d43762dac11d9&scope.domain.id=default&role.id=736e70deba004b9289c2fed43eb107f7 => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:04:42.451652 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99864cbb-5190-4f0d-be04-39627acf0948 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:42.452153 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99864cbb-5190-4f0d-be04-39627acf0948 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:42.452223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99864cbb-5190-4f0d-be04-39627acf0948 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:42.453804 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 12/22] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:04:42.459192 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f73a1-60cc-48f9-b862-85c0d676dcb2 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:42.459630 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f73a1-60cc-48f9-b862-85c0d676dcb2 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:42.459825 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f73a1-60cc-48f9-b862-85c0d676dcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:42.462689 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7f326-9e08-4d74-a3a3-f9f79168bb63 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:42.462982 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7f326-9e08-4d74-a3a3-f9f79168bb63 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:42.463265 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7f326-9e08-4d74-a3a3-f9f79168bb63 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:42.464626 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 13/23] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:04:42.470661 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e89e5-e2b0-4ed4-8aaa-26b8f00e365f None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:42.470959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e89e5-e2b0-4ed4-8aaa-26b8f00e365f None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:42.471243 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e89e5-e2b0-4ed4-8aaa-26b8f00e365f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:42.492054 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG passlib.handlers.bcrypt [None req-4f7f73a1-60cc-48f9-b862-85c0d676dcb2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80521) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 11 11:04:42.492811 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG passlib.handlers.bcrypt [None req-4f7f73a1-60cc-48f9-b862-85c0d676dcb2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80521) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 11 11:04:42.507466 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-e90e89e5-e2b0-4ed4-8aaa-26b8f00e365f None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:04:42.508698 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-e90e89e5-e2b0-4ed4-8aaa-26b8f00e365f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:04:42.544793 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-4f7f73a1-60cc-48f9-b862-85c0d676dcb2 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:04:42.546601 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4f7f73a1-60cc-48f9-b862-85c0d676dcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:04:42.668195 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 14/24] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:04:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:04:42.694671 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 11/25] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:04:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:04:42.711333 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e89e5-e2b0-4ed4-8aaa-26b8f00e365f None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:42.732382 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f73a1-60cc-48f9-b862-85c0d676dcb2 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:42.793423 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:42.886496 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:42.897062 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e89e5-e2b0-4ed4-8aaa-26b8f00e365f None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:42.901802 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f73a1-60cc-48f9-b862-85c0d676dcb2 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:42.940710 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222ac49-feb2-4667-a615-afef0375818e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:42.942370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222ac49-feb2-4667-a615-afef0375818e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:42.942877 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222ac49-feb2-4667-a615-afef0375818e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:42.943442 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222ac49-feb2-4667-a615-afef0375818e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:42.945206 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c06aa-db72-490a-9193-65d9f019f401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:42.946205 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c06aa-db72-490a-9193-65d9f019f401 None admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:42.946505 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c06aa-db72-490a-9193-65d9f019f401 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:42.946795 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c06aa-db72-490a-9193-65d9f019f401 None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:42.948030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c06aa-db72-490a-9193-65d9f019f401 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:42.949458 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c06aa-db72-490a-9193-65d9f019f401 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:42.956665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222ac49-feb2-4667-a615-afef0375818e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:04:42.965683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-c222ac49-feb2-4667-a615-afef0375818e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:04:42.965683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:04:42.965683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:04:42.965683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:04:42.965683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:04:42.965683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:04:42.965683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:04:42.965683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:04:42.965683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:04:42.965683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:04:42.965683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:04:42.965683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:04:42.965683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:04:42.965683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:04:42.965683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:04:42.965683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:04:42.966569 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:04:42.966569 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:04:42.966569 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:04:42.966569 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:04:42.966569 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:04:42.966569 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:04:42.966569 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:04:42.966569 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:04:42.966569 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:04:42.966569 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:04:42.966569 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:04:42.966569 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:04:42.966569 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:04:42.966569 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:04:42.966569 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:04:42.966569 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:04:42.967407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:04:42.967407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:04:42.967407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:04:42.967407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:04:42.967407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:04:42.967407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:04:42.967407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:04:42.967407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:04:42.967407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:04:42.967407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:04:42.967407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:04:42.967407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:04:42.967407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 12/26] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:04:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:04:42.968724 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d3510-0956-46cc-b2ad-1d1e6add4fbc None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:42.969081 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d3510-0956-46cc-b2ad-1d1e6add4fbc None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:42.969429 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d3510-0956-46cc-b2ad-1d1e6add4fbc None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:42.975549 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 13/27] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:04:42.975549 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ced25f-fea0-4410-9e27-22d10a7f2277 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:42.975549 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ced25f-fea0-4410-9e27-22d10a7f2277 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:42.975549 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ced25f-fea0-4410-9e27-22d10a7f2277 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:42.975549 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 14/28] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:04:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:04:42.976703 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc49b27-271c-44d4-b887-28cb54c52f60 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:42.977091 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc49b27-271c-44d4-b887-28cb54c52f60 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:42.977434 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc49b27-271c-44d4-b887-28cb54c52f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:42.997617 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-1fc49b27-271c-44d4-b887-28cb54c52f60 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:04:42.998852 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1fc49b27-271c-44d4-b887-28cb54c52f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:04:43.074158 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 15/29] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:04:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:04:43.075327 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc49b27-271c-44d4-b887-28cb54c52f60 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:43.094137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:43.153064 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 15/30] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Jul 11 11:04:42 2022] POST /identity/v3/roles => generated 219 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:04:43.159290 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd2d24-1649-4b92-b780-b1708b0a9cb5 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:43.159468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd2d24-1649-4b92-b780-b1708b0a9cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:43.159651 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd2d24-1649-4b92-b780-b1708b0a9cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:43.185907 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc49b27-271c-44d4-b887-28cb54c52f60 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:43.194075 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-a5dd2d24-1649-4b92-b780-b1708b0a9cb5 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:04:43.196035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-a5dd2d24-1649-4b92-b780-b1708b0a9cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:04:43.229612 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418de18-045b-44f7-9071-a8f7bdfd2249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:43.230660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418de18-045b-44f7-9071-a8f7bdfd2249 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:43.231169 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418de18-045b-44f7-9071-a8f7bdfd2249 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:43.231649 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418de18-045b-44f7-9071-a8f7bdfd2249 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:43.232643 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418de18-045b-44f7-9071-a8f7bdfd2249 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:04:43.233187 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418de18-045b-44f7-9071-a8f7bdfd2249 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:43.235239 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418de18-045b-44f7-9071-a8f7bdfd2249 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:43.246925 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 16/31] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:04:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:04:43.248352 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418de18-045b-44f7-9071-a8f7bdfd2249 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:43.347426 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:43.374242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418de18-045b-44f7-9071-a8f7bdfd2249 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:43.379004 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 16/32] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:04:43.380097 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd2d24-1649-4b92-b780-b1708b0a9cb5 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:43.428035 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51936ccc-917f-40f8-898a-00c397365dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:43.429160 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51936ccc-917f-40f8-898a-00c397365dba None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:43.429727 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51936ccc-917f-40f8-898a-00c397365dba None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:43.430245 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51936ccc-917f-40f8-898a-00c397365dba None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:43.431201 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51936ccc-917f-40f8-898a-00c397365dba None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:43.433283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51936ccc-917f-40f8-898a-00c397365dba None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:43.495216 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:43.516147 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd2d24-1649-4b92-b780-b1708b0a9cb5 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:43.552218 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb34be-6332-46ea-8e43-1050f5c0b7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:43.553834 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb34be-6332-46ea-8e43-1050f5c0b7f5 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:43.554160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb34be-6332-46ea-8e43-1050f5c0b7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:43.554442 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb34be-6332-46ea-8e43-1050f5c0b7f5 None admin] PATH_INFO: `/v3/users/d07257ebe5bd4aaa947d43762dac11d9` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:43.555663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb34be-6332-46ea-8e43-1050f5c0b7f5 None admin] RBAC: Authorizing `identity:get_user(user_id=d07257ebe5bd4aaa947d43762dac11d9)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:43.557276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb34be-6332-46ea-8e43-1050f5c0b7f5 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:43.564026 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 17/33] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:04:43 2022] GET /identity/v3/users/d07257ebe5bd4aaa947d43762dac11d9 => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:04:43.564026 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb34be-6332-46ea-8e43-1050f5c0b7f5 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:43.621699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 17/34] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Jul 11 11:04:43 2022] POST /identity/v3/roles => generated 225 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:04:43.623281 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04666e-d9e8-427c-90dc-107b7733f223 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:43.623582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04666e-d9e8-427c-90dc-107b7733f223 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:43.624135 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04666e-d9e8-427c-90dc-107b7733f223 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:43.630023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 18/35] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:04:43.630023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04666e-d9e8-427c-90dc-107b7733f223 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:43.697621 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb34be-6332-46ea-8e43-1050f5c0b7f5 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:43.745189 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72ca8d-f8c9-4fea-85b9-ab004e01aecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:43.746537 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72ca8d-f8c9-4fea-85b9-ab004e01aecf None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:43.747045 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72ca8d-f8c9-4fea-85b9-ab004e01aecf None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:43.747529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72ca8d-f8c9-4fea-85b9-ab004e01aecf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:43.765946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72ca8d-f8c9-4fea-85b9-ab004e01aecf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:43.768210 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72ca8d-f8c9-4fea-85b9-ab004e01aecf None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:43.786855 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04666e-d9e8-427c-90dc-107b7733f223 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:43.794134 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-1e72ca8d-f8c9-4fea-85b9-ab004e01aecf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:04:43.794134 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:04:43.794134 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:04:43.794134 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:04:43.794134 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:04:43.794134 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:04:43.794134 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:04:43.794134 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:04:43.794134 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:04:43.794134 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:04:43.794134 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:04:43.794134 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:04:43.794134 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:04:43.794134 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:04:43.794134 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:04:43.794979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:04:43.794979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:04:43.794979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:04:43.794979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:04:43.794979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:04:43.794979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:04:43.794979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:04:43.794979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:04:43.794979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:04:43.794979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:04:43.794979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:04:43.794979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:04:43.794979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:04:43.794979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:04:43.794979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:04:43.794979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:04:43.794979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:04:43.795764 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:04:43.795764 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:04:43.795764 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:04:43.795764 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:04:43.796332 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 18/36] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:04:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:04:43.801215 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebbf3d-cfee-47e3-a164-0f20ab93fcb3 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:43.801215 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebbf3d-cfee-47e3-a164-0f20ab93fcb3 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:43.801215 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebbf3d-cfee-47e3-a164-0f20ab93fcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:43.808071 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:43.822412 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-b7ebbf3d-cfee-47e3-a164-0f20ab93fcb3 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:04:43.823919 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-b7ebbf3d-cfee-47e3-a164-0f20ab93fcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:04:43.840305 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883bf223-af52-499b-90cd-3ce8071c3b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:43.841124 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bf223-af52-499b-90cd-3ce8071c3b4c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:43.841409 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bf223-af52-499b-90cd-3ce8071c3b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:43.841693 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bf223-af52-499b-90cd-3ce8071c3b4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:43.843866 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883bf223-af52-499b-90cd-3ce8071c3b4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:43.845436 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883bf223-af52-499b-90cd-3ce8071c3b4c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:43.847164 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 19/37] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:04:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:04:43.847951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883bf223-af52-499b-90cd-3ce8071c3b4c None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:43.857240 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:43.913848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 19/38] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:04:43.913848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebbf3d-cfee-47e3-a164-0f20ab93fcb3 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:43.952125 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883bf223-af52-499b-90cd-3ce8071c3b4c None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:43.985815 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1ce2f-d2fb-43a1-a7e4-5538c261321e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:43.986484 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1ce2f-d2fb-43a1-a7e4-5538c261321e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:43.986773 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1ce2f-d2fb-43a1-a7e4-5538c261321e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:43.987059 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1ce2f-d2fb-43a1-a7e4-5538c261321e None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:43.987796 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1ce2f-d2fb-43a1-a7e4-5538c261321e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:04:43.988110 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1ce2f-d2fb-43a1-a7e4-5538c261321e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:43.989509 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1ce2f-d2fb-43a1-a7e4-5538c261321e None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:44.010238 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 20/39] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:04:44.010970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1ce2f-d2fb-43a1-a7e4-5538c261321e None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:44.018104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebbf3d-cfee-47e3-a164-0f20ab93fcb3 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:44.054063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0badd43c-d599-49b9-83b9-ab3a0e1ff827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:44.054928 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badd43c-d599-49b9-83b9-ab3a0e1ff827 None admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:44.055216 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badd43c-d599-49b9-83b9-ab3a0e1ff827 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:44.055495 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badd43c-d599-49b9-83b9-ab3a0e1ff827 None admin] PATH_INFO: `/v3/domains/default/users/d07257ebe5bd4aaa947d43762dac11d9/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:44.057521 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0badd43c-d599-49b9-83b9-ab3a0e1ff827 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d07257ebe5bd4aaa947d43762dac11d9, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:44.059285 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0badd43c-d599-49b9-83b9-ab3a0e1ff827 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:44.061472 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:44.076498 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:44.109319 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1ce2f-d2fb-43a1-a7e4-5538c261321e None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:44.142522 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6717604-cf9f-4e78-9c44-08a24c4c3e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:44.143196 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6717604-cf9f-4e78-9c44-08a24c4c3e63 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:44.143495 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6717604-cf9f-4e78-9c44-08a24c4c3e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:44.143780 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6717604-cf9f-4e78-9c44-08a24c4c3e63 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:44.144595 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6717604-cf9f-4e78-9c44-08a24c4c3e63 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:44.146011 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6717604-cf9f-4e78-9c44-08a24c4c3e63 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:44.164444 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 20/40] 10.222.0.23 () {58 vars in 1361 bytes} [Mon Jul 11 11:04:43 2022] PUT /identity/v3/domains/default/users/d07257ebe5bd4aaa947d43762dac11d9/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:04:44.165750 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5345392-efd8-4059-9a74-c9485b489ed1 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:44.166066 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5345392-efd8-4059-9a74-c9485b489ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:44.166347 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5345392-efd8-4059-9a74-c9485b489ed1 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:44.167717 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 21/41] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:04:44.173208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5345392-efd8-4059-9a74-c9485b489ed1 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:44.242998 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 21/42] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Jul 11 11:04:44 2022] POST /identity/v3/roles => generated 223 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:04:44.244804 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68c759-43f5-4161-b584-d33280da6eb2 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:44.245303 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68c759-43f5-4161-b584-d33280da6eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:44.245905 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68c759-43f5-4161-b584-d33280da6eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:44.265684 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-ab68c759-43f5-4161-b584-d33280da6eb2 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:04:44.268130 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ab68c759-43f5-4161-b584-d33280da6eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:04:44.369984 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 22/43] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:04:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:04:44.393757 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68c759-43f5-4161-b584-d33280da6eb2 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:44.422185 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5345392-efd8-4059-9a74-c9485b489ed1 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:44.460515 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdb393-6d24-4eab-9a48-4699237394f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:44.461192 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdb393-6d24-4eab-9a48-4699237394f5 None admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:44.461481 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdb393-6d24-4eab-9a48-4699237394f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:44.461792 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdb393-6d24-4eab-9a48-4699237394f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:44.462512 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bdb393-6d24-4eab-9a48-4699237394f5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:44.464526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bdb393-6d24-4eab-9a48-4699237394f5 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:44.486342 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:44.534919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68c759-43f5-4161-b584-d33280da6eb2 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:44.554964 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 22/44] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Jul 11 11:04:44 2022] POST /identity/v3/projects => generated 301 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:04:44.570819 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09838546-19fb-45dd-8634-aedebce1ed0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:44.571657 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09838546-19fb-45dd-8634-aedebce1ed0b None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:44.571948 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09838546-19fb-45dd-8634-aedebce1ed0b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:44.572232 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09838546-19fb-45dd-8634-aedebce1ed0b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:44.573530 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09838546-19fb-45dd-8634-aedebce1ed0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:44.575084 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09838546-19fb-45dd-8634-aedebce1ed0b None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:44.577176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 23/45] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:04:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:04:44.582458 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdb393-6d24-4eab-9a48-4699237394f5 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:44.641059 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:44.702493 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdb393-6d24-4eab-9a48-4699237394f5 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:44.741798 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfac7b8-ef41-4daa-be7f-f883ded47743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:44.742470 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfac7b8-ef41-4daa-be7f-f883ded47743 None admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:44.742766 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfac7b8-ef41-4daa-be7f-f883ded47743 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:44.743114 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfac7b8-ef41-4daa-be7f-f883ded47743 None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:44.743881 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfac7b8-ef41-4daa-be7f-f883ded47743 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:44.745377 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfac7b8-ef41-4daa-be7f-f883ded47743 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:44.852953 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 23/46] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Jul 11 11:04:44 2022] POST /identity/v3/projects => generated 312 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:04:46.259462 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ec37e-c617-40ad-bd33-808f5504e98a None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:46.260012 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ec37e-c617-40ad-bd33-808f5504e98a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:46.260012 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ec37e-c617-40ad-bd33-808f5504e98a None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:46.261417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 24/47] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:04:46.266775 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90209be2-6bc8-4110-91b6-d8f61ed9cf0e None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:46.267203 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90209be2-6bc8-4110-91b6-d8f61ed9cf0e None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:46.267345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90209be2-6bc8-4110-91b6-d8f61ed9cf0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:46.283658 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-90209be2-6bc8-4110-91b6-d8f61ed9cf0e None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:04:46.284829 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-90209be2-6bc8-4110-91b6-d8f61ed9cf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:04:46.350738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 24/48] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:04:46.373893 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ec37e-c617-40ad-bd33-808f5504e98a None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:46.474108 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ec37e-c617-40ad-bd33-808f5504e98a None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:46.498815 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:46.521249 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08094b-af7d-4007-9bae-edb8f7865d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:46.521249 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08094b-af7d-4007-9bae-edb8f7865d4d None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:46.521249 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08094b-af7d-4007-9bae-edb8f7865d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:46.521249 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08094b-af7d-4007-9bae-edb8f7865d4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:46.521820 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08094b-af7d-4007-9bae-edb8f7865d4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:04:46.528469 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-2e08094b-af7d-4007-9bae-edb8f7865d4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:04:46.528469 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:04:46.528469 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:04:46.528469 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:04:46.528469 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:04:46.528469 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:04:46.528469 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:04:46.528469 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:04:46.528469 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:04:46.528469 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:04:46.528469 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:04:46.528469 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:04:46.528469 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:04:46.528469 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:04:46.528469 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:04:46.528469 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:04:46.529434 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:04:46.529434 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:04:46.529434 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:04:46.529434 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:04:46.529434 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:04:46.529434 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:04:46.529434 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:04:46.529434 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:04:46.529434 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:04:46.529434 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:04:46.529434 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:04:46.529434 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:04:46.529434 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:04:46.529434 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:04:46.529434 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:04:46.529434 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:04:46.530196 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:04:46.530196 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:04:46.530196 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:04:46.530196 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:04:46.530196 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:04:46.530196 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:04:46.530196 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:04:46.530196 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:04:46.530196 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:04:46.530196 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:04:46.530196 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:04:46.530196 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:04:46.530196 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 25/49] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:04:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:04:46.535534 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90209be2-6bc8-4110-91b6-d8f61ed9cf0e None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:46.564581 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:46.637056 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90209be2-6bc8-4110-91b6-d8f61ed9cf0e None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:46.671359 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92946ec0-67cc-4d8e-8173-d7a463d49ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:46.672031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92946ec0-67cc-4d8e-8173-d7a463d49ebe None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:46.672318 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92946ec0-67cc-4d8e-8173-d7a463d49ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:46.672602 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92946ec0-67cc-4d8e-8173-d7a463d49ebe None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:46.673358 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92946ec0-67cc-4d8e-8173-d7a463d49ebe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:04:46.673668 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92946ec0-67cc-4d8e-8173-d7a463d49ebe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:46.675093 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92946ec0-67cc-4d8e-8173-d7a463d49ebe None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:46.687220 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 25/50] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:04:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:04:46.692989 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08094b-af7d-4007-9bae-edb8f7865d4d None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:46.795864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08094b-af7d-4007-9bae-edb8f7865d4d None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:46.830549 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f26750-a805-44af-ac11-3ace49103375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:46.831431 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f26750-a805-44af-ac11-3ace49103375 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:46.831732 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f26750-a805-44af-ac11-3ace49103375 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:46.832007 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f26750-a805-44af-ac11-3ace49103375 None admin] PATH_INFO: `/v3/users/d07257ebe5bd4aaa947d43762dac11d9` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:46.833441 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f26750-a805-44af-ac11-3ace49103375 None admin] RBAC: Authorizing `identity:get_user(user_id=d07257ebe5bd4aaa947d43762dac11d9)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:46.835457 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f26750-a805-44af-ac11-3ace49103375 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:46.837122 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 26/51] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:04:46 2022] GET /identity/v3/users/d07257ebe5bd4aaa947d43762dac11d9 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:04:46.842634 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92946ec0-67cc-4d8e-8173-d7a463d49ebe None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:46.900200 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609978c1-a039-4432-a42c-65d0a1758a9e None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:46.900630 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609978c1-a039-4432-a42c-65d0a1758a9e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:46.901034 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609978c1-a039-4432-a42c-65d0a1758a9e None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:46.902831 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 27/52] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:04:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:04:46.907490 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c78bf-f412-49e5-8ccc-0c0c63dd21a9 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:46.907796 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c78bf-f412-49e5-8ccc-0c0c63dd21a9 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:46.908078 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c78bf-f412-49e5-8ccc-0c0c63dd21a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:46.925258 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-a34c78bf-f412-49e5-8ccc-0c0c63dd21a9 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:04:46.926511 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a34c78bf-f412-49e5-8ccc-0c0c63dd21a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:04:46.934229 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:46.943881 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92946ec0-67cc-4d8e-8173-d7a463d49ebe None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:46.975097 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:46.977688 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22687e89-135e-4881-a696-13448ad2f983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:46.978532 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22687e89-135e-4881-a696-13448ad2f983 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:46.978875 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22687e89-135e-4881-a696-13448ad2f983 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:46.979161 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22687e89-135e-4881-a696-13448ad2f983 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:46.980333 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22687e89-135e-4881-a696-13448ad2f983 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:46.981817 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22687e89-135e-4881-a696-13448ad2f983 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:46.983449 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:04:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:04:46.989213 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22687e89-135e-4881-a696-13448ad2f983 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:46.994217 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 28/54] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:04:47.017780 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c78bf-f412-49e5-8ccc-0c0c63dd21a9 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:47.088466 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22687e89-135e-4881-a696-13448ad2f983 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:47.115818 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c78bf-f412-49e5-8ccc-0c0c63dd21a9 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:47.120750 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaaf0e9-06f0-421c-bb5b-6ca01a89729e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:47.121401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaaf0e9-06f0-421c-bb5b-6ca01a89729e None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:47.121691 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaaf0e9-06f0-421c-bb5b-6ca01a89729e None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:47.122002 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaaf0e9-06f0-421c-bb5b-6ca01a89729e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:47.122952 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaaf0e9-06f0-421c-bb5b-6ca01a89729e None admin] RBAC: Adding query filter params (role.id=736e70deba004b9289c2fed43eb107f7, scope.domain.id=default, user.id=d07257ebe5bd4aaa947d43762dac11d9) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:04:47.123268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaaf0e9-06f0-421c-bb5b-6ca01a89729e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:47.124735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaaf0e9-06f0-421c-bb5b-6ca01a89729e None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:47.133559 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1322 bytes} [Mon Jul 11 11:04:46 2022] GET /identity/v3/role_assignments?user.id=d07257ebe5bd4aaa947d43762dac11d9&scope.domain.id=default&role.id=736e70deba004b9289c2fed43eb107f7 => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:04:47.261141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee385d-d2d0-45bf-9cda-ac69a90e6eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:47.261986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee385d-d2d0-45bf-9cda-ac69a90e6eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:47.262286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee385d-d2d0-45bf-9cda-ac69a90e6eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:47.262569 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee385d-d2d0-45bf-9cda-ac69a90e6eb4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:47.263782 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee385d-d2d0-45bf-9cda-ac69a90e6eb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:47.265274 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee385d-d2d0-45bf-9cda-ac69a90e6eb4 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:47.266992 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 29/56] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:04:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:04:47.273515 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaaf0e9-06f0-421c-bb5b-6ca01a89729e None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:47.300835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:47.378625 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaaf0e9-06f0-421c-bb5b-6ca01a89729e None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:47.411650 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71963d8-8cc1-48ee-a722-2a16a322a506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:47.412863 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71963d8-8cc1-48ee-a722-2a16a322a506 None admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:47.413145 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71963d8-8cc1-48ee-a722-2a16a322a506 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:47.413421 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71963d8-8cc1-48ee-a722-2a16a322a506 None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:47.414181 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71963d8-8cc1-48ee-a722-2a16a322a506 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:47.415633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71963d8-8cc1-48ee-a722-2a16a322a506 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:47.514105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 28/57] 10.222.0.23 () {60 vars in 1140 bytes} [Mon Jul 11 11:04:47 2022] POST /identity/v3/projects => generated 298 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:04:49.553483 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45abd1-ec3a-4c02-b0cc-42297d4d0577 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:49.554029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45abd1-ec3a-4c02-b0cc-42297d4d0577 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:49.554133 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45abd1-ec3a-4c02-b0cc-42297d4d0577 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:49.555461 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 30/58] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:04:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:04:49.560905 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ca2fb-4c44-47eb-83a6-5b7d5a256059 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:49.561305 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ca2fb-4c44-47eb-83a6-5b7d5a256059 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:49.561501 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ca2fb-4c44-47eb-83a6-5b7d5a256059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:49.578251 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-ac7ca2fb-4c44-47eb-83a6-5b7d5a256059 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:04:49.579535 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-ac7ca2fb-4c44-47eb-83a6-5b7d5a256059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:04:49.645258 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 29/59] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:04:49.670742 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45abd1-ec3a-4c02-b0cc-42297d4d0577 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:49.720599 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:49.770746 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45abd1-ec3a-4c02-b0cc-42297d4d0577 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:49.804305 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4260b1c-c390-4c4f-bf12-70dc88702b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:49.805038 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4260b1c-c390-4c4f-bf12-70dc88702b30 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:49.805325 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4260b1c-c390-4c4f-bf12-70dc88702b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:49.805693 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4260b1c-c390-4c4f-bf12-70dc88702b30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:49.806906 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4260b1c-c390-4c4f-bf12-70dc88702b30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:49.808603 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4260b1c-c390-4c4f-bf12-70dc88702b30 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:49.810256 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 31/60] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:04:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:04:49.815725 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ca2fb-4c44-47eb-83a6-5b7d5a256059 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:49.819290 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:49.915737 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ca2fb-4c44-47eb-83a6-5b7d5a256059 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:49.948594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f793355-096d-436d-8ae5-f29e594bb48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:49.949258 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f793355-096d-436d-8ae5-f29e594bb48d None admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:49.949541 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f793355-096d-436d-8ae5-f29e594bb48d None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:49.949845 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f793355-096d-436d-8ae5-f29e594bb48d None admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:49.955125 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f793355-096d-436d-8ae5-f29e594bb48d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:49.955125 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f793355-096d-436d-8ae5-f29e594bb48d None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:50.080518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 30/61] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jul 11 11:04:49 2022] POST /identity/v3/users => generated 275 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:04:53.558088 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609604c2-084e-41a9-9361-6be0d40aff0a None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:53.559654 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609604c2-084e-41a9-9361-6be0d40aff0a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:53.560446 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609604c2-084e-41a9-9361-6be0d40aff0a None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:53.563291 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 32/62] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:04:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:04:53.569936 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e12cd9-ab03-48cf-9f42-e7b2b46afefc None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:53.571290 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e12cd9-ab03-48cf-9f42-e7b2b46afefc None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:53.572122 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e12cd9-ab03-48cf-9f42-e7b2b46afefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:53.603592 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-71e12cd9-ab03-48cf-9f42-e7b2b46afefc None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:04:53.604797 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-71e12cd9-ab03-48cf-9f42-e7b2b46afefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:04:53.696588 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:53.711694 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 31/63] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:04:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:04:53.750261 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609604c2-084e-41a9-9361-6be0d40aff0a None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:54.016548 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609604c2-084e-41a9-9361-6be0d40aff0a None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:54.057242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:54.086515 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a718a-8554-45dd-b38e-20fabd099932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:54.087337 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a718a-8554-45dd-b38e-20fabd099932 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:54.087629 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a718a-8554-45dd-b38e-20fabd099932 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:54.087914 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a718a-8554-45dd-b38e-20fabd099932 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:54.102899 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a718a-8554-45dd-b38e-20fabd099932 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:04:54.111070 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a854806-1461-4750-8def-c824b82e63d7 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:54.111621 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a854806-1461-4750-8def-c824b82e63d7 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:54.111930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-ae1a718a-8554-45dd-b38e-20fabd099932 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:04:54.111930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:04:54.111930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:04:54.111930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:04:54.111930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:04:54.111930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:04:54.111930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:04:54.111930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:04:54.111930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:04:54.111930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:04:54.111930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:04:54.111930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:04:54.111930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:04:54.111930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:04:54.111930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:04:54.111930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:04:54.112756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:04:54.112756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:04:54.112756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:04:54.112756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:04:54.112756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:04:54.112756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:04:54.112756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:04:54.112756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:04:54.112756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:04:54.112756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:04:54.112756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:04:54.112756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:04:54.112756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:04:54.112756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:04:54.112756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:04:54.112756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:04:54.113493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:04:54.113493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:04:54.113493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:04:54.113493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:04:54.113493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:04:54.113493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:04:54.113493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:04:54.113493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:04:54.113493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:04:54.113493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:04:54.113493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:04:54.113493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:04:54.113493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 33/64] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:04:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:04:54.114955 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a854806-1461-4750-8def-c824b82e63d7 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:54.116589 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 32/65] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:04:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:04:54.120422 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a718a-8554-45dd-b38e-20fabd099932 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:54.122145 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45307ec-1193-41e9-ba2b-6fe561010440 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:54.122754 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45307ec-1193-41e9-ba2b-6fe561010440 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:54.123235 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45307ec-1193-41e9-ba2b-6fe561010440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:54.154522 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-e45307ec-1193-41e9-ba2b-6fe561010440 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:04:54.156996 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-e45307ec-1193-41e9-ba2b-6fe561010440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:04:54.245209 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 33/66] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:04:54.246569 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b29461-cb23-47a7-9fdb-1357b3466a76 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:54.246870 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b29461-cb23-47a7-9fdb-1357b3466a76 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:54.247157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b29461-cb23-47a7-9fdb-1357b3466a76 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:54.248446 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 34/67] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:04:54.249510 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e3f4b-8541-4728-8f03-7ea00c14519f None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:54.249970 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e3f4b-8541-4728-8f03-7ea00c14519f None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:54.250136 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e3f4b-8541-4728-8f03-7ea00c14519f None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:54.251409 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 35/68] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:04:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:04:54.252390 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d497682-3dbc-42df-98e1-db11c0e215eb None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:54.252687 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d497682-3dbc-42df-98e1-db11c0e215eb None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:54.252957 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d497682-3dbc-42df-98e1-db11c0e215eb None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:54.254210 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 36/69] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:04:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:04:54.255256 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddac7c0-286b-474c-942d-7f118638c69d None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:54.255620 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddac7c0-286b-474c-942d-7f118638c69d None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:54.255998 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddac7c0-286b-474c-942d-7f118638c69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:54.263195 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a718a-8554-45dd-b38e-20fabd099932 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:54.272970 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-9ddac7c0-286b-474c-942d-7f118638c69d None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:04:54.274140 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-9ddac7c0-286b-474c-942d-7f118638c69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:04:54.297365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fea383-563a-4960-bc83-b4015eb573c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:54.298075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fea383-563a-4960-bc83-b4015eb573c6 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:54.298365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fea383-563a-4960-bc83-b4015eb573c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:54.298646 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fea383-563a-4960-bc83-b4015eb573c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:54.299400 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fea383-563a-4960-bc83-b4015eb573c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:04:54.299716 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fea383-563a-4960-bc83-b4015eb573c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:54.301075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fea383-563a-4960-bc83-b4015eb573c6 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:54.309705 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 34/70] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jul 11 11:04:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:04:54.314213 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce701df5-276d-4013-8bba-e69b8daffcea None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:54.314213 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce701df5-276d-4013-8bba-e69b8daffcea None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:54.314213 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce701df5-276d-4013-8bba-e69b8daffcea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:54.327009 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-ce701df5-276d-4013-8bba-e69b8daffcea None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:04:54.328208 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ce701df5-276d-4013-8bba-e69b8daffcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:04:54.340978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 37/71] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:04:54.342122 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee07a1-1aa6-443a-af2e-865b4c0d4d81 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:54.342419 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee07a1-1aa6-443a-af2e-865b4c0d4d81 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:54.342702 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee07a1-1aa6-443a-af2e-865b4c0d4d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:54.359126 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-2eee07a1-1aa6-443a-af2e-865b4c0d4d81 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:04:54.360465 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-2eee07a1-1aa6-443a-af2e-865b4c0d4d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:04:54.372686 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:54.405288 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 35/72] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:04:54.406149 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce701df5-276d-4013-8bba-e69b8daffcea None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:54.410873 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:54.430637 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 38/73] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:04:54.431470 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee07a1-1aa6-443a-af2e-865b4c0d4d81 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:54.513265 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce701df5-276d-4013-8bba-e69b8daffcea None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:54.531273 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee07a1-1aa6-443a-af2e-865b4c0d4d81 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:54.546886 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4774fed-519a-4e34-b402-77707296018f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:54.547688 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4774fed-519a-4e34-b402-77707296018f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:54.547970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4774fed-519a-4e34-b402-77707296018f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:54.548257 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4774fed-519a-4e34-b402-77707296018f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:54.558688 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4774fed-519a-4e34-b402-77707296018f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:04:54.564547 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69fdd2-ae0a-427c-acfd-f4708c283780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:54.565414 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69fdd2-ae0a-427c-acfd-f4708c283780 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:54.565703 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69fdd2-ae0a-427c-acfd-f4708c283780 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:54.566040 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69fdd2-ae0a-427c-acfd-f4708c283780 None admin] PATH_INFO: `/v3/users/ea2579845baa4661a50c96046959ebc2` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:54.566637 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-b4774fed-519a-4e34-b402-77707296018f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:04:54.566637 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:04:54.566637 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:04:54.566637 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:04:54.566637 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:04:54.566637 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:04:54.566637 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:04:54.566637 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:04:54.566637 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:04:54.566637 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:04:54.566637 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:04:54.566637 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:04:54.566637 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:04:54.566637 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:04:54.566637 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:04:54.566637 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:04:54.567453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:04:54.567453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:04:54.567453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:04:54.567453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:04:54.567453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:04:54.567453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:04:54.567453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:04:54.567453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:04:54.567453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:04:54.567453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:04:54.567453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:04:54.567453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:04:54.567453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:04:54.567453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:04:54.567453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:04:54.567453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:04:54.568837 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:04:54.568837 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:04:54.568837 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:04:54.568837 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:04:54.568837 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:04:54.568837 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:04:54.568837 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:04:54.568837 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:04:54.568837 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:04:54.568837 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:04:54.568837 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:04:54.568837 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:04:54.568837 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 36/74] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jul 11 11:04:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:04:54.569452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4774fed-519a-4e34-b402-77707296018f None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:54.582626 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69fdd2-ae0a-427c-acfd-f4708c283780 None admin] RBAC: Authorizing `identity:get_user(user_id=ea2579845baa4661a50c96046959ebc2)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:54.584231 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69fdd2-ae0a-427c-acfd-f4708c283780 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:54.585976 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 39/75] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:04:54 2022] GET /identity/v3/users/ea2579845baa4661a50c96046959ebc2 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:04:54.586745 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69fdd2-ae0a-427c-acfd-f4708c283780 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:54.602193 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:54.628632 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:54.670431 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4774fed-519a-4e34-b402-77707296018f None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:54.689110 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69fdd2-ae0a-427c-acfd-f4708c283780 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:54.704125 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd513b-e9de-4bac-b1c3-5546146e7443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:54.704925 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd513b-e9de-4bac-b1c3-5546146e7443 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:54.705220 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd513b-e9de-4bac-b1c3-5546146e7443 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:54.705508 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd513b-e9de-4bac-b1c3-5546146e7443 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:54.706770 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd513b-e9de-4bac-b1c3-5546146e7443 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:54.708264 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd513b-e9de-4bac-b1c3-5546146e7443 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:54.710040 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 37/76] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:04:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:04:54.710825 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd513b-e9de-4bac-b1c3-5546146e7443 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:54.723922 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad797394-7e14-4116-bfc1-0e58572423db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:54.725252 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad797394-7e14-4116-bfc1-0e58572423db None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:54.725539 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad797394-7e14-4116-bfc1-0e58572423db None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:54.725856 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad797394-7e14-4116-bfc1-0e58572423db None admin] PATH_INFO: `/v3/roles/member` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:54.737360 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad797394-7e14-4116-bfc1-0e58572423db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:04:54.746619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-ad797394-7e14-4116-bfc1-0e58572423db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:04:54.746619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:04:54.746619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:04:54.746619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:04:54.746619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:04:54.746619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:04:54.746619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:04:54.746619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:04:54.746619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:04:54.746619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:04:54.746619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:04:54.746619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:04:54.746619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:04:54.746619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:04:54.746619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:04:54.746619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:04:54.747663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:04:54.747663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:04:54.747663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:04:54.747663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:04:54.747663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:04:54.747663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:04:54.747663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:04:54.747663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:04:54.747663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:04:54.747663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:04:54.747663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:04:54.747663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:04:54.747663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:04:54.747663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:04:54.747663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:04:54.747663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:04:54.753478 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:04:54.753478 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:04:54.753478 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:04:54.753478 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:04:54.753478 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:04:54.753478 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:04:54.753478 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:04:54.753478 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:04:54.753478 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:04:54.753478 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:04:54.753478 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:04:54.753478 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:04:54.753478 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 40/77] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:04:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:04:54.753478 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad797394-7e14-4116-bfc1-0e58572423db None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:54.811883 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:54.815421 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd513b-e9de-4bac-b1c3-5546146e7443 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:54.846983 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:54.850004 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0efe46-0eb1-4253-8c6e-b5e38de0db41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:54.850806 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0efe46-0eb1-4253-8c6e-b5e38de0db41 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:54.851098 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0efe46-0eb1-4253-8c6e-b5e38de0db41 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:54.851213 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad797394-7e14-4116-bfc1-0e58572423db None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:54.851383 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0efe46-0eb1-4253-8c6e-b5e38de0db41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:54.861815 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0efe46-0eb1-4253-8c6e-b5e38de0db41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:04:54.869600 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-ed0efe46-0eb1-4253-8c6e-b5e38de0db41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:04:54.869600 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:04:54.869600 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:04:54.869600 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:04:54.869600 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:04:54.869600 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:04:54.869600 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:04:54.869600 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:04:54.869600 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:04:54.869600 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:04:54.869600 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:04:54.869600 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:04:54.869600 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:04:54.869600 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:04:54.869600 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:04:54.869600 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:04:54.870548 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:04:54.870548 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:04:54.870548 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:04:54.870548 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:04:54.870548 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:04:54.870548 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:04:54.870548 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:04:54.870548 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:04:54.870548 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:04:54.870548 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:04:54.870548 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:04:54.870548 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:04:54.870548 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:04:54.870548 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:04:54.870548 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:04:54.870548 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:04:54.871330 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:04:54.871330 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:04:54.871330 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:04:54.871330 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:04:54.871330 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:04:54.871330 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:04:54.871330 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:04:54.871330 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:04:54.871330 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:04:54.871330 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:04:54.871330 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:04:54.871330 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:04:54.871330 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 38/78] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:04:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:04:54.872020 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0efe46-0eb1-4253-8c6e-b5e38de0db41 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:54.885260 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884464c-86e4-489a-abeb-1bbc84fcda00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:54.886001 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884464c-86e4-489a-abeb-1bbc84fcda00 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:54.886298 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884464c-86e4-489a-abeb-1bbc84fcda00 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:54.886585 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884464c-86e4-489a-abeb-1bbc84fcda00 None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:54.887348 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884464c-86e4-489a-abeb-1bbc84fcda00 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:04:54.887670 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884464c-86e4-489a-abeb-1bbc84fcda00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:54.889075 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884464c-86e4-489a-abeb-1bbc84fcda00 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:54.898872 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 41/79] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:04:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:04:54.899648 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884464c-86e4-489a-abeb-1bbc84fcda00 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:54.976233 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0efe46-0eb1-4253-8c6e-b5e38de0db41 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:54.998530 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884464c-86e4-489a-abeb-1bbc84fcda00 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:55.008782 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afeead6-3d45-4a18-bfdc-7d864833d06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:55.009441 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afeead6-3d45-4a18-bfdc-7d864833d06e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:55.009734 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afeead6-3d45-4a18-bfdc-7d864833d06e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:55.010052 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afeead6-3d45-4a18-bfdc-7d864833d06e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:55.033716 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf1e52-bd19-4725-b3e8-be73b7088e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:55.034402 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf1e52-bd19-4725-b3e8-be73b7088e16 None admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:55.034688 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf1e52-bd19-4725-b3e8-be73b7088e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:55.034974 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf1e52-bd19-4725-b3e8-be73b7088e16 None admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:55.035689 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf1e52-bd19-4725-b3e8-be73b7088e16 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:55.036400 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:55.037904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf1e52-bd19-4725-b3e8-be73b7088e16 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:55.076509 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afeead6-3d45-4a18-bfdc-7d864833d06e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:55.077936 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afeead6-3d45-4a18-bfdc-7d864833d06e None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:55.126424 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 42/80] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jul 11 11:04:54 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:04:55.127247 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf1e52-bd19-4725-b3e8-be73b7088e16 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:55.163845 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:55.183381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 39/81] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:04:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:04:55.184380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afeead6-3d45-4a18-bfdc-7d864833d06e None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:55.251467 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:55.263399 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf1e52-bd19-4725-b3e8-be73b7088e16 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:55.305068 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afeead6-3d45-4a18-bfdc-7d864833d06e None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:55.306709 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed909f67-b1b8-4ac2-9543-ea679c600de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:55.308276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed909f67-b1b8-4ac2-9543-ea679c600de7 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:55.308276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed909f67-b1b8-4ac2-9543-ea679c600de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:55.308276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed909f67-b1b8-4ac2-9543-ea679c600de7 None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:55.309030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed909f67-b1b8-4ac2-9543-ea679c600de7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:04:55.309345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed909f67-b1b8-4ac2-9543-ea679c600de7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:55.310994 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed909f67-b1b8-4ac2-9543-ea679c600de7 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:55.320335 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 43/82] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jul 11 11:04:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:04:55.321088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed909f67-b1b8-4ac2-9543-ea679c600de7 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:55.350234 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcdb69e-5c3f-4475-8d92-c62b456add35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:55.351159 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdb69e-5c3f-4475-8d92-c62b456add35 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:55.351445 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdb69e-5c3f-4475-8d92-c62b456add35 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:55.351724 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdb69e-5c3f-4475-8d92-c62b456add35 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:55.352489 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcdb69e-5c3f-4475-8d92-c62b456add35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:04:55.352803 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcdb69e-5c3f-4475-8d92-c62b456add35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:55.354234 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcdb69e-5c3f-4475-8d92-c62b456add35 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:55.363414 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 40/83] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:04:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:04:55.364253 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcdb69e-5c3f-4475-8d92-c62b456add35 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:55.425803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:55.455215 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed909f67-b1b8-4ac2-9543-ea679c600de7 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:55.496603 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcdb69e-5c3f-4475-8d92-c62b456add35 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:55.501266 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f3d50-00a8-4965-b62e-0826cbc4aaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:55.502414 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f3d50-00a8-4965-b62e-0826cbc4aaca None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:55.502882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f3d50-00a8-4965-b62e-0826cbc4aaca None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:55.503312 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f3d50-00a8-4965-b62e-0826cbc4aaca None admin] PATH_INFO: `/v3/users/ea2579845baa4661a50c96046959ebc2` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:55.505863 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f3d50-00a8-4965-b62e-0826cbc4aaca None admin] RBAC: Authorizing `identity:get_user(user_id=ea2579845baa4661a50c96046959ebc2)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:55.508423 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f3d50-00a8-4965-b62e-0826cbc4aaca None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:55.510891 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 44/84] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:04:55 2022] GET /identity/v3/users/ea2579845baa4661a50c96046959ebc2 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:04:55.512339 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f3d50-00a8-4965-b62e-0826cbc4aaca None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:55.519136 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:55.534371 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967377a-0f27-4eaa-b70f-84b6f743d128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:55.535261 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967377a-0f27-4eaa-b70f-84b6f743d128 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:55.535555 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967377a-0f27-4eaa-b70f-84b6f743d128 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:55.535837 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967377a-0f27-4eaa-b70f-84b6f743d128 None admin] PATH_INFO: `/v3/projects/0ad20973f17243d0959845935c042b0f` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:55.537813 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967377a-0f27-4eaa-b70f-84b6f743d128 None admin] RBAC: Authorizing `identity:get_project(project_id=0ad20973f17243d0959845935c042b0f)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:55.539401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967377a-0f27-4eaa-b70f-84b6f743d128 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:55.541487 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 41/85] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:04:55 2022] GET /identity/v3/projects/0ad20973f17243d0959845935c042b0f => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:04:55.542505 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967377a-0f27-4eaa-b70f-84b6f743d128 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:55.641154 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f3d50-00a8-4965-b62e-0826cbc4aaca None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:55.656325 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967377a-0f27-4eaa-b70f-84b6f743d128 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:55.689109 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a878a5-5105-4e0b-a408-467b56c0cddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:55.690016 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a878a5-5105-4e0b-a408-467b56c0cddd None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:55.690308 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a878a5-5105-4e0b-a408-467b56c0cddd None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:55.690589 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a878a5-5105-4e0b-a408-467b56c0cddd None admin] PATH_INFO: `/v3/users/ea2579845baa4661a50c96046959ebc2` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:55.691955 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a878a5-5105-4e0b-a408-467b56c0cddd None admin] RBAC: Authorizing `identity:get_user(user_id=ea2579845baa4661a50c96046959ebc2)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:55.693847 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a878a5-5105-4e0b-a408-467b56c0cddd None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:55.695500 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 45/86] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:04:55 2022] GET /identity/v3/users/ea2579845baa4661a50c96046959ebc2 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:04:55.696383 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a878a5-5105-4e0b-a408-467b56c0cddd None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:55.698620 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66007389-0d9f-4d45-b449-233980a479fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:55.700057 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66007389-0d9f-4d45-b449-233980a479fb None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:55.701406 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66007389-0d9f-4d45-b449-233980a479fb None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:55.701915 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66007389-0d9f-4d45-b449-233980a479fb None admin] PATH_INFO: `/v3/users/d07257ebe5bd4aaa947d43762dac11d9` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:55.703398 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66007389-0d9f-4d45-b449-233980a479fb None admin] RBAC: Authorizing `identity:get_user(user_id=d07257ebe5bd4aaa947d43762dac11d9)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:55.705040 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66007389-0d9f-4d45-b449-233980a479fb None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:55.707396 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 42/87] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:04:55 2022] GET /identity/v3/users/d07257ebe5bd4aaa947d43762dac11d9 => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:04:55.709377 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66007389-0d9f-4d45-b449-233980a479fb None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:55.714518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:55.826324 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:55.840172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a878a5-5105-4e0b-a408-467b56c0cddd None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:55.870744 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66007389-0d9f-4d45-b449-233980a479fb None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:55.881393 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eea1a1-0386-4a3c-b0fb-9a44fa1740df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:55.882083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eea1a1-0386-4a3c-b0fb-9a44fa1740df None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:55.882372 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eea1a1-0386-4a3c-b0fb-9a44fa1740df None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:55.882655 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eea1a1-0386-4a3c-b0fb-9a44fa1740df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:55.914615 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacb8d4-f758-4ff8-b362-a51562270898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:55.915222 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacb8d4-f758-4ff8-b362-a51562270898 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:55.915497 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacb8d4-f758-4ff8-b362-a51562270898 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:55.915778 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacb8d4-f758-4ff8-b362-a51562270898 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:55.916624 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbacb8d4-f758-4ff8-b362-a51562270898 None admin] RBAC: Adding query filter params (role.id=16b11a05b5da4287bdd74d219dde5fb1, scope.project.id=0ad20973f17243d0959845935c042b0f, user.id=ea2579845baa4661a50c96046959ebc2) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:04:55.916942 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbacb8d4-f758-4ff8-b362-a51562270898 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:55.918409 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbacb8d4-f758-4ff8-b362-a51562270898 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:55.924552 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 43/88] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:04:55 2022] GET /identity/v3/role_assignments?user.id=ea2579845baa4661a50c96046959ebc2&scope.project.id=0ad20973f17243d0959845935c042b0f&role.id=16b11a05b5da4287bdd74d219dde5fb1 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:04:55.925115 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacb8d4-f758-4ff8-b362-a51562270898 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:55.969701 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eea1a1-0386-4a3c-b0fb-9a44fa1740df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:55.971641 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eea1a1-0386-4a3c-b0fb-9a44fa1740df None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:55.988808 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:56.039014 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacb8d4-f758-4ff8-b362-a51562270898 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:56.061483 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:56.077675 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c12713-fcd0-4101-88f6-063ddaba7e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:56.078468 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c12713-fcd0-4101-88f6-063ddaba7e4d None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:56.078673 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c12713-fcd0-4101-88f6-063ddaba7e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:56.078924 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c12713-fcd0-4101-88f6-063ddaba7e4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:56.087379 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 46/89] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:04:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:04:56.088696 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eea1a1-0386-4a3c-b0fb-9a44fa1740df None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:56.152963 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c12713-fcd0-4101-88f6-063ddaba7e4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:56.154483 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c12713-fcd0-4101-88f6-063ddaba7e4d None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:56.226820 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eea1a1-0386-4a3c-b0fb-9a44fa1740df None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:56.255850 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:56.260048 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 44/90] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:04:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:04:56.260915 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c12713-fcd0-4101-88f6-063ddaba7e4d None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:56.282476 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:56.319306 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f3884-7b8e-436f-a0b7-84ccd040a4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:56.320435 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f3884-7b8e-436f-a0b7-84ccd040a4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:56.320920 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f3884-7b8e-436f-a0b7-84ccd040a4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:56.321414 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f3884-7b8e-436f-a0b7-84ccd040a4c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:56.363423 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c12713-fcd0-4101-88f6-063ddaba7e4d None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:56.401159 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ee6d0-f626-48cb-b4f4-d938f231a2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:56.402070 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ee6d0-f626-48cb-b4f4-d938f231a2e1 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:56.402355 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ee6d0-f626-48cb-b4f4-d938f231a2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:56.402665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ee6d0-f626-48cb-b4f4-d938f231a2e1 None admin] PATH_INFO: `/v3/projects/0ad20973f17243d0959845935c042b0f` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:56.403952 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ee6d0-f626-48cb-b4f4-d938f231a2e1 None admin] RBAC: Authorizing `identity:get_project(project_id=0ad20973f17243d0959845935c042b0f)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:56.405411 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ee6d0-f626-48cb-b4f4-d938f231a2e1 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:56.407189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 45/91] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:04:56 2022] GET /identity/v3/projects/0ad20973f17243d0959845935c042b0f => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:04:56.407963 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ee6d0-f626-48cb-b4f4-d938f231a2e1 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:56.486923 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f3884-7b8e-436f-a0b7-84ccd040a4c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:56.488336 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f3884-7b8e-436f-a0b7-84ccd040a4c6 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:56.502145 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:56.514341 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ee6d0-f626-48cb-b4f4-d938f231a2e1 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:56.550194 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37095f96-7c54-418c-8fea-2c073ab869de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:56.551066 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37095f96-7c54-418c-8fea-2c073ab869de None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:56.551354 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37095f96-7c54-418c-8fea-2c073ab869de None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:56.551641 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37095f96-7c54-418c-8fea-2c073ab869de None admin] PATH_INFO: `/v3/projects/30ae024da7c54848bae86ab33b79878b` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:56.553495 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37095f96-7c54-418c-8fea-2c073ab869de None admin] RBAC: Authorizing `identity:get_project(project_id=30ae024da7c54848bae86ab33b79878b)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:56.554970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37095f96-7c54-418c-8fea-2c073ab869de None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:56.556822 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 46/92] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:04:56 2022] GET /identity/v3/projects/30ae024da7c54848bae86ab33b79878b => generated 312 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:04:56.557703 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37095f96-7c54-418c-8fea-2c073ab869de None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:56.663226 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37095f96-7c54-418c-8fea-2c073ab869de None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:56.699101 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870c59c-98d8-4a45-b7b4-74186e70dd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:56.699877 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870c59c-98d8-4a45-b7b4-74186e70dd54 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:56.700167 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870c59c-98d8-4a45-b7b4-74186e70dd54 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:56.700447 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870c59c-98d8-4a45-b7b4-74186e70dd54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:56.701284 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870c59c-98d8-4a45-b7b4-74186e70dd54 None admin] RBAC: Adding query filter params (role.id=da398232f5f14edc908b967ea8653212, scope.project.id=0ad20973f17243d0959845935c042b0f, user.id=ea2579845baa4661a50c96046959ebc2) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:04:56.701613 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870c59c-98d8-4a45-b7b4-74186e70dd54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:56.703070 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870c59c-98d8-4a45-b7b4-74186e70dd54 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:56.708653 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 47/93] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:04:56 2022] GET /identity/v3/role_assignments?user.id=ea2579845baa4661a50c96046959ebc2&scope.project.id=0ad20973f17243d0959845935c042b0f&role.id=da398232f5f14edc908b967ea8653212 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:04:56.709586 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870c59c-98d8-4a45-b7b4-74186e70dd54 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:56.740954 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:56.773133 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 47/94] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:04:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:04:56.774320 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f3884-7b8e-436f-a0b7-84ccd040a4c6 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:56.838191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:56.871045 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870c59c-98d8-4a45-b7b4-74186e70dd54 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:56.971048 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d0f27-7cfc-448e-9c9f-0b515c960bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:56.971761 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d0f27-7cfc-448e-9c9f-0b515c960bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:56.972055 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d0f27-7cfc-448e-9c9f-0b515c960bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:56.972344 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d0f27-7cfc-448e-9c9f-0b515c960bc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:56.973199 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d0f27-7cfc-448e-9c9f-0b515c960bc7 None admin] RBAC: Adding query filter params (role.id=16b11a05b5da4287bdd74d219dde5fb1, scope.project.id=30ae024da7c54848bae86ab33b79878b, user.id=ea2579845baa4661a50c96046959ebc2) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:04:56.973520 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d0f27-7cfc-448e-9c9f-0b515c960bc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:56.975717 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d0f27-7cfc-448e-9c9f-0b515c960bc7 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:56.990491 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 48/95] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:04:56 2022] GET /identity/v3/role_assignments?user.id=ea2579845baa4661a50c96046959ebc2&scope.project.id=30ae024da7c54848bae86ab33b79878b&role.id=16b11a05b5da4287bdd74d219dde5fb1 => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:04:57.049199 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f3884-7b8e-436f-a0b7-84ccd040a4c6 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:57.101072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e2e6f-b163-4599-b3aa-2f6a56a7f3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:57.101999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e2e6f-b163-4599-b3aa-2f6a56a7f3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:57.102293 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e2e6f-b163-4599-b3aa-2f6a56a7f3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:57.102576 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e2e6f-b163-4599-b3aa-2f6a56a7f3f1 None admin] PATH_INFO: `/v3/projects/0ad20973f17243d0959845935c042b0f` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:57.103858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e2e6f-b163-4599-b3aa-2f6a56a7f3f1 None admin] RBAC: Authorizing `identity:get_project(project_id=0ad20973f17243d0959845935c042b0f)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:57.105470 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e2e6f-b163-4599-b3aa-2f6a56a7f3f1 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:57.107628 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 48/96] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:04:56 2022] GET /identity/v3/projects/0ad20973f17243d0959845935c042b0f => generated 298 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:04:57.118995 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d0f27-7cfc-448e-9c9f-0b515c960bc7 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:57.255452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:57.277029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d0f27-7cfc-448e-9c9f-0b515c960bc7 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:57.325945 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70667b-b5e5-4a16-8711-faa69d706e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:57.326543 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70667b-b5e5-4a16-8711-faa69d706e05 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:57.326834 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70667b-b5e5-4a16-8711-faa69d706e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:57.327121 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70667b-b5e5-4a16-8711-faa69d706e05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:57.327964 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70667b-b5e5-4a16-8711-faa69d706e05 None admin] RBAC: Adding query filter params (role.id=736e70deba004b9289c2fed43eb107f7, scope.project.id=0ad20973f17243d0959845935c042b0f, user.id=d07257ebe5bd4aaa947d43762dac11d9) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:04:57.328283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70667b-b5e5-4a16-8711-faa69d706e05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:57.329719 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70667b-b5e5-4a16-8711-faa69d706e05 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:57.338435 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 49/97] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:04:57 2022] GET /identity/v3/role_assignments?user.id=d07257ebe5bd4aaa947d43762dac11d9&scope.project.id=0ad20973f17243d0959845935c042b0f&role.id=736e70deba004b9289c2fed43eb107f7 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:04:57.907634 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48176a1f-d28d-4dc4-9570-c60088e1dc21 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:57.908474 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48176a1f-d28d-4dc4-9570-c60088e1dc21 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:57.908918 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48176a1f-d28d-4dc4-9570-c60088e1dc21 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:57.910477 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 49/98] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:04:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:04:57.923399 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77371149-cbbe-4647-b22b-c78c9ade540e None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:57.923884 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77371149-cbbe-4647-b22b-c78c9ade540e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:57.924102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77371149-cbbe-4647-b22b-c78c9ade540e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:57.946880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-77371149-cbbe-4647-b22b-c78c9ade540e None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:04:57.948173 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-77371149-cbbe-4647-b22b-c78c9ade540e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:04:58.006789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f73a87-b109-4dfb-b3d3-df35a9d774ea None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:58.007433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f73a87-b109-4dfb-b3d3-df35a9d774ea None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:58.007907 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f73a87-b109-4dfb-b3d3-df35a9d774ea None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:58.009485 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 50/99] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:04:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:04:58.014643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc570431-1617-4eb3-bfa2-699e768ec148 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:58.015191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc570431-1617-4eb3-bfa2-699e768ec148 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:58.015684 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc570431-1617-4eb3-bfa2-699e768ec148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:58.031491 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 50/100] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:04:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:04:58.033820 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-cc570431-1617-4eb3-bfa2-699e768ec148 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:04:58.035219 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-cc570431-1617-4eb3-bfa2-699e768ec148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:04:58.068983 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77371149-cbbe-4647-b22b-c78c9ade540e None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:58.106735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 51/101] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:04:58.130972 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc570431-1617-4eb3-bfa2-699e768ec148 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:58.154173 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:58.221979 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:58.265054 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77371149-cbbe-4647-b22b-c78c9ade540e None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:58.294692 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc570431-1617-4eb3-bfa2-699e768ec148 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:58.321974 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d64ba3-1106-4282-b6c3-45908ebb9f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:58.322838 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d64ba3-1106-4282-b6c3-45908ebb9f4d None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:58.323133 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d64ba3-1106-4282-b6c3-45908ebb9f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:58.323418 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d64ba3-1106-4282-b6c3-45908ebb9f4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:58.324593 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d64ba3-1106-4282-b6c3-45908ebb9f4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:58.326070 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d64ba3-1106-4282-b6c3-45908ebb9f4d None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:58.327699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 51/102] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:04:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:04:58.333503 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d64ba3-1106-4282-b6c3-45908ebb9f4d None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:58.359527 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcad9f7-184a-47e7-9aa7-1c0719470f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:58.360688 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcad9f7-184a-47e7-9aa7-1c0719470f0b None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:58.361194 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcad9f7-184a-47e7-9aa7-1c0719470f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:58.361698 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcad9f7-184a-47e7-9aa7-1c0719470f0b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:58.379046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcad9f7-184a-47e7-9aa7-1c0719470f0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:04:58.389127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-abcad9f7-184a-47e7-9aa7-1c0719470f0b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:04:58.389127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:04:58.389127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:04:58.389127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:04:58.389127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:04:58.389127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:04:58.389127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:04:58.389127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:04:58.389127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:04:58.389127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:04:58.389127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:04:58.389127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:04:58.389127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:04:58.389127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:04:58.389127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:04:58.389127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:04:58.390107 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:04:58.390107 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:04:58.390107 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:04:58.390107 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:04:58.390107 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:04:58.390107 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:04:58.390107 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:04:58.390107 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:04:58.390107 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:04:58.390107 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:04:58.390107 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:04:58.390107 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:04:58.390107 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:04:58.390107 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:04:58.390107 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:04:58.390107 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:04:58.390861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:04:58.390861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:04:58.390861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:04:58.390861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:04:58.390861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:04:58.390861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:04:58.390861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:04:58.390861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:04:58.390861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:04:58.390861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:04:58.390861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:04:58.390861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:04:58.393398 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 52/103] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:04:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:04:58.400872 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcad9f7-184a-47e7-9aa7-1c0719470f0b None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:58.513779 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:58.554813 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcad9f7-184a-47e7-9aa7-1c0719470f0b None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:58.564164 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d64ba3-1106-4282-b6c3-45908ebb9f4d None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:58.590033 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c72ac-2d0f-4b5a-b2ec-8a5caa0a3f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:58.590707 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c72ac-2d0f-4b5a-b2ec-8a5caa0a3f5b None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:58.590997 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c72ac-2d0f-4b5a-b2ec-8a5caa0a3f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:58.591282 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c72ac-2d0f-4b5a-b2ec-8a5caa0a3f5b None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:58.592025 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c72ac-2d0f-4b5a-b2ec-8a5caa0a3f5b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:04:58.592338 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c72ac-2d0f-4b5a-b2ec-8a5caa0a3f5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:58.593744 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c72ac-2d0f-4b5a-b2ec-8a5caa0a3f5b None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:58.603554 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 53/104] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jul 11 11:04:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:04:58.608771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c72ac-2d0f-4b5a-b2ec-8a5caa0a3f5b None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:58.641087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508968b-1647-40d3-b6b0-caae4760887a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:58.641775 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508968b-1647-40d3-b6b0-caae4760887a None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:58.642066 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508968b-1647-40d3-b6b0-caae4760887a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:58.642344 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508968b-1647-40d3-b6b0-caae4760887a None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:58.643076 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5508968b-1647-40d3-b6b0-caae4760887a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:58.644515 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5508968b-1647-40d3-b6b0-caae4760887a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:58.721330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c72ac-2d0f-4b5a-b2ec-8a5caa0a3f5b None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:58.756930 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2cf6d-9bca-4e88-8515-c36ecc3f2af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:58.757843 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2cf6d-9bca-4e88-8515-c36ecc3f2af6 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:58.758136 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2cf6d-9bca-4e88-8515-c36ecc3f2af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:58.758413 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2cf6d-9bca-4e88-8515-c36ecc3f2af6 None admin] PATH_INFO: `/v3/users/37ce2de6603c4baba04f73de52f74de9` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:58.759550 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:58.764630 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:58.778090 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2cf6d-9bca-4e88-8515-c36ecc3f2af6 None admin] RBAC: Authorizing `identity:get_user(user_id=37ce2de6603c4baba04f73de52f74de9)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:58.778090 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2cf6d-9bca-4e88-8515-c36ecc3f2af6 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:58.778465 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 54/105] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:04:58 2022] GET /identity/v3/users/37ce2de6603c4baba04f73de52f74de9 => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:04:58.787095 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2cf6d-9bca-4e88-8515-c36ecc3f2af6 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:58.791968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 52/106] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Jul 11 11:04:58 2022] POST /identity/v3/projects => generated 302 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:04:58.929153 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2cf6d-9bca-4e88-8515-c36ecc3f2af6 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:58.966755 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637369a-5b69-4d63-9695-2602b9f28ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:58.967691 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637369a-5b69-4d63-9695-2602b9f28ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:58.968120 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637369a-5b69-4d63-9695-2602b9f28ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:58.968539 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637369a-5b69-4d63-9695-2602b9f28ed2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:59.031610 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:59.042180 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637369a-5b69-4d63-9695-2602b9f28ed2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:59.047509 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637369a-5b69-4d63-9695-2602b9f28ed2 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:59.111445 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d568aa-3fc1-4c96-b822-d44a7f697031 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:59.111955 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d568aa-3fc1-4c96-b822-d44a7f697031 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:59.112237 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d568aa-3fc1-4c96-b822-d44a7f697031 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:59.113731 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 53/107] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:04:59.123453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bb008-4a80-47d6-8c91-75a3720f8405 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:59.123751 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bb008-4a80-47d6-8c91-75a3720f8405 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:59.124044 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bb008-4a80-47d6-8c91-75a3720f8405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:59.150197 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-b03bb008-4a80-47d6-8c91-75a3720f8405 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:04:59.151787 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b03bb008-4a80-47d6-8c91-75a3720f8405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:04:59.158094 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 55/108] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:04:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:04:59.159963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637369a-5b69-4d63-9695-2602b9f28ed2 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:59.258860 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 54/109] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:04:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:04:59.285222 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637369a-5b69-4d63-9695-2602b9f28ed2 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:59.288928 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:59.337411 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152efded-81bd-4760-b07c-71e4344e469e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:59.338430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152efded-81bd-4760-b07c-71e4344e469e None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:59.338722 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152efded-81bd-4760-b07c-71e4344e469e None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:59.339007 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152efded-81bd-4760-b07c-71e4344e469e None admin] PATH_INFO: `/v3/projects/0ad20973f17243d0959845935c042b0f` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:59.340240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152efded-81bd-4760-b07c-71e4344e469e None admin] RBAC: Authorizing `identity:get_project(project_id=0ad20973f17243d0959845935c042b0f)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:59.341712 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152efded-81bd-4760-b07c-71e4344e469e None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:59.344748 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 56/110] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:04:59 2022] GET /identity/v3/projects/0ad20973f17243d0959845935c042b0f => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:04:59.350432 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bb008-4a80-47d6-8c91-75a3720f8405 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:59.351880 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152efded-81bd-4760-b07c-71e4344e469e None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:59.460124 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152efded-81bd-4760-b07c-71e4344e469e None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:59.495905 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9074b8-4717-4f89-be66-f28f75bb8f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:59.496848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9074b8-4717-4f89-be66-f28f75bb8f51 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:59.497142 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9074b8-4717-4f89-be66-f28f75bb8f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:59.497429 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9074b8-4717-4f89-be66-f28f75bb8f51 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:59.511355 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9074b8-4717-4f89-be66-f28f75bb8f51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:04:59.519528 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-da9074b8-4717-4f89-be66-f28f75bb8f51 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:04:59.519528 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:04:59.519528 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:04:59.519528 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:04:59.519528 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:04:59.519528 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:04:59.519528 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:04:59.519528 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:04:59.519528 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:04:59.519528 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:04:59.519528 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:04:59.519528 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:04:59.519528 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:04:59.519528 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:04:59.519528 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:04:59.519528 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:04:59.520386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:04:59.520386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:04:59.520386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:04:59.520386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:04:59.520386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:04:59.520386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:04:59.520386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:04:59.520386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:04:59.520386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:04:59.520386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:04:59.520386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:04:59.520386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:04:59.520386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:04:59.520386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:04:59.520386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:04:59.520386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:04:59.521709 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:04:59.521709 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:04:59.521709 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:04:59.521709 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:04:59.521709 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:04:59.521709 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:04:59.521709 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:04:59.521709 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:04:59.521709 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:04:59.521709 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:04:59.521709 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:04:59.521709 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:04:59.521709 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 57/111] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:04:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:04:59.527673 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9074b8-4717-4f89-be66-f28f75bb8f51 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:59.554802 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bb008-4a80-47d6-8c91-75a3720f8405 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:59.563175 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:59.606300 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:59.641796 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a9baf-9057-4dcd-8f0f-311213989186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:59.702914 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a9baf-9057-4dcd-8f0f-311213989186 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:59.702914 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a9baf-9057-4dcd-8f0f-311213989186 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:59.702914 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a9baf-9057-4dcd-8f0f-311213989186 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:59.702914 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a9baf-9057-4dcd-8f0f-311213989186 None admin] RBAC: Adding query filter params (role.id=ebafad9871bc4983849d1e2efaf955f2, scope.project.id=0ad20973f17243d0959845935c042b0f, user.id=37ce2de6603c4baba04f73de52f74de9) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:04:59.702914 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a9baf-9057-4dcd-8f0f-311213989186 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:59.702914 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a9baf-9057-4dcd-8f0f-311213989186 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:59.703426 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9074b8-4717-4f89-be66-f28f75bb8f51 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:04:59.703511 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 55/112] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:04:59 2022] GET /identity/v3/role_assignments?user.id=37ce2de6603c4baba04f73de52f74de9&scope.project.id=0ad20973f17243d0959845935c042b0f&role.id=ebafad9871bc4983849d1e2efaf955f2 => generated 259 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:04:59.703511 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69190a-7a3b-455f-8538-2d2e6b7a5a9a None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:59.703511 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69190a-7a3b-455f-8538-2d2e6b7a5a9a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:59.703511 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69190a-7a3b-455f-8538-2d2e6b7a5a9a None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:59.703511 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 56/113] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:04:59.703511 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26739b4a-c602-4253-bed7-68069fe74008 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:59.703858 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26739b4a-c602-4253-bed7-68069fe74008 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:59.703858 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26739b4a-c602-4253-bed7-68069fe74008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:59.711702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-26739b4a-c602-4253-bed7-68069fe74008 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:04:59.712959 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-26739b4a-c602-4253-bed7-68069fe74008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:04:59.771336 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929833e1-0e04-4e0c-b401-d2eff4265134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:04:59.772316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929833e1-0e04-4e0c-b401-d2eff4265134 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:04:59.772760 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929833e1-0e04-4e0c-b401-d2eff4265134 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:04:59.773193 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929833e1-0e04-4e0c-b401-d2eff4265134 None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:04:59.774143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929833e1-0e04-4e0c-b401-d2eff4265134 None admin] RBAC: Adding query filter params (name=member) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:04:59.774613 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929833e1-0e04-4e0c-b401-d2eff4265134 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:04:59.776187 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929833e1-0e04-4e0c-b401-d2eff4265134 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:04:59.797440 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 58/114] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jul 11 11:04:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:04:59.803255 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929833e1-0e04-4e0c-b401-d2eff4265134 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:59.865015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 57/115] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:04:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:04:59.904841 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26739b4a-c602-4253-bed7-68069fe74008 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:04:59.928951 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:04:59.967423 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929833e1-0e04-4e0c-b401-d2eff4265134 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:00.039090 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c3f26-b431-4461-9eab-b9944c11c5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:00.040103 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c3f26-b431-4461-9eab-b9944c11c5f7 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:00.040389 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c3f26-b431-4461-9eab-b9944c11c5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:00.040703 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c3f26-b431-4461-9eab-b9944c11c5f7 None admin] PATH_INFO: `/v3/users/ea2579845baa4661a50c96046959ebc2` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:00.042951 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c3f26-b431-4461-9eab-b9944c11c5f7 None admin] RBAC: Authorizing `identity:get_user(user_id=ea2579845baa4661a50c96046959ebc2)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:00.044509 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c3f26-b431-4461-9eab-b9944c11c5f7 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:00.046448 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 59/116] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:04:59 2022] GET /identity/v3/users/ea2579845baa4661a50c96046959ebc2 => generated 275 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:00.052532 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c3f26-b431-4461-9eab-b9944c11c5f7 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:00.082195 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26739b4a-c602-4253-bed7-68069fe74008 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:00.123849 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:00.151087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039819a-4283-4043-b512-92125cff3151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:00.152328 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039819a-4283-4043-b512-92125cff3151 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:00.152831 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039819a-4283-4043-b512-92125cff3151 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:00.153314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039819a-4283-4043-b512-92125cff3151 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:00.182743 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039819a-4283-4043-b512-92125cff3151 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:00.187017 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c3f26-b431-4461-9eab-b9944c11c5f7 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:00.197788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-4039819a-4283-4043-b512-92125cff3151 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:05:00.197788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:00.197788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:00.197788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:00.197788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:00.197788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:00.197788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:00.197788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:00.197788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:00.197788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:00.197788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:00.197788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:00.197788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:00.197788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:00.197788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:00.197788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:00.207109 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:00.207109 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:00.207109 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:00.207109 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:00.207109 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:00.207109 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:00.207109 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:00.207109 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:00.207109 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:00.207109 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:00.207109 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:00.207109 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:00.207109 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:00.207109 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:00.207109 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:00.207109 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:00.207873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:00.207873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:00.207873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:00.207873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:00.207873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:00.207873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:00.207873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:00.207873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:00.207873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:00.207873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:00.207873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:05:00.207873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:00.207873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 58/117] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jul 11 11:04:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:00.207873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4af918-8522-485d-a204-1bd8f1a7c4be None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:00.208973 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4af918-8522-485d-a204-1bd8f1a7c4be None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:00.208973 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4af918-8522-485d-a204-1bd8f1a7c4be None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:00.210079 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 59/118] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:00 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:00.211181 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4af918-8522-485d-a204-1bd8f1a7c4be None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:00.242423 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a874943-a14c-422a-a322-aed0d50eb5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:00.244369 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a874943-a14c-422a-a322-aed0d50eb5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:00.246178 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a874943-a14c-422a-a322-aed0d50eb5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:00.246634 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a874943-a14c-422a-a322-aed0d50eb5e6 None admin] PATH_INFO: `/v3/projects/0ad20973f17243d0959845935c042b0f` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:00.249171 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a874943-a14c-422a-a322-aed0d50eb5e6 None admin] RBAC: Authorizing `identity:get_project(project_id=0ad20973f17243d0959845935c042b0f)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:00.251120 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a874943-a14c-422a-a322-aed0d50eb5e6 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:00.256433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 60/119] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:00 2022] GET /identity/v3/projects/0ad20973f17243d0959845935c042b0f => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:00.258967 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b0adb-2519-48f8-a76a-5800e2545510 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:00.259997 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b0adb-2519-48f8-a76a-5800e2545510 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:00.260592 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b0adb-2519-48f8-a76a-5800e2545510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:00.292364 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-d81b0adb-2519-48f8-a76a-5800e2545510 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:00.295051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-d81b0adb-2519-48f8-a76a-5800e2545510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:00.335530 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:00.377978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 61/120] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:00.379454 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b0adb-2519-48f8-a76a-5800e2545510 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:00.403215 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4af918-8522-485d-a204-1bd8f1a7c4be None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:00.447632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa5410-26d5-4c34-8ce7-8004cfe8de01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:00.448363 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa5410-26d5-4c34-8ce7-8004cfe8de01 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:00.448658 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa5410-26d5-4c34-8ce7-8004cfe8de01 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:00.448943 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa5410-26d5-4c34-8ce7-8004cfe8de01 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:00.449707 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa5410-26d5-4c34-8ce7-8004cfe8de01 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:00.450110 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa5410-26d5-4c34-8ce7-8004cfe8de01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:00.451511 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa5410-26d5-4c34-8ce7-8004cfe8de01 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:00.460173 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 60/121] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:05:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:00.461200 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa5410-26d5-4c34-8ce7-8004cfe8de01 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:00.534912 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b0adb-2519-48f8-a76a-5800e2545510 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:00.546277 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:00.592101 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd239a-cf6e-40b9-855a-5e709f686979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:00.593006 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd239a-cf6e-40b9-855a-5e709f686979 None admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:00.593298 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd239a-cf6e-40b9-855a-5e709f686979 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:00.593580 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd239a-cf6e-40b9-855a-5e709f686979 None admin] PATH_INFO: `/v3/projects/0ad20973f17243d0959845935c042b0f/users/ea2579845baa4661a50c96046959ebc2/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:00.595721 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd239a-cf6e-40b9-855a-5e709f686979 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ad20973f17243d0959845935c042b0f, user_id=ea2579845baa4661a50c96046959ebc2, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:00.597177 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd239a-cf6e-40b9-855a-5e709f686979 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:00.621447 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa5410-26d5-4c34-8ce7-8004cfe8de01 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:00.657433 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a78e3b-c32b-471f-a692-35654a53147d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:00.658272 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a78e3b-c32b-471f-a692-35654a53147d None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:00.658565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a78e3b-c32b-471f-a692-35654a53147d None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:00.658851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a78e3b-c32b-471f-a692-35654a53147d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:00.667390 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 62/122] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jul 11 11:05:00 2022] PUT /identity/v3/projects/0ad20973f17243d0959845935c042b0f/users/ea2579845baa4661a50c96046959ebc2/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:05:00.668366 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd239a-cf6e-40b9-855a-5e709f686979 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:00.675828 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a78e3b-c32b-471f-a692-35654a53147d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:00.681433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:00.688864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-40a78e3b-c32b-471f-a692-35654a53147d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:05:00.688864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:00.688864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:00.688864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:00.688864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:00.688864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:00.688864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:00.688864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:00.688864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:00.688864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:00.688864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:00.688864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:00.688864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:00.688864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:00.688864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:00.688864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:00.689956 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:00.689956 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:00.689956 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:00.689956 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:00.689956 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:00.689956 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:00.689956 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:00.689956 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:00.689956 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:00.689956 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:00.689956 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:00.689956 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:00.689956 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:00.689956 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:00.689956 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:00.689956 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:00.690750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:00.690750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:00.690750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:00.690750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:00.690750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:00.690750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:00.690750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:00.690750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:00.690750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:00.690750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:00.690750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:05:00.690750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:00.691316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 61/123] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:00.692528 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fd656-329a-4e78-9964-8c9f82918af4 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:00.693400 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fd656-329a-4e78-9964-8c9f82918af4 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:00.693692 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fd656-329a-4e78-9964-8c9f82918af4 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:00.700279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 62/124] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:00.701483 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325fd656-329a-4e78-9964-8c9f82918af4 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:00.835999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd239a-cf6e-40b9-855a-5e709f686979 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:00.854645 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325fd656-329a-4e78-9964-8c9f82918af4 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:00.858173 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:00.899186 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac5d22-64b6-4734-acf2-37cdd2236f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:00.900318 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac5d22-64b6-4734-acf2-37cdd2236f24 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:00.900947 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac5d22-64b6-4734-acf2-37cdd2236f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:00.901566 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac5d22-64b6-4734-acf2-37cdd2236f24 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:00.902676 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac5d22-64b6-4734-acf2-37cdd2236f24 None admin] RBAC: Adding query filter params (name=member) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:00.903217 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac5d22-64b6-4734-acf2-37cdd2236f24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:00.905018 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac5d22-64b6-4734-acf2-37cdd2236f24 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:00.905704 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201be98-b993-45b5-8ad3-c2a5310cd266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:00.906791 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201be98-b993-45b5-8ad3-c2a5310cd266 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:00.907100 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201be98-b993-45b5-8ad3-c2a5310cd266 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:00.907477 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201be98-b993-45b5-8ad3-c2a5310cd266 None admin] PATH_INFO: `/v3/users/ea2579845baa4661a50c96046959ebc2` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:00.909579 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201be98-b993-45b5-8ad3-c2a5310cd266 None admin] RBAC: Authorizing `identity:get_user(user_id=ea2579845baa4661a50c96046959ebc2)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:00.911195 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201be98-b993-45b5-8ad3-c2a5310cd266 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:00.913095 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 63/125] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:05:00 2022] GET /identity/v3/users/ea2579845baa4661a50c96046959ebc2 => generated 275 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:00.915269 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250adbf3-694d-46f6-a477-2a37f93fcae7 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:00.915665 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250adbf3-694d-46f6-a477-2a37f93fcae7 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:00.915875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 63/126] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jul 11 11:05:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:00.916139 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250adbf3-694d-46f6-a477-2a37f93fcae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:00.918639 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac5d22-64b6-4734-acf2-37cdd2236f24 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:00.937693 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-250adbf3-694d-46f6-a477-2a37f93fcae7 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:00.939121 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-250adbf3-694d-46f6-a477-2a37f93fcae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:01.020728 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 64/127] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:01.021843 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250adbf3-694d-46f6-a477-2a37f93fcae7 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:01.032331 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:01.069216 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac5d22-64b6-4734-acf2-37cdd2236f24 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:01.133785 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e5dd4-5673-4b93-b7e8-1ede6758c1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:01.134640 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e5dd4-5673-4b93-b7e8-1ede6758c1c4 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:01.134887 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e5dd4-5673-4b93-b7e8-1ede6758c1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:01.135173 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e5dd4-5673-4b93-b7e8-1ede6758c1c4 None admin] PATH_INFO: `/v3/projects/0ad20973f17243d0959845935c042b0f` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:01.137612 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e5dd4-5673-4b93-b7e8-1ede6758c1c4 None admin] RBAC: Authorizing `identity:get_project(project_id=0ad20973f17243d0959845935c042b0f)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:01.139149 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e5dd4-5673-4b93-b7e8-1ede6758c1c4 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:01.140984 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 64/128] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:00 2022] GET /identity/v3/projects/0ad20973f17243d0959845935c042b0f => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:01.141790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e5dd4-5673-4b93-b7e8-1ede6758c1c4 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:01.201687 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250adbf3-694d-46f6-a477-2a37f93fcae7 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:01.206827 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:01.264979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2edf9c-6f1f-4c60-928e-6cfdc18f0eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:01.265919 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2edf9c-6f1f-4c60-928e-6cfdc18f0eaf None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:01.266214 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2edf9c-6f1f-4c60-928e-6cfdc18f0eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:01.266495 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2edf9c-6f1f-4c60-928e-6cfdc18f0eaf None admin] PATH_INFO: `/v3/users/ea2579845baa4661a50c96046959ebc2` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:01.269013 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2edf9c-6f1f-4c60-928e-6cfdc18f0eaf None admin] RBAC: Authorizing `identity:get_user(user_id=ea2579845baa4661a50c96046959ebc2)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:01.270521 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2edf9c-6f1f-4c60-928e-6cfdc18f0eaf None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:01.272289 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 65/129] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:05:01 2022] GET /identity/v3/users/ea2579845baa4661a50c96046959ebc2 => generated 275 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:01.273045 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2edf9c-6f1f-4c60-928e-6cfdc18f0eaf None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:01.327212 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e5dd4-5673-4b93-b7e8-1ede6758c1c4 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:01.384698 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5b3f2-9237-485d-8fe0-4cf1d9f668ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:01.386817 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5b3f2-9237-485d-8fe0-4cf1d9f668ce None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:01.387107 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5b3f2-9237-485d-8fe0-4cf1d9f668ce None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:01.387390 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5b3f2-9237-485d-8fe0-4cf1d9f668ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:01.410067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5b3f2-9237-485d-8fe0-4cf1d9f668ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:01.418103 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:01.420101 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-4cc5b3f2-9237-485d-8fe0-4cf1d9f668ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:05:01.420101 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:01.420101 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:01.420101 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:01.420101 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:01.420101 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:01.420101 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:01.420101 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:01.420101 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:01.420101 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:01.420101 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:01.420101 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:01.420101 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:01.420101 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:01.420101 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:01.420101 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:01.420935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:01.420935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:01.420935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:01.420935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:01.420935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:01.420935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:01.420935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:01.420935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:01.420935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:01.420935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:01.420935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:01.420935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:01.420935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:01.420935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:01.420935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:01.420935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:01.421702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:01.421702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:01.421702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:01.421702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:01.421702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:01.421702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:01.421702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:01.421702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:01.421702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:01.421702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:01.421702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:05:01.421702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:01.424589 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 65/130] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:05:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:01.424589 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5b3f2-9237-485d-8fe0-4cf1d9f668ce None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:01.460059 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2edf9c-6f1f-4c60-928e-6cfdc18f0eaf None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:01.566476 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:01.566688 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebff37-256a-4ad7-9816-6b0ac8430339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:01.567436 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebff37-256a-4ad7-9816-6b0ac8430339 None admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:01.567777 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebff37-256a-4ad7-9816-6b0ac8430339 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:01.568239 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebff37-256a-4ad7-9816-6b0ac8430339 None admin] PATH_INFO: `/v3/projects/0ad20973f17243d0959845935c042b0f/users/ea2579845baa4661a50c96046959ebc2/roles/da398232f5f14edc908b967ea8653212` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:01.571536 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebff37-256a-4ad7-9816-6b0ac8430339 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ad20973f17243d0959845935c042b0f, user_id=ea2579845baa4661a50c96046959ebc2, role_id=da398232f5f14edc908b967ea8653212)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:01.573025 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebff37-256a-4ad7-9816-6b0ac8430339 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:01.574029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5b3f2-9237-485d-8fe0-4cf1d9f668ce None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:01.614927 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68f847-370d-40b6-a7f9-a1097a9b71d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:01.615807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68f847-370d-40b6-a7f9-a1097a9b71d3 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:01.616096 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68f847-370d-40b6-a7f9-a1097a9b71d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:01.616381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68f847-370d-40b6-a7f9-a1097a9b71d3 None admin] PATH_INFO: `/v3/projects/30ae024da7c54848bae86ab33b79878b` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:01.617671 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68f847-370d-40b6-a7f9-a1097a9b71d3 None admin] RBAC: Authorizing `identity:get_project(project_id=30ae024da7c54848bae86ab33b79878b)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:01.619231 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68f847-370d-40b6-a7f9-a1097a9b71d3 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:01.621136 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 66/131] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:01 2022] GET /identity/v3/projects/30ae024da7c54848bae86ab33b79878b => generated 312 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:01.621935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68f847-370d-40b6-a7f9-a1097a9b71d3 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:01.698740 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 66/132] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jul 11 11:05:01 2022] PUT /identity/v3/projects/0ad20973f17243d0959845935c042b0f/users/ea2579845baa4661a50c96046959ebc2/roles/da398232f5f14edc908b967ea8653212 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:05:01.699495 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebff37-256a-4ad7-9816-6b0ac8430339 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:01.755758 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68f847-370d-40b6-a7f9-a1097a9b71d3 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:01.813993 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659cc759-9a35-4cbe-aa49-7cbca23403f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:01.814775 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cc759-9a35-4cbe-aa49-7cbca23403f2 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:01.815076 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cc759-9a35-4cbe-aa49-7cbca23403f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:01.815369 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cc759-9a35-4cbe-aa49-7cbca23403f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:01.816152 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659cc759-9a35-4cbe-aa49-7cbca23403f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:01.816477 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659cc759-9a35-4cbe-aa49-7cbca23403f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:01.818213 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659cc759-9a35-4cbe-aa49-7cbca23403f2 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:01.839937 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 67/133] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:01.841312 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d49ffc-fe3d-4745-8d5b-18c0572ba908 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:01.841612 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d49ffc-fe3d-4745-8d5b-18c0572ba908 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:01.847423 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d49ffc-fe3d-4745-8d5b-18c0572ba908 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:01.850830 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 68/134] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:01 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:01.856530 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d49ffc-fe3d-4745-8d5b-18c0572ba908 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:01.890811 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebff37-256a-4ad7-9816-6b0ac8430339 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:01.914148 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:01.937958 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb034bc-7826-4337-9cdf-49a1089ab3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:01.939464 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb034bc-7826-4337-9cdf-49a1089ab3ad None admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:01.939765 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb034bc-7826-4337-9cdf-49a1089ab3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:01.940195 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb034bc-7826-4337-9cdf-49a1089ab3ad None admin] PATH_INFO: `/v3/projects/30ae024da7c54848bae86ab33b79878b/users/ea2579845baa4661a50c96046959ebc2/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:01.944158 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb034bc-7826-4337-9cdf-49a1089ab3ad None admin] RBAC: Authorizing `identity:create_grant(project_id=30ae024da7c54848bae86ab33b79878b, user_id=ea2579845baa4661a50c96046959ebc2, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:01.946073 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb034bc-7826-4337-9cdf-49a1089ab3ad None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:01.949035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:02.012019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d49ffc-fe3d-4745-8d5b-18c0572ba908 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:02.048053 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f53f2b-e8be-4303-b2ef-140b15c30ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:02.048950 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f53f2b-e8be-4303-b2ef-140b15c30ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:02.049243 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f53f2b-e8be-4303-b2ef-140b15c30ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:02.049529 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f53f2b-e8be-4303-b2ef-140b15c30ac4 None admin] PATH_INFO: `/v3/users/d07257ebe5bd4aaa947d43762dac11d9` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:02.050772 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f53f2b-e8be-4303-b2ef-140b15c30ac4 None admin] RBAC: Authorizing `identity:get_user(user_id=d07257ebe5bd4aaa947d43762dac11d9)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:02.052267 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f53f2b-e8be-4303-b2ef-140b15c30ac4 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:02.053955 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 69/135] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:05:01 2022] GET /identity/v3/users/d07257ebe5bd4aaa947d43762dac11d9 => generated 247 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:02.055123 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b1370-b9e9-464f-b0c2-067c4451fedd None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:02.055419 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b1370-b9e9-464f-b0c2-067c4451fedd None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:02.055705 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b1370-b9e9-464f-b0c2-067c4451fedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:02.075845 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 67/136] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jul 11 11:05:01 2022] PUT /identity/v3/projects/30ae024da7c54848bae86ab33b79878b/users/ea2579845baa4661a50c96046959ebc2/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:05:02.076699 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb034bc-7826-4337-9cdf-49a1089ab3ad None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:02.089308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-778b1370-b9e9-464f-b0c2-067c4451fedd None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:02.091143 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-778b1370-b9e9-464f-b0c2-067c4451fedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:02.203364 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 70/137] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:02.229522 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b1370-b9e9-464f-b0c2-067c4451fedd None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:02.256289 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:02.300894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb034bc-7826-4337-9cdf-49a1089ab3ad None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:02.349411 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e20d4-3880-4079-bc6e-df45f156b946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:02.350337 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e20d4-3880-4079-bc6e-df45f156b946 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:02.350629 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e20d4-3880-4079-bc6e-df45f156b946 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:02.350916 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e20d4-3880-4079-bc6e-df45f156b946 None admin] PATH_INFO: `/v3/projects/0ad20973f17243d0959845935c042b0f` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:02.353413 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e20d4-3880-4079-bc6e-df45f156b946 None admin] RBAC: Authorizing `identity:get_project(project_id=0ad20973f17243d0959845935c042b0f)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:02.354955 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e20d4-3880-4079-bc6e-df45f156b946 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:02.357003 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 68/138] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:02 2022] GET /identity/v3/projects/0ad20973f17243d0959845935c042b0f => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:02.366247 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a710b-fa37-4a04-b5b7-8e719fc28281 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:02.366550 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a710b-fa37-4a04-b5b7-8e719fc28281 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:02.366796 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b1370-b9e9-464f-b0c2-067c4451fedd None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:02.366965 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a710b-fa37-4a04-b5b7-8e719fc28281 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:02.368315 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 69/139] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:02 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:02.369042 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a710b-fa37-4a04-b5b7-8e719fc28281 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:02.405553 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ffb3a-7bc5-482c-a7a6-e86716b63948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:02.406510 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ffb3a-7bc5-482c-a7a6-e86716b63948 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:02.406800 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ffb3a-7bc5-482c-a7a6-e86716b63948 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:02.407083 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ffb3a-7bc5-482c-a7a6-e86716b63948 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:02.408286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ffb3a-7bc5-482c-a7a6-e86716b63948 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:02.409973 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ffb3a-7bc5-482c-a7a6-e86716b63948 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:02.412883 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 71/140] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:05:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:02.418745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6b562-f1a5-4e9b-a3fd-04f6d052f2f5 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:02.419051 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6b562-f1a5-4e9b-a3fd-04f6d052f2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:02.419347 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6b562-f1a5-4e9b-a3fd-04f6d052f2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:02.440743 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-c3d6b562-f1a5-4e9b-a3fd-04f6d052f2f5 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:02.442577 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c3d6b562-f1a5-4e9b-a3fd-04f6d052f2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:02.444508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:02.486435 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a710b-fa37-4a04-b5b7-8e719fc28281 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:02.534808 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 72/141] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:02.535663 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6b562-f1a5-4e9b-a3fd-04f6d052f2f5 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:02.564167 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9fd66-4b82-4385-859b-413ad9ddcf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:02.564167 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9fd66-4b82-4385-859b-413ad9ddcf63 None admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:02.564167 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9fd66-4b82-4385-859b-413ad9ddcf63 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:02.564167 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9fd66-4b82-4385-859b-413ad9ddcf63 None admin] PATH_INFO: `/v3/projects/0ad20973f17243d0959845935c042b0f/users/d07257ebe5bd4aaa947d43762dac11d9/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:02.570585 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9fd66-4b82-4385-859b-413ad9ddcf63 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ad20973f17243d0959845935c042b0f, user_id=d07257ebe5bd4aaa947d43762dac11d9, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:02.572316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9fd66-4b82-4385-859b-413ad9ddcf63 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:02.573061 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:02.657324 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6b562-f1a5-4e9b-a3fd-04f6d052f2f5 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:02.671570 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 70/142] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jul 11 11:05:02 2022] PUT /identity/v3/projects/0ad20973f17243d0959845935c042b0f/users/d07257ebe5bd4aaa947d43762dac11d9/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:05:02.672530 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9fd66-4b82-4385-859b-413ad9ddcf63 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:02.697592 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adba65-6491-4eb8-972b-7674525ef417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:02.698524 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adba65-6491-4eb8-972b-7674525ef417 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:02.698743 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adba65-6491-4eb8-972b-7674525ef417 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:02.698974 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adba65-6491-4eb8-972b-7674525ef417 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:02.705785 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77adba65-6491-4eb8-972b-7674525ef417 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:02.705785 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77adba65-6491-4eb8-972b-7674525ef417 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:02.815026 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 73/143] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jul 11 11:05:02 2022] POST /identity/v3/users => generated 283 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:05:02.868016 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9fd66-4b82-4385-859b-413ad9ddcf63 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:02.895039 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:02.906354 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef75834-962c-4cd0-9044-9865e8b39bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:02.907241 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef75834-962c-4cd0-9044-9865e8b39bdc None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:02.907516 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef75834-962c-4cd0-9044-9865e8b39bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:02.907793 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef75834-962c-4cd0-9044-9865e8b39bdc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:02.919798 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef75834-962c-4cd0-9044-9865e8b39bdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:02.928641 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-8ef75834-962c-4cd0-9044-9865e8b39bdc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:05:02.928641 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:02.928641 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:02.928641 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:02.928641 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:02.928641 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:02.928641 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:02.928641 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:02.928641 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:02.928641 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:02.928641 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:02.928641 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:02.928641 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:02.928641 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:02.928641 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:02.928641 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:02.929539 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:02.929539 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:02.929539 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:02.929539 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:02.929539 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:02.929539 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:02.929539 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:02.929539 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:02.929539 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:02.929539 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:02.929539 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:02.929539 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:02.929539 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:02.929539 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:02.929539 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:02.929539 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:02.930328 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:02.930328 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:02.930328 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:02.930328 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:02.930328 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:02.930328 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:02.930328 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:02.930328 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:02.930328 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:02.930328 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:02.930328 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:05:02.930328 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:02.933942 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 71/144] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:02.936468 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adba65-6491-4eb8-972b-7674525ef417 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:03.044004 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:03.074637 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adba65-6491-4eb8-972b-7674525ef417 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:03.113940 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244665a-2ec2-4ee1-95cc-13eab00d0d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:03.115377 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244665a-2ec2-4ee1-95cc-13eab00d0d7b None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:03.115958 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244665a-2ec2-4ee1-95cc-13eab00d0d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:03.116676 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244665a-2ec2-4ee1-95cc-13eab00d0d7b None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:03.117452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244665a-2ec2-4ee1-95cc-13eab00d0d7b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:03.117788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244665a-2ec2-4ee1-95cc-13eab00d0d7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:03.119195 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244665a-2ec2-4ee1-95cc-13eab00d0d7b None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:03.128102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 74/145] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jul 11 11:05:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:03.134258 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef75834-962c-4cd0-9044-9865e8b39bdc None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:03.282513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef75834-962c-4cd0-9044-9865e8b39bdc None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:03.324352 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a128f-c261-401b-8ef4-f0f55390231a None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:03.324971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a128f-c261-401b-8ef4-f0f55390231a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:03.324971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a128f-c261-401b-8ef4-f0f55390231a None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:03.326449 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 75/146] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:03.331348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883de2c9-29e4-497f-b62d-da158e5f4370 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:03.331641 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883de2c9-29e4-497f-b62d-da158e5f4370 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:03.331929 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883de2c9-29e4-497f-b62d-da158e5f4370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:03.336704 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f7517-cbdd-47dd-b0c9-0de12d21c4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:03.338566 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f7517-cbdd-47dd-b0c9-0de12d21c4ad None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:03.338874 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f7517-cbdd-47dd-b0c9-0de12d21c4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:03.340041 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f7517-cbdd-47dd-b0c9-0de12d21c4ad None admin] PATH_INFO: `/v3/users/37ce2de6603c4baba04f73de52f74de9` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:03.341317 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f7517-cbdd-47dd-b0c9-0de12d21c4ad None admin] RBAC: Authorizing `identity:get_user(user_id=37ce2de6603c4baba04f73de52f74de9)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:03.342932 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f7517-cbdd-47dd-b0c9-0de12d21c4ad None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:03.344867 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 72/147] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:05:03 2022] GET /identity/v3/users/37ce2de6603c4baba04f73de52f74de9 => generated 289 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:03.353435 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f7517-cbdd-47dd-b0c9-0de12d21c4ad None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:03.356194 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-883de2c9-29e4-497f-b62d-da158e5f4370 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:03.357413 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-883de2c9-29e4-497f-b62d-da158e5f4370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:03.446368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:03.480493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 76/148] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:05:03.523533 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f7517-cbdd-47dd-b0c9-0de12d21c4ad None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:03.558434 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883de2c9-29e4-497f-b62d-da158e5f4370 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:03.594091 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a2714-3285-4034-8b26-65acaf6bdc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:03.595008 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a2714-3285-4034-8b26-65acaf6bdc32 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:03.595298 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a2714-3285-4034-8b26-65acaf6bdc32 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:03.595580 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a2714-3285-4034-8b26-65acaf6bdc32 None admin] PATH_INFO: `/v3/projects/0ad20973f17243d0959845935c042b0f` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:03.597398 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a2714-3285-4034-8b26-65acaf6bdc32 None admin] RBAC: Authorizing `identity:get_project(project_id=0ad20973f17243d0959845935c042b0f)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:03.598927 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a2714-3285-4034-8b26-65acaf6bdc32 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:03.600679 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 73/149] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:03 2022] GET /identity/v3/projects/0ad20973f17243d0959845935c042b0f => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:03.607456 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a2714-3285-4034-8b26-65acaf6bdc32 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:03.681438 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:03.752297 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883de2c9-29e4-497f-b62d-da158e5f4370 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:03.801661 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a2714-3285-4034-8b26-65acaf6bdc32 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:03.813690 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266dc84-c6ce-4a7a-ad6c-333a74639767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:03.814540 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266dc84-c6ce-4a7a-ad6c-333a74639767 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:03.814826 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266dc84-c6ce-4a7a-ad6c-333a74639767 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:03.815103 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266dc84-c6ce-4a7a-ad6c-333a74639767 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:03.839277 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266dc84-c6ce-4a7a-ad6c-333a74639767 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:03.846008 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:03.850339 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-0266dc84-c6ce-4a7a-ad6c-333a74639767 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:05:03.850339 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:03.850339 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:03.850339 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:03.850339 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:03.850339 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:03.850339 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:03.850339 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:03.850339 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:03.850339 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:03.850339 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:03.850339 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:03.850339 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:03.850339 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:03.850339 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:03.850339 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:03.852403 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:03.852403 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:03.852403 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:03.852403 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:03.852403 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:03.852403 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:03.852403 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:03.852403 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:03.852403 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:03.852403 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:03.852403 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:03.852403 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:03.852403 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:03.852403 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:03.852403 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:03.852403 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:03.854325 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:03.854325 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:03.854325 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:03.854325 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:03.854325 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:03.854325 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:03.854325 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:03.854325 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:03.854325 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:03.854325 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:03.854325 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:05:03.854325 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:03.854325 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 77/150] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:05:03.859808 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266dc84-c6ce-4a7a-ad6c-333a74639767 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:03.885817 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18592003-55a8-4a80-a67d-b653083f774b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:03.886728 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18592003-55a8-4a80-a67d-b653083f774b None admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:03.887018 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18592003-55a8-4a80-a67d-b653083f774b None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:03.887301 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18592003-55a8-4a80-a67d-b653083f774b None admin] PATH_INFO: `/v3/projects/0ad20973f17243d0959845935c042b0f/users/37ce2de6603c4baba04f73de52f74de9/roles/ebafad9871bc4983849d1e2efaf955f2` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:03.890299 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18592003-55a8-4a80-a67d-b653083f774b None admin] RBAC: Authorizing `identity:create_grant(project_id=0ad20973f17243d0959845935c042b0f, user_id=37ce2de6603c4baba04f73de52f74de9, role_id=ebafad9871bc4983849d1e2efaf955f2)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:03.891759 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18592003-55a8-4a80-a67d-b653083f774b None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:03.994042 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 74/151] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jul 11 11:05:03 2022] PUT /identity/v3/projects/0ad20973f17243d0959845935c042b0f/users/37ce2de6603c4baba04f73de52f74de9/roles/ebafad9871bc4983849d1e2efaf955f2 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:05:03.995596 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266dc84-c6ce-4a7a-ad6c-333a74639767 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:04.027284 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:04.036113 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86850e-39ae-40d8-a5dd-b72e2abeea30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:04.036952 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86850e-39ae-40d8-a5dd-b72e2abeea30 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:04.037276 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86850e-39ae-40d8-a5dd-b72e2abeea30 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:04.037558 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86850e-39ae-40d8-a5dd-b72e2abeea30 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:04.038379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86850e-39ae-40d8-a5dd-b72e2abeea30 None admin] RBAC: Adding query filter params (name=member) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:04.038694 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86850e-39ae-40d8-a5dd-b72e2abeea30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:04.040226 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86850e-39ae-40d8-a5dd-b72e2abeea30 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:04.051075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 78/152] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jul 11 11:05:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:04.057205 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18592003-55a8-4a80-a67d-b653083f774b None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:04.171135 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18592003-55a8-4a80-a67d-b653083f774b None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:04.214183 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8b6e6-692e-4762-9d5d-78be288253d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:04.215136 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8b6e6-692e-4762-9d5d-78be288253d2 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:04.215428 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8b6e6-692e-4762-9d5d-78be288253d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:04.215706 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8b6e6-692e-4762-9d5d-78be288253d2 None admin] PATH_INFO: `/v3/users/ea2579845baa4661a50c96046959ebc2` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:04.216984 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8b6e6-692e-4762-9d5d-78be288253d2 None admin] RBAC: Authorizing `identity:get_user(user_id=ea2579845baa4661a50c96046959ebc2)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:04.218551 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8b6e6-692e-4762-9d5d-78be288253d2 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:04.220311 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 75/153] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:05:04 2022] GET /identity/v3/users/ea2579845baa4661a50c96046959ebc2 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:04.226520 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86850e-39ae-40d8-a5dd-b72e2abeea30 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:04.363971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86850e-39ae-40d8-a5dd-b72e2abeea30 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:04.410721 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7718ab-d7f2-43d4-a56d-0ab0367a5b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:04.412292 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7718ab-d7f2-43d4-a56d-0ab0367a5b52 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:04.412995 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7718ab-d7f2-43d4-a56d-0ab0367a5b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:04.413491 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7718ab-d7f2-43d4-a56d-0ab0367a5b52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:04.481060 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:04.493246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7718ab-d7f2-43d4-a56d-0ab0367a5b52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:04.495063 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7718ab-d7f2-43d4-a56d-0ab0367a5b52 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:04.605121 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 79/154] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:05:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:05:04.610903 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8b6e6-692e-4762-9d5d-78be288253d2 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:04.673396 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:04.731633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8b6e6-692e-4762-9d5d-78be288253d2 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:04.777263 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2bef6a-08e9-4d3d-ae6a-f9b37bb02448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:04.778159 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bef6a-08e9-4d3d-ae6a-f9b37bb02448 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:04.778447 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bef6a-08e9-4d3d-ae6a-f9b37bb02448 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:04.778728 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bef6a-08e9-4d3d-ae6a-f9b37bb02448 None admin] PATH_INFO: `/v3/projects/0ad20973f17243d0959845935c042b0f` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:04.779921 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2bef6a-08e9-4d3d-ae6a-f9b37bb02448 None admin] RBAC: Authorizing `identity:get_project(project_id=0ad20973f17243d0959845935c042b0f)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:04.781413 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2bef6a-08e9-4d3d-ae6a-f9b37bb02448 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:04.783241 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 76/155] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:04 2022] GET /identity/v3/projects/0ad20973f17243d0959845935c042b0f => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:04.789173 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7718ab-d7f2-43d4-a56d-0ab0367a5b52 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:04.897147 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:04.907438 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7718ab-d7f2-43d4-a56d-0ab0367a5b52 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:04.945921 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac57cf-d62b-4de9-903a-ce3fa2d782c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:04.946594 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac57cf-d62b-4de9-903a-ce3fa2d782c6 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:04.946878 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac57cf-d62b-4de9-903a-ce3fa2d782c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:04.947157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac57cf-d62b-4de9-903a-ce3fa2d782c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:04.948007 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac57cf-d62b-4de9-903a-ce3fa2d782c6 None admin] RBAC: Adding query filter params (role.id=16b11a05b5da4287bdd74d219dde5fb1, scope.project.id=0ad20973f17243d0959845935c042b0f, user.id=ea2579845baa4661a50c96046959ebc2) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:04.948323 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac57cf-d62b-4de9-903a-ce3fa2d782c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:04.949797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac57cf-d62b-4de9-903a-ce3fa2d782c6 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:04.956601 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 80/156] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:05:04 2022] GET /identity/v3/role_assignments?user.id=ea2579845baa4661a50c96046959ebc2&scope.project.id=0ad20973f17243d0959845935c042b0f&role.id=16b11a05b5da4287bdd74d219dde5fb1 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:05.219733 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f4d0a-126e-4211-8a56-56594bd4281d None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:05.220242 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f4d0a-126e-4211-8a56-56594bd4281d None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:05.220349 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f4d0a-126e-4211-8a56-56594bd4281d None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:05.221674 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 77/157] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:05.237719 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ed6f8-02e3-47b7-952d-1baefca7d27f None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:05.238084 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ed6f8-02e3-47b7-952d-1baefca7d27f None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:05.238367 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ed6f8-02e3-47b7-952d-1baefca7d27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:05.266337 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-2f7ed6f8-02e3-47b7-952d-1baefca7d27f None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:05.267615 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2f7ed6f8-02e3-47b7-952d-1baefca7d27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:05.347929 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a6f51-a120-4227-a8fa-06b590226c2e None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:05.348243 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a6f51-a120-4227-a8fa-06b590226c2e None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:05.348496 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a6f51-a120-4227-a8fa-06b590226c2e None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:05.349997 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 78/158] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:05:05.351282 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 81/159] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:05.355259 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d28aa4-2751-486f-b4fd-a962f6faae21 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:05.355550 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d28aa4-2751-486f-b4fd-a962f6faae21 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:05.355875 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d28aa4-2751-486f-b4fd-a962f6faae21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:05.374470 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-19d28aa4-2751-486f-b4fd-a962f6faae21 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:05.375666 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-19d28aa4-2751-486f-b4fd-a962f6faae21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:05.410586 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ed6f8-02e3-47b7-952d-1baefca7d27f None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:05.488170 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 79/160] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:05.503496 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:05.521376 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ed6f8-02e3-47b7-952d-1baefca7d27f None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:05.533632 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d28aa4-2751-486f-b4fd-a962f6faae21 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:05.561712 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0a525-99fb-4a16-b986-6c4710255c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:05.562591 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0a525-99fb-4a16-b986-6c4710255c44 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:05.562864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0a525-99fb-4a16-b986-6c4710255c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:05.563143 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0a525-99fb-4a16-b986-6c4710255c44 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:05.574469 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0a525-99fb-4a16-b986-6c4710255c44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:05.582831 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-b9a0a525-99fb-4a16-b986-6c4710255c44 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:05:05.582831 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:05.582831 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:05.582831 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:05.582831 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:05.582831 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:05.582831 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:05.582831 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:05.582831 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:05.582831 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:05.582831 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:05.582831 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:05.582831 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:05.582831 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:05.582831 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:05.582831 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:05.584380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:05.584380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:05.584380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:05.584380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:05.584380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:05.584380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:05.584380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:05.584380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:05.584380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:05.584380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:05.584380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:05.584380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:05.584380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:05.584380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:05.584380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:05.584380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:05.585162 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:05.585162 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:05.585162 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:05.585162 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:05.585162 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:05.585162 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:05.585162 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:05.585162 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:05.585162 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:05.585162 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:05.585162 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:05:05.585162 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:05.585162 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 82/161] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jul 11 11:05:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:05.593523 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0a525-99fb-4a16-b986-6c4710255c44 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:05.664820 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:05.751548 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0a525-99fb-4a16-b986-6c4710255c44 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:05.807278 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94910d-25cc-44f0-88a5-50f449d31bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:05.808153 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d28aa4-2751-486f-b4fd-a962f6faae21 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:05.808264 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94910d-25cc-44f0-88a5-50f449d31bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:05.808504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94910d-25cc-44f0-88a5-50f449d31bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:05.808815 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94910d-25cc-44f0-88a5-50f449d31bd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:05.809929 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94910d-25cc-44f0-88a5-50f449d31bd5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:05.810254 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94910d-25cc-44f0-88a5-50f449d31bd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:05.812657 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94910d-25cc-44f0-88a5-50f449d31bd5 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:05.827462 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 83/162] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:05:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:05.833757 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94910d-25cc-44f0-88a5-50f449d31bd5 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:05.849545 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:05.885896 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de633212-99c9-4324-842d-3cfa46526f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:05.886770 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de633212-99c9-4324-842d-3cfa46526f72 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:05.887059 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de633212-99c9-4324-842d-3cfa46526f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:05.887337 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de633212-99c9-4324-842d-3cfa46526f72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:05.918691 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de633212-99c9-4324-842d-3cfa46526f72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:05.926659 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-de633212-99c9-4324-842d-3cfa46526f72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:05:05.926659 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:05.926659 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:05.926659 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:05.926659 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:05.926659 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:05.926659 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:05.926659 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:05.926659 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:05.926659 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:05.926659 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:05.926659 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:05.926659 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:05.926659 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:05.926659 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:05.926659 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:05.927848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:05.927848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:05.927848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:05.927848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:05.927848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:05.927848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:05.927848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:05.927848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:05.927848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:05.927848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:05.927848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:05.927848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:05.927848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:05.927848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:05.927848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:05.927848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:05.929200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:05.929200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:05.929200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:05.929200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:05.929200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:05.929200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:05.929200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:05.929200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:05.929200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:05.929200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:05.929200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:05:05.929200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:05.929200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 80/163] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:05.936759 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de633212-99c9-4324-842d-3cfa46526f72 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:06.022993 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94910d-25cc-44f0-88a5-50f449d31bd5 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:06.085380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150570f7-b643-4953-a883-6ff3346ef467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:06.086315 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150570f7-b643-4953-a883-6ff3346ef467 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:06.086605 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150570f7-b643-4953-a883-6ff3346ef467 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:06.086889 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150570f7-b643-4953-a883-6ff3346ef467 None admin] PATH_INFO: `/v3/users/ea2579845baa4661a50c96046959ebc2` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:06.088127 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150570f7-b643-4953-a883-6ff3346ef467 None admin] RBAC: Authorizing `identity:get_user(user_id=ea2579845baa4661a50c96046959ebc2)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:06.089584 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150570f7-b643-4953-a883-6ff3346ef467 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:06.091935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 84/164] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:05:05 2022] GET /identity/v3/users/ea2579845baa4661a50c96046959ebc2 => generated 275 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:06.099852 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150570f7-b643-4953-a883-6ff3346ef467 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:06.201491 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de633212-99c9-4324-842d-3cfa46526f72 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:06.207564 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:06.225345 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:06.269322 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150570f7-b643-4953-a883-6ff3346ef467 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:06.271610 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d2394-8657-4867-83e5-4ca218d182ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:06.272612 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d2394-8657-4867-83e5-4ca218d182ab None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:06.272898 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d2394-8657-4867-83e5-4ca218d182ab None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:06.273273 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d2394-8657-4867-83e5-4ca218d182ab None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:06.278111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d2394-8657-4867-83e5-4ca218d182ab None admin] RBAC: Adding query filter params (name=member) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:06.278111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d2394-8657-4867-83e5-4ca218d182ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:06.278111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d2394-8657-4867-83e5-4ca218d182ab None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:06.285375 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 81/165] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jul 11 11:05:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:06.287624 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a820a3-2829-45dc-8265-4847e6592173 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:06.287914 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a820a3-2829-45dc-8265-4847e6592173 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:06.288192 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a820a3-2829-45dc-8265-4847e6592173 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:06.289591 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 82/166] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:06.294633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a820a3-2829-45dc-8265-4847e6592173 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:06.321640 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b639a9-f109-42ac-9c83-ce998bbe3bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:06.322484 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b639a9-f109-42ac-9c83-ce998bbe3bfb None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:06.322890 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b639a9-f109-42ac-9c83-ce998bbe3bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:06.323273 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b639a9-f109-42ac-9c83-ce998bbe3bfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:06.398170 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b639a9-f109-42ac-9c83-ce998bbe3bfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:06.399996 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b639a9-f109-42ac-9c83-ce998bbe3bfb None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:06.475004 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:06.476684 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a820a3-2829-45dc-8265-4847e6592173 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:06.501695 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 85/167] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:05:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:05:06.503203 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e5fa8-d9cd-4c7f-a6fc-60a439d239a7 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:06.503598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e5fa8-d9cd-4c7f-a6fc-60a439d239a7 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:06.503980 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e5fa8-d9cd-4c7f-a6fc-60a439d239a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:06.514323 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0ea0c-ec85-4173-92bd-9b122d4d37d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:06.515428 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0ea0c-ec85-4173-92bd-9b122d4d37d9 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:06.516853 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0ea0c-ec85-4173-92bd-9b122d4d37d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:06.517277 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0ea0c-ec85-4173-92bd-9b122d4d37d9 None admin] PATH_INFO: `/v3/users/ea2579845baa4661a50c96046959ebc2` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:06.518652 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0ea0c-ec85-4173-92bd-9b122d4d37d9 None admin] RBAC: Authorizing `identity:get_user(user_id=ea2579845baa4661a50c96046959ebc2)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:06.520259 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0ea0c-ec85-4173-92bd-9b122d4d37d9 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:06.522667 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-bb8e5fa8-d9cd-4c7f-a6fc-60a439d239a7 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:06.523149 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 83/168] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:05:06 2022] GET /identity/v3/users/ea2579845baa4661a50c96046959ebc2 => generated 275 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:06.524096 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0ea0c-ec85-4173-92bd-9b122d4d37d9 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:06.524207 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-bb8e5fa8-d9cd-4c7f-a6fc-60a439d239a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:06.604646 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:06.659218 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 86/169] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:06.660112 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e5fa8-d9cd-4c7f-a6fc-60a439d239a7 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:06.718347 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0ea0c-ec85-4173-92bd-9b122d4d37d9 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:06.794609 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c4b21-d073-42a9-8bcc-ef447c1556d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:06.795500 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c4b21-d073-42a9-8bcc-ef447c1556d7 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:06.795789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c4b21-d073-42a9-8bcc-ef447c1556d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:06.796067 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c4b21-d073-42a9-8bcc-ef447c1556d7 None admin] PATH_INFO: `/v3/projects/0ad20973f17243d0959845935c042b0f` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:06.802999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c4b21-d073-42a9-8bcc-ef447c1556d7 None admin] RBAC: Authorizing `identity:get_project(project_id=0ad20973f17243d0959845935c042b0f)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:06.804602 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c4b21-d073-42a9-8bcc-ef447c1556d7 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:06.806739 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 84/170] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:06 2022] GET /identity/v3/projects/0ad20973f17243d0959845935c042b0f => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:06.807373 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c4b21-d073-42a9-8bcc-ef447c1556d7 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:06.856428 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e5fa8-d9cd-4c7f-a6fc-60a439d239a7 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:06.859469 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:06.892291 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3f73f-cc1d-4476-80a1-bc30354d145a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:06.892969 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3f73f-cc1d-4476-80a1-bc30354d145a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:06.893262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3f73f-cc1d-4476-80a1-bc30354d145a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:06.893553 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3f73f-cc1d-4476-80a1-bc30354d145a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:06.965043 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd3f73f-cc1d-4476-80a1-bc30354d145a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:06.966571 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd3f73f-cc1d-4476-80a1-bc30354d145a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:07.032041 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c4b21-d073-42a9-8bcc-ef447c1556d7 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:07.033657 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:07.070540 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 87/171] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:05:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:05:07.071608 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3f73f-cc1d-4476-80a1-bc30354d145a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:07.075543 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:07.119022 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa48242-2f0d-4e88-9bed-b70aad3c44f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:07.119834 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa48242-2f0d-4e88-9bed-b70aad3c44f1 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:07.120152 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa48242-2f0d-4e88-9bed-b70aad3c44f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:07.120396 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa48242-2f0d-4e88-9bed-b70aad3c44f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:07.148376 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa48242-2f0d-4e88-9bed-b70aad3c44f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:07.156228 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-cfa48242-2f0d-4e88-9bed-b70aad3c44f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:05:07.156228 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:07.156228 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:07.156228 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:07.156228 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:07.156228 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:07.156228 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:07.156228 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:07.156228 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:07.156228 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:07.156228 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:07.156228 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:07.156228 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:07.156228 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:07.156228 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:07.156228 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:07.157083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:07.157083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:07.157083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:07.157083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:07.157083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:07.157083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:07.157083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:07.157083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:07.157083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:07.157083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:07.157083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:07.157083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:07.157083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:07.157083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:07.157083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:07.157083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:07.157959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:07.157959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:07.157959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:07.157959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:07.157959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:07.157959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:07.157959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:07.157959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:07.157959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:07.157959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:07.157959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:05:07.157959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:07.157959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 85/172] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:05:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:07.166721 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa48242-2f0d-4e88-9bed-b70aad3c44f1 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:07.173501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3f73f-cc1d-4476-80a1-bc30354d145a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:07.209614 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff231fc4-8e60-4432-89cf-93da1c22518b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:07.210626 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff231fc4-8e60-4432-89cf-93da1c22518b None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:07.211058 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff231fc4-8e60-4432-89cf-93da1c22518b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:07.211482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff231fc4-8e60-4432-89cf-93da1c22518b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:07.212481 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff231fc4-8e60-4432-89cf-93da1c22518b None admin] RBAC: Adding query filter params (role.id=da398232f5f14edc908b967ea8653212, scope.project.id=0ad20973f17243d0959845935c042b0f, user.id=ea2579845baa4661a50c96046959ebc2) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:07.212944 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff231fc4-8e60-4432-89cf-93da1c22518b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:07.214563 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff231fc4-8e60-4432-89cf-93da1c22518b None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:07.220802 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 88/173] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:05:07 2022] GET /identity/v3/role_assignments?user.id=ea2579845baa4661a50c96046959ebc2&scope.project.id=0ad20973f17243d0959845935c042b0f&role.id=da398232f5f14edc908b967ea8653212 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:07.225786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff231fc4-8e60-4432-89cf-93da1c22518b None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:07.334485 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:07.372835 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff231fc4-8e60-4432-89cf-93da1c22518b None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:07.387747 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa48242-2f0d-4e88-9bed-b70aad3c44f1 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:07.414121 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aebc66-0ce2-4854-9dd4-b2e972db940c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:07.415065 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aebc66-0ce2-4854-9dd4-b2e972db940c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:07.415737 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aebc66-0ce2-4854-9dd4-b2e972db940c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:07.416171 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aebc66-0ce2-4854-9dd4-b2e972db940c None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:07.417607 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aebc66-0ce2-4854-9dd4-b2e972db940c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:07.418113 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aebc66-0ce2-4854-9dd4-b2e972db940c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:07.419673 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aebc66-0ce2-4854-9dd4-b2e972db940c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:07.429307 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 89/174] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:07.436133 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aebc66-0ce2-4854-9dd4-b2e972db940c None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:07.468797 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da5031-1c73-46eb-bcb3-2e97e1f92582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:07.469678 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da5031-1c73-46eb-bcb3-2e97e1f92582 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:07.470032 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da5031-1c73-46eb-bcb3-2e97e1f92582 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:07.470314 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da5031-1c73-46eb-bcb3-2e97e1f92582 None admin] PATH_INFO: `/v3/projects/30ae024da7c54848bae86ab33b79878b` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:07.471518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da5031-1c73-46eb-bcb3-2e97e1f92582 None admin] RBAC: Authorizing `identity:get_project(project_id=30ae024da7c54848bae86ab33b79878b)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:07.473171 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da5031-1c73-46eb-bcb3-2e97e1f92582 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:07.475607 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 86/175] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:07 2022] GET /identity/v3/projects/30ae024da7c54848bae86ab33b79878b => generated 312 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:07.485791 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da5031-1c73-46eb-bcb3-2e97e1f92582 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:07.542337 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:07.630401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aebc66-0ce2-4854-9dd4-b2e972db940c None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:07.643755 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da5031-1c73-46eb-bcb3-2e97e1f92582 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:07.685592 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afa8b3-e0a8-4414-adcf-c0ba20cf7cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:07.686287 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afa8b3-e0a8-4414-adcf-c0ba20cf7cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:07.686573 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afa8b3-e0a8-4414-adcf-c0ba20cf7cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:07.686851 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afa8b3-e0a8-4414-adcf-c0ba20cf7cf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:07.687691 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afa8b3-e0a8-4414-adcf-c0ba20cf7cf4 None admin] RBAC: Adding query filter params (role.id=16b11a05b5da4287bdd74d219dde5fb1, scope.project.id=30ae024da7c54848bae86ab33b79878b, user.id=ea2579845baa4661a50c96046959ebc2) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:07.688006 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afa8b3-e0a8-4414-adcf-c0ba20cf7cf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:07.689464 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afa8b3-e0a8-4414-adcf-c0ba20cf7cf4 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:07.694745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:07.699288 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 87/176] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:05:07 2022] GET /identity/v3/role_assignments?user.id=ea2579845baa4661a50c96046959ebc2&scope.project.id=30ae024da7c54848bae86ab33b79878b&role.id=16b11a05b5da4287bdd74d219dde5fb1 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:07.701092 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0020f2-95cf-49ba-8c10-05cbb7844a4a None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:07.701092 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0020f2-95cf-49ba-8c10-05cbb7844a4a None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:07.701092 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0020f2-95cf-49ba-8c10-05cbb7844a4a None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:07.703992 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c43b2-ddb8-4f50-9027-223ad8058c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:07.705190 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c43b2-ddb8-4f50-9027-223ad8058c2f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:07.705699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c43b2-ddb8-4f50-9027-223ad8058c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:07.706267 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c43b2-ddb8-4f50-9027-223ad8058c2f None admin] PATH_INFO: `/v3/users/d07257ebe5bd4aaa947d43762dac11d9` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:07.708028 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c43b2-ddb8-4f50-9027-223ad8058c2f None admin] RBAC: Authorizing `identity:get_user(user_id=d07257ebe5bd4aaa947d43762dac11d9)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:07.710343 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c43b2-ddb8-4f50-9027-223ad8058c2f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:07.711390 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 88/177] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:07 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:07.721912 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 90/178] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:05:07 2022] GET /identity/v3/users/d07257ebe5bd4aaa947d43762dac11d9 => generated 247 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:07.722072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d961d-d5ea-41dd-af0b-e27fd47077f4 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:07.722072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d961d-d5ea-41dd-af0b-e27fd47077f4 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:07.722072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d961d-d5ea-41dd-af0b-e27fd47077f4 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:07.722072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 89/179] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:07.722311 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d2ff4-596f-4319-85c0-226722e05042 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:07.722311 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d2ff4-596f-4319-85c0-226722e05042 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:07.722311 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d2ff4-596f-4319-85c0-226722e05042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:07.723600 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d961d-d5ea-41dd-af0b-e27fd47077f4 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:07.746933 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-9c5d2ff4-596f-4319-85c0-226722e05042 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:07.748545 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9c5d2ff4-596f-4319-85c0-226722e05042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:07.843067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 91/180] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:07.843266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6e55a-801c-483d-9404-c292dc3e7585 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:07.844275 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6e55a-801c-483d-9404-c292dc3e7585 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:07.844717 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6e55a-801c-483d-9404-c292dc3e7585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:07.866697 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-35d6e55a-801c-483d-9404-c292dc3e7585 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:07.868362 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-35d6e55a-801c-483d-9404-c292dc3e7585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:07.948071 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:07.957351 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 92/181] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:07.962558 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6e55a-801c-483d-9404-c292dc3e7585 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:07.974797 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d961d-d5ea-41dd-af0b-e27fd47077f4 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:08.041577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e2ec1-4b44-402f-bbee-b28e23c2258e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:08.042507 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e2ec1-4b44-402f-bbee-b28e23c2258e None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:08.042940 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e2ec1-4b44-402f-bbee-b28e23c2258e None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:08.043363 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e2ec1-4b44-402f-bbee-b28e23c2258e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:08.045958 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:08.099350 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6e55a-801c-483d-9404-c292dc3e7585 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:08.131099 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e2ec1-4b44-402f-bbee-b28e23c2258e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:08.133034 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e2ec1-4b44-402f-bbee-b28e23c2258e None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:08.147187 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445698d-7577-4b14-a318-676195e4aad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:08.148000 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445698d-7577-4b14-a318-676195e4aad5 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:08.148275 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445698d-7577-4b14-a318-676195e4aad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:08.148550 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445698d-7577-4b14-a318-676195e4aad5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:08.159007 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445698d-7577-4b14-a318-676195e4aad5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:08.167468 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-4445698d-7577-4b14-a318-676195e4aad5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:05:08.167468 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:08.167468 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:08.167468 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:08.167468 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:08.167468 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:08.167468 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:08.167468 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:08.167468 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:08.167468 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:08.167468 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:08.167468 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:08.167468 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:08.167468 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:08.167468 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:08.167468 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:08.168543 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:08.168543 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:08.168543 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:08.168543 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:08.168543 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:08.168543 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:08.168543 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:08.168543 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:08.168543 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:08.168543 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:08.168543 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:08.168543 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:08.168543 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:08.168543 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:08.168543 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:08.168543 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:08.169504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:08.169504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:08.169504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:08.169504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:08.169504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:08.169504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:08.169504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:08.169504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:08.169504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:08.169504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:08.169504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:05:08.169504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:08.169504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 93/182] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:05:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:08.170340 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445698d-7577-4b14-a318-676195e4aad5 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:08.250436 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:08.257697 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 90/183] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:05:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:05:08.260460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8a783-9fdc-44fc-b153-e1b3fb433639 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:08.260758 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8a783-9fdc-44fc-b153-e1b3fb433639 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:08.265224 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8a783-9fdc-44fc-b153-e1b3fb433639 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:08.265224 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 91/184] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:08.265224 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8a783-9fdc-44fc-b153-e1b3fb433639 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:08.284570 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445698d-7577-4b14-a318-676195e4aad5 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:08.302800 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:08.319078 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8cf61-622b-4c42-9e3d-38dc7d610c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:08.319896 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8cf61-622b-4c42-9e3d-38dc7d610c13 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:08.320186 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8cf61-622b-4c42-9e3d-38dc7d610c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:08.320466 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8cf61-622b-4c42-9e3d-38dc7d610c13 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:08.330813 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f8cf61-622b-4c42-9e3d-38dc7d610c13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:08.339280 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-34f8cf61-622b-4c42-9e3d-38dc7d610c13 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:05:08.339280 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:08.339280 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:08.339280 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:08.339280 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:08.339280 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:08.339280 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:08.339280 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:08.339280 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:08.339280 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:08.339280 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:08.339280 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:08.339280 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:08.339280 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:08.339280 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:08.339280 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:08.340352 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:08.340352 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:08.340352 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:08.340352 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:08.340352 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:08.340352 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:08.340352 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:08.340352 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:08.340352 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:08.340352 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:08.340352 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:08.340352 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:08.340352 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:08.340352 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:08.340352 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:08.340352 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:08.341155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:08.341155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:08.341155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:08.341155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:08.341155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:08.341155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:08.341155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:08.341155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:08.341155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:08.341155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:08.341155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:05:08.341155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:08.341155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 94/185] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:08.341814 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11f19d-deac-484f-8ece-87f5e3589075 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:08.341985 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11f19d-deac-484f-8ece-87f5e3589075 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:08.342264 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11f19d-deac-484f-8ece-87f5e3589075 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:08.343584 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 95/186] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:08.344292 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11f19d-deac-484f-8ece-87f5e3589075 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:08.373692 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8a783-9fdc-44fc-b153-e1b3fb433639 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:08.407858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf69df-b489-458e-bf39-c45d16665d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:08.408528 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf69df-b489-458e-bf39-c45d16665d50 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:08.408812 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf69df-b489-458e-bf39-c45d16665d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:08.409085 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf69df-b489-458e-bf39-c45d16665d50 None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:08.409866 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf69df-b489-458e-bf39-c45d16665d50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:08.410177 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf69df-b489-458e-bf39-c45d16665d50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:08.411614 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf69df-b489-458e-bf39-c45d16665d50 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:08.419684 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 92/187] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:08.420697 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644da35-bb18-45fe-84cf-32ec451e03c5 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:08.420984 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644da35-bb18-45fe-84cf-32ec451e03c5 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:08.421261 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644da35-bb18-45fe-84cf-32ec451e03c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:08.437736 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-8644da35-bb18-45fe-84cf-32ec451e03c5 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:08.438948 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-8644da35-bb18-45fe-84cf-32ec451e03c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:08.445445 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11f19d-deac-484f-8ece-87f5e3589075 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:08.478832 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb291bd-6456-4755-ac61-2a3aeaa93970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:08.479688 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb291bd-6456-4755-ac61-2a3aeaa93970 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:08.479989 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb291bd-6456-4755-ac61-2a3aeaa93970 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:08.480251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb291bd-6456-4755-ac61-2a3aeaa93970 None admin] PATH_INFO: `/v3/projects/0ad20973f17243d0959845935c042b0f` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:08.481410 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb291bd-6456-4755-ac61-2a3aeaa93970 None admin] RBAC: Authorizing `identity:get_project(project_id=0ad20973f17243d0959845935c042b0f)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:08.482889 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb291bd-6456-4755-ac61-2a3aeaa93970 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:08.484582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 96/188] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:08 2022] GET /identity/v3/projects/0ad20973f17243d0959845935c042b0f => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:08.485341 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb291bd-6456-4755-ac61-2a3aeaa93970 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:08.490113 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:08.507130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 93/189] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:08.515315 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d74eb8-1467-4b0a-b50c-10a23614b82c None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:08.515919 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d74eb8-1467-4b0a-b50c-10a23614b82c None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:08.516211 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d74eb8-1467-4b0a-b50c-10a23614b82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:08.532744 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:08.533321 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-03d74eb8-1467-4b0a-b50c-10a23614b82c None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:08.534547 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-03d74eb8-1467-4b0a-b50c-10a23614b82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:08.584818 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb291bd-6456-4755-ac61-2a3aeaa93970 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:08.600304 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 94/190] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:08.601129 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d74eb8-1467-4b0a-b50c-10a23614b82c None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:08.620899 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7165ae9-a982-4243-9095-114e89313cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:08.621729 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7165ae9-a982-4243-9095-114e89313cbf None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:08.622141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7165ae9-a982-4243-9095-114e89313cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:08.622516 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7165ae9-a982-4243-9095-114e89313cbf None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:08.623375 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7165ae9-a982-4243-9095-114e89313cbf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:08.623787 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7165ae9-a982-4243-9095-114e89313cbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:08.625167 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7165ae9-a982-4243-9095-114e89313cbf None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:08.634192 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 97/191] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jul 11 11:05:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:08.635592 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7165ae9-a982-4243-9095-114e89313cbf None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:08.705192 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d74eb8-1467-4b0a-b50c-10a23614b82c None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:08.721312 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:08.732114 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7165ae9-a982-4243-9095-114e89313cbf None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:08.740303 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37930d-3c46-44e4-bd8e-600846dd0d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:08.741177 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37930d-3c46-44e4-bd8e-600846dd0d51 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:08.741467 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37930d-3c46-44e4-bd8e-600846dd0d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:08.741603 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:08.741754 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37930d-3c46-44e4-bd8e-600846dd0d51 None admin] PATH_INFO: `/v3/users/ab5dcae07958489babd17815a1d58875` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:08.754915 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37930d-3c46-44e4-bd8e-600846dd0d51 None admin] RBAC: Authorizing `identity:get_user(user_id=ab5dcae07958489babd17815a1d58875)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:08.757210 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37930d-3c46-44e4-bd8e-600846dd0d51 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:08.758887 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 95/192] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:05:08 2022] GET /identity/v3/users/ab5dcae07958489babd17815a1d58875 => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:08.759661 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37930d-3c46-44e4-bd8e-600846dd0d51 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:08.770568 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6f79c-cb1b-424b-9d23-060110de91e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:08.771364 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6f79c-cb1b-424b-9d23-060110de91e6 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:08.771647 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6f79c-cb1b-424b-9d23-060110de91e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:08.771930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6f79c-cb1b-424b-9d23-060110de91e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:08.772776 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6f79c-cb1b-424b-9d23-060110de91e6 None admin] RBAC: Adding query filter params (role.id=736e70deba004b9289c2fed43eb107f7, scope.project.id=0ad20973f17243d0959845935c042b0f, user.id=d07257ebe5bd4aaa947d43762dac11d9) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:08.773095 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6f79c-cb1b-424b-9d23-060110de91e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:08.774632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6f79c-cb1b-424b-9d23-060110de91e6 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:08.780504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 98/193] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:05:08 2022] GET /identity/v3/role_assignments?user.id=d07257ebe5bd4aaa947d43762dac11d9&scope.project.id=0ad20973f17243d0959845935c042b0f&role.id=736e70deba004b9289c2fed43eb107f7 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:08.781444 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6f79c-cb1b-424b-9d23-060110de91e6 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:08.874450 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37930d-3c46-44e4-bd8e-600846dd0d51 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:08.898108 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6f79c-cb1b-424b-9d23-060110de91e6 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:08.912863 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4610e-da87-4275-8ee2-c6f57fd2fe22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:08.913827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4610e-da87-4275-8ee2-c6f57fd2fe22 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:08.914116 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4610e-da87-4275-8ee2-c6f57fd2fe22 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:08.914392 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4610e-da87-4275-8ee2-c6f57fd2fe22 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:08.925448 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4610e-da87-4275-8ee2-c6f57fd2fe22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:08.934566 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-9bf4610e-da87-4275-8ee2-c6f57fd2fe22 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:05:08.934566 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:08.934566 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:08.934566 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:08.934566 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:08.934566 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:08.934566 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:08.934566 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:08.934566 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:08.934566 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:08.934566 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:08.934566 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:08.934566 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:08.934566 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:08.934566 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:08.934566 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:08.935503 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:08.935503 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:08.935503 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:08.935503 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:08.935503 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:08.935503 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:08.935503 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:08.935503 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:08.935503 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:08.935503 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:08.935503 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:08.935503 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:08.935503 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:08.935503 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:08.935503 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:08.935503 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:08.936307 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:08.936307 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:08.936307 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:08.936307 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:08.936307 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:08.936307 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:08.936307 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:08.936307 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:08.936307 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:08.936307 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:08.936307 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:05:08.936307 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:08.936307 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 96/194] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jul 11 11:05:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:08.936988 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4610e-da87-4275-8ee2-c6f57fd2fe22 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:08.946903 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c238244-3fc1-40a2-a12b-08b882df1903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:08.947875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c238244-3fc1-40a2-a12b-08b882df1903 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:08.948263 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c238244-3fc1-40a2-a12b-08b882df1903 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:08.948651 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c238244-3fc1-40a2-a12b-08b882df1903 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:08.950531 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c238244-3fc1-40a2-a12b-08b882df1903 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:08.951997 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c238244-3fc1-40a2-a12b-08b882df1903 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:08.953228 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 99/195] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:05:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:08.954080 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c238244-3fc1-40a2-a12b-08b882df1903 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:08.976482 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:09.000821 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:09.051783 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4610e-da87-4275-8ee2-c6f57fd2fe22 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:09.060415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c238244-3fc1-40a2-a12b-08b882df1903 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:09.086931 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567331e-77fc-4713-8013-3edb7cc11ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:09.087796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567331e-77fc-4713-8013-3edb7cc11ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:09.088084 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567331e-77fc-4713-8013-3edb7cc11ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:09.088358 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567331e-77fc-4713-8013-3edb7cc11ab2 None admin] PATH_INFO: `/v3/users/37ce2de6603c4baba04f73de52f74de9` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:09.089526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567331e-77fc-4713-8013-3edb7cc11ab2 None admin] RBAC: Authorizing `identity:get_user(user_id=37ce2de6603c4baba04f73de52f74de9)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:09.091005 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567331e-77fc-4713-8013-3edb7cc11ab2 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:09.092632 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 97/196] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:05:08 2022] GET /identity/v3/users/37ce2de6603c4baba04f73de52f74de9 => generated 289 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:09.093381 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567331e-77fc-4713-8013-3edb7cc11ab2 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:09.098688 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfccee6-8a27-42dc-b401-738a37ee8a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:09.100564 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfccee6-8a27-42dc-b401-738a37ee8a0a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:09.100859 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfccee6-8a27-42dc-b401-738a37ee8a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:09.101143 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfccee6-8a27-42dc-b401-738a37ee8a0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:09.169027 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfccee6-8a27-42dc-b401-738a37ee8a0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:09.171915 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfccee6-8a27-42dc-b401-738a37ee8a0a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:09.197709 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567331e-77fc-4713-8013-3edb7cc11ab2 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:09.199534 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:09.227427 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:09.235891 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05e98d-1575-4b50-83d1-2cf673cf9e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:09.236575 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05e98d-1575-4b50-83d1-2cf673cf9e27 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:09.236863 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05e98d-1575-4b50-83d1-2cf673cf9e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:09.237144 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05e98d-1575-4b50-83d1-2cf673cf9e27 None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:09.237935 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05e98d-1575-4b50-83d1-2cf673cf9e27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:09.238254 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05e98d-1575-4b50-83d1-2cf673cf9e27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:09.239677 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05e98d-1575-4b50-83d1-2cf673cf9e27 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:09.249421 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 98/197] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:05:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:09.250701 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05e98d-1575-4b50-83d1-2cf673cf9e27 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:09.301068 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 100/198] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:05:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:05:09.301068 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfccee6-8a27-42dc-b401-738a37ee8a0a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:09.363656 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05e98d-1575-4b50-83d1-2cf673cf9e27 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:09.401398 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a6983-e73f-4fcd-ade5-cfec2e9cde9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:09.402445 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a6983-e73f-4fcd-ade5-cfec2e9cde9a None admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:09.402445 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a6983-e73f-4fcd-ade5-cfec2e9cde9a None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:09.402630 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a6983-e73f-4fcd-ade5-cfec2e9cde9a None admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:09.403359 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a6983-e73f-4fcd-ade5-cfec2e9cde9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:09.404811 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a6983-e73f-4fcd-ade5-cfec2e9cde9a None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:09.408323 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfccee6-8a27-42dc-b401-738a37ee8a0a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:09.446302 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4102514-7caa-4803-a040-0e1b7c2c3568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:09.446988 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4102514-7caa-4803-a040-0e1b7c2c3568 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:09.447277 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4102514-7caa-4803-a040-0e1b7c2c3568 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:09.447559 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4102514-7caa-4803-a040-0e1b7c2c3568 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:09.458985 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:09.486538 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 99/199] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jul 11 11:05:09 2022] POST /identity/v3/users => generated 297 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:05:09.487375 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a6983-e73f-4fcd-ade5-cfec2e9cde9a None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:09.518978 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4102514-7caa-4803-a040-0e1b7c2c3568 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:09.520574 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4102514-7caa-4803-a040-0e1b7c2c3568 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:09.528991 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:09.624490 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a6983-e73f-4fcd-ade5-cfec2e9cde9a None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:09.644654 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 101/200] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:05:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:05:09.644654 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4102514-7caa-4803-a040-0e1b7c2c3568 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:09.673158 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e3c27-5ff2-43a4-9c81-3231843df9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:09.674079 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e3c27-5ff2-43a4-9c81-3231843df9cd None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:09.674458 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e3c27-5ff2-43a4-9c81-3231843df9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:09.674735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e3c27-5ff2-43a4-9c81-3231843df9cd None admin] PATH_INFO: `/v3/users/ab5dcae07958489babd17815a1d58875` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:09.676040 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e3c27-5ff2-43a4-9c81-3231843df9cd None admin] RBAC: Authorizing `identity:get_user(user_id=ab5dcae07958489babd17815a1d58875)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:09.677740 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e3c27-5ff2-43a4-9c81-3231843df9cd None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:09.679794 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 100/201] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:05:09 2022] GET /identity/v3/users/ab5dcae07958489babd17815a1d58875 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:09.680327 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e3c27-5ff2-43a4-9c81-3231843df9cd None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:09.697318 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:09.781745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4102514-7caa-4803-a040-0e1b7c2c3568 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:09.796818 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:09.810132 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e3c27-5ff2-43a4-9c81-3231843df9cd None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:09.827026 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384310d-eade-461b-ae71-6352e117d799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:09.828267 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384310d-eade-461b-ae71-6352e117d799 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:09.828720 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384310d-eade-461b-ae71-6352e117d799 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:09.829004 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384310d-eade-461b-ae71-6352e117d799 None admin] PATH_INFO: `/v3/projects/fb8c135f505f41c49fcaeb13354bca87` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:09.831306 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384310d-eade-461b-ae71-6352e117d799 None admin] RBAC: Authorizing `identity:get_project(project_id=fb8c135f505f41c49fcaeb13354bca87)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:09.832012 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384310d-eade-461b-ae71-6352e117d799 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:09.838013 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 102/202] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:09 2022] GET /identity/v3/projects/fb8c135f505f41c49fcaeb13354bca87 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:09.838013 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384310d-eade-461b-ae71-6352e117d799 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:09.852013 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b999e-ccb2-4c24-9d8f-3053274734ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:09.852972 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b999e-ccb2-4c24-9d8f-3053274734ab None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:09.853344 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b999e-ccb2-4c24-9d8f-3053274734ab None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:09.853620 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b999e-ccb2-4c24-9d8f-3053274734ab None admin] PATH_INFO: `/v3/projects/0ad20973f17243d0959845935c042b0f` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:09.854853 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b999e-ccb2-4c24-9d8f-3053274734ab None admin] RBAC: Authorizing `identity:get_project(project_id=0ad20973f17243d0959845935c042b0f)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:09.856316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b999e-ccb2-4c24-9d8f-3053274734ab None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:09.861801 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 101/203] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:09 2022] GET /identity/v3/projects/0ad20973f17243d0959845935c042b0f => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:09.861801 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b999e-ccb2-4c24-9d8f-3053274734ab None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:09.971453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384310d-eade-461b-ae71-6352e117d799 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:09.984384 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:09.997661 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b999e-ccb2-4c24-9d8f-3053274734ab None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:10.014152 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a3248-a7ba-471c-967b-c17e2d70b069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:10.015194 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a3248-a7ba-471c-967b-c17e2d70b069 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:10.015620 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a3248-a7ba-471c-967b-c17e2d70b069 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:10.016429 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a3248-a7ba-471c-967b-c17e2d70b069 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:10.042344 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51a3e7-82b4-4378-b8ab-e4142dcb1183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:10.043700 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51a3e7-82b4-4378-b8ab-e4142dcb1183 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:10.044090 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51a3e7-82b4-4378-b8ab-e4142dcb1183 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:10.044471 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51a3e7-82b4-4378-b8ab-e4142dcb1183 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:10.045703 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51a3e7-82b4-4378-b8ab-e4142dcb1183 None admin] RBAC: Adding query filter params (role.id=736e70deba004b9289c2fed43eb107f7, scope.project.id=fb8c135f505f41c49fcaeb13354bca87, user.id=ab5dcae07958489babd17815a1d58875) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:10.046168 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51a3e7-82b4-4378-b8ab-e4142dcb1183 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:10.048544 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51a3e7-82b4-4378-b8ab-e4142dcb1183 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:10.061880 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 102/204] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:05:09 2022] GET /identity/v3/role_assignments?user.id=ab5dcae07958489babd17815a1d58875&scope.project.id=fb8c135f505f41c49fcaeb13354bca87&role.id=736e70deba004b9289c2fed43eb107f7 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:10.064002 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51a3e7-82b4-4378-b8ab-e4142dcb1183 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:10.097101 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:10.117931 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a3248-a7ba-471c-967b-c17e2d70b069 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:10.119411 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a3248-a7ba-471c-967b-c17e2d70b069 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:10.185091 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51a3e7-82b4-4378-b8ab-e4142dcb1183 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:10.229874 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a67df-7e89-4c7f-94a0-b7265b522bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:10.229874 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a67df-7e89-4c7f-94a0-b7265b522bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:10.229874 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a67df-7e89-4c7f-94a0-b7265b522bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:10.229874 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a67df-7e89-4c7f-94a0-b7265b522bc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:10.230256 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a67df-7e89-4c7f-94a0-b7265b522bc8 None admin] RBAC: Adding query filter params (role.id=ebafad9871bc4983849d1e2efaf955f2, scope.project.id=0ad20973f17243d0959845935c042b0f, user.id=37ce2de6603c4baba04f73de52f74de9) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:10.230256 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a67df-7e89-4c7f-94a0-b7265b522bc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:10.230256 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a67df-7e89-4c7f-94a0-b7265b522bc8 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:10.235568 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 103/205] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:05:10 2022] GET /identity/v3/role_assignments?user.id=37ce2de6603c4baba04f73de52f74de9&scope.project.id=0ad20973f17243d0959845935c042b0f&role.id=ebafad9871bc4983849d1e2efaf955f2 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:10.280214 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 103/206] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:05:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:05:10.285746 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a67df-7e89-4c7f-94a0-b7265b522bc8 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:10.392207 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:10.421132 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a67df-7e89-4c7f-94a0-b7265b522bc8 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:10.462105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96af09-9217-4f6f-bf1d-555374dfad8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:10.463320 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96af09-9217-4f6f-bf1d-555374dfad8b None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:10.463801 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96af09-9217-4f6f-bf1d-555374dfad8b None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:10.464268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96af09-9217-4f6f-bf1d-555374dfad8b None admin] PATH_INFO: `/v3/projects/fb8c135f505f41c49fcaeb13354bca87` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:10.465675 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96af09-9217-4f6f-bf1d-555374dfad8b None admin] RBAC: Authorizing `identity:get_project(project_id=fb8c135f505f41c49fcaeb13354bca87)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:10.467439 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96af09-9217-4f6f-bf1d-555374dfad8b None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:10.469414 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 104/207] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:10 2022] GET /identity/v3/projects/fb8c135f505f41c49fcaeb13354bca87 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:10.477603 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a3248-a7ba-471c-967b-c17e2d70b069 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:10.494859 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:10.603721 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a3248-a7ba-471c-967b-c17e2d70b069 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:10.643708 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c636012-8a8c-4701-84ff-03ab89bc3069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:10.644379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c636012-8a8c-4701-84ff-03ab89bc3069 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:10.644666 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c636012-8a8c-4701-84ff-03ab89bc3069 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:10.644945 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c636012-8a8c-4701-84ff-03ab89bc3069 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:10.646541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c636012-8a8c-4701-84ff-03ab89bc3069 None admin] RBAC: Adding query filter params (role.id=da398232f5f14edc908b967ea8653212, scope.project.id=fb8c135f505f41c49fcaeb13354bca87, user.id=ab5dcae07958489babd17815a1d58875) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:10.646867 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c636012-8a8c-4701-84ff-03ab89bc3069 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:10.648308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c636012-8a8c-4701-84ff-03ab89bc3069 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:10.656864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 104/208] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:05:10 2022] GET /identity/v3/role_assignments?user.id=ab5dcae07958489babd17815a1d58875&scope.project.id=fb8c135f505f41c49fcaeb13354bca87&role.id=da398232f5f14edc908b967ea8653212 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:11.823342 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cfe5d-5446-44bd-8802-45f5217ef59f None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:11.823842 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cfe5d-5446-44bd-8802-45f5217ef59f None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:11.823914 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cfe5d-5446-44bd-8802-45f5217ef59f None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:11.825400 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 105/209] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:11.830537 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b9e97-400c-4ef2-a6ff-7056040c48c6 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:11.830948 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b9e97-400c-4ef2-a6ff-7056040c48c6 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:11.831109 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b9e97-400c-4ef2-a6ff-7056040c48c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:11.848674 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-b78b9e97-400c-4ef2-a6ff-7056040c48c6 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:11.850702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b78b9e97-400c-4ef2-a6ff-7056040c48c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:11.862152 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67345868-ae5f-4237-943f-176b32297b1e None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:11.862428 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67345868-ae5f-4237-943f-176b32297b1e None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:11.862710 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67345868-ae5f-4237-943f-176b32297b1e None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:11.864072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 106/210] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:05:11.869615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5f3c1-d6f0-4e0a-803d-3b65192e7790 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:11.869942 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5f3c1-d6f0-4e0a-803d-3b65192e7790 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:11.870220 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5f3c1-d6f0-4e0a-803d-3b65192e7790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:11.886987 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-7de5f3c1-d6f0-4e0a-803d-3b65192e7790 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:11.888295 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-7de5f3c1-d6f0-4e0a-803d-3b65192e7790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:11.923185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 105/211] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:05:11.946387 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b9e97-400c-4ef2-a6ff-7056040c48c6 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:11.948495 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:11.962810 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 107/212] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:05:11.987526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5f3c1-d6f0-4e0a-803d-3b65192e7790 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:12.069047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b9e97-400c-4ef2-a6ff-7056040c48c6 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:12.078731 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:12.097110 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5f3c1-d6f0-4e0a-803d-3b65192e7790 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:12.117829 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021770a2-0d4d-47b6-9b37-c53ad883042b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:12.118977 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021770a2-0d4d-47b6-9b37-c53ad883042b None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:12.119995 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021770a2-0d4d-47b6-9b37-c53ad883042b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:12.120478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021770a2-0d4d-47b6-9b37-c53ad883042b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:12.133757 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c428a5-09a2-4232-9f27-693b84cc7ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:12.134573 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c428a5-09a2-4232-9f27-693b84cc7ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:12.134856 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c428a5-09a2-4232-9f27-693b84cc7ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:12.135133 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c428a5-09a2-4232-9f27-693b84cc7ee1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:12.136303 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c428a5-09a2-4232-9f27-693b84cc7ee1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:12.137298 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021770a2-0d4d-47b6-9b37-c53ad883042b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:12.137785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c428a5-09a2-4232-9f27-693b84cc7ee1 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:12.139442 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 108/213] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:05:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:12.144653 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c428a5-09a2-4232-9f27-693b84cc7ee1 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:12.146985 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-021770a2-0d4d-47b6-9b37-c53ad883042b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:05:12.146985 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:12.146985 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:12.146985 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:12.146985 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:12.146985 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:12.146985 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:12.146985 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:12.146985 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:12.146985 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:12.146985 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:12.146985 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:12.146985 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:12.146985 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:12.146985 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:12.146985 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:12.148021 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:12.148021 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:12.148021 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:12.148021 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:12.148021 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:12.148021 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:12.148021 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:12.148021 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:12.148021 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:12.148021 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:12.148021 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:12.148021 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:12.148021 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:12.148021 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:12.148021 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:12.148021 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:12.148989 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:12.148989 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:12.148989 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:12.148989 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:12.148989 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:12.148989 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:12.148989 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:12.148989 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:12.148989 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:12.148989 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:12.148989 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:05:12.148989 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:12.151387 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 106/214] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:05:12.156812 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021770a2-0d4d-47b6-9b37-c53ad883042b None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:12.221682 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:12.262144 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021770a2-0d4d-47b6-9b37-c53ad883042b None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:12.283188 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c428a5-09a2-4232-9f27-693b84cc7ee1 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:12.308431 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37eeddc-3f24-47dd-bbfe-ac66197ee4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:12.309522 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37eeddc-3f24-47dd-bbfe-ac66197ee4df None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:12.309864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37eeddc-3f24-47dd-bbfe-ac66197ee4df None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:12.310140 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37eeddc-3f24-47dd-bbfe-ac66197ee4df None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:12.311206 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37eeddc-3f24-47dd-bbfe-ac66197ee4df None admin] RBAC: Adding query filter params (name=member) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:12.311529 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37eeddc-3f24-47dd-bbfe-ac66197ee4df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:12.313200 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37eeddc-3f24-47dd-bbfe-ac66197ee4df None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:12.322143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854c53b-c91c-489f-86b1-25dab1ab5fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:12.323256 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854c53b-c91c-489f-86b1-25dab1ab5fda None admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:12.323749 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854c53b-c91c-489f-86b1-25dab1ab5fda None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:12.324354 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 107/215] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jul 11 11:05:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:12.324704 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854c53b-c91c-489f-86b1-25dab1ab5fda None admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:12.325622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854c53b-c91c-489f-86b1-25dab1ab5fda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:12.327376 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854c53b-c91c-489f-86b1-25dab1ab5fda None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:12.329597 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37eeddc-3f24-47dd-bbfe-ac66197ee4df None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:12.413799 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 109/216] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jul 11 11:05:12 2022] POST /identity/v3/users => generated 297 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:05:12.413799 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5fe46-4417-40d2-af8b-c6947bed6e40 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:12.413799 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5fe46-4417-40d2-af8b-c6947bed6e40 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:12.413799 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5fe46-4417-40d2-af8b-c6947bed6e40 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:12.413799 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 110/217] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:12.416361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e61397-f476-4c6f-9f39-d43ba435cbd1 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:12.416765 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e61397-f476-4c6f-9f39-d43ba435cbd1 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:12.417084 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e61397-f476-4c6f-9f39-d43ba435cbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:12.429492 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:12.440002 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-17e61397-f476-4c6f-9f39-d43ba435cbd1 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:12.441492 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-17e61397-f476-4c6f-9f39-d43ba435cbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:12.454709 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37eeddc-3f24-47dd-bbfe-ac66197ee4df None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:12.488584 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:12.502478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2fa42-e6f5-472a-89fe-9e162c545a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:12.504051 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2fa42-e6f5-472a-89fe-9e162c545a88 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:12.504414 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2fa42-e6f5-472a-89fe-9e162c545a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:12.504768 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2fa42-e6f5-472a-89fe-9e162c545a88 None admin] PATH_INFO: `/v3/users/82510dbf52084ee5939590a7c268c053` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:12.526675 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 111/218] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:05:12.531093 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2fa42-e6f5-472a-89fe-9e162c545a88 None admin] RBAC: Authorizing `identity:get_user(user_id=82510dbf52084ee5939590a7c268c053)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:12.532846 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2fa42-e6f5-472a-89fe-9e162c545a88 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:12.535223 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 108/219] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:05:12 2022] GET /identity/v3/users/82510dbf52084ee5939590a7c268c053 => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:12.541383 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e61397-f476-4c6f-9f39-d43ba435cbd1 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:12.550907 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2fa42-e6f5-472a-89fe-9e162c545a88 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:12.674253 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e61397-f476-4c6f-9f39-d43ba435cbd1 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:12.687281 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2fa42-e6f5-472a-89fe-9e162c545a88 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:12.715763 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863319df-d2c5-4c06-b8f8-82d50f6eb8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:12.716679 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863319df-d2c5-4c06-b8f8-82d50f6eb8fd None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:12.717105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863319df-d2c5-4c06-b8f8-82d50f6eb8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:12.717522 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863319df-d2c5-4c06-b8f8-82d50f6eb8fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:12.722299 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:12.737205 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585048ff-d055-4d0f-aeca-e32a871ef5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:12.737685 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585048ff-d055-4d0f-aeca-e32a871ef5ca None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:12.741341 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585048ff-d055-4d0f-aeca-e32a871ef5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:12.741341 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585048ff-d055-4d0f-aeca-e32a871ef5ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:12.753586 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585048ff-d055-4d0f-aeca-e32a871ef5ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:12.763137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-585048ff-d055-4d0f-aeca-e32a871ef5ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:05:12.763137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:12.763137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:12.763137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:12.763137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:12.763137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:12.763137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:12.763137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:12.763137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:12.763137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:12.763137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:12.763137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:12.763137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:12.763137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:12.763137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:12.763137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:12.764058 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:12.764058 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:12.764058 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:12.764058 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:12.764058 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:12.764058 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:12.764058 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:12.764058 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:12.764058 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:12.764058 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:12.764058 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:12.764058 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:12.764058 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:12.764058 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:12.764058 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:12.764058 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:12.764821 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:12.764821 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:12.764821 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:12.764821 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:12.764821 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:12.764821 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:12.764821 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:12.764821 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:12.764821 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:12.764821 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:12.764821 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:05:12.764821 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:12.764821 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 109/220] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:05:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:05:12.766155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8c664-6316-4be9-9ae8-ec6a6367902c None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:12.766478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8c664-6316-4be9-9ae8-ec6a6367902c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:12.766778 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8c664-6316-4be9-9ae8-ec6a6367902c None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:12.771182 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 110/221] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:12.772411 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8c664-6316-4be9-9ae8-ec6a6367902c None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:12.899096 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863319df-d2c5-4c06-b8f8-82d50f6eb8fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:12.900928 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863319df-d2c5-4c06-b8f8-82d50f6eb8fd None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:12.942247 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:12.995031 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8c664-6316-4be9-9ae8-ec6a6367902c None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:13.015740 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 112/222] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:05:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:05:13.017338 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a93aa-dd22-4ce0-82e8-af2bc923555c None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:13.017861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a93aa-dd22-4ce0-82e8-af2bc923555c None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:13.018331 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a93aa-dd22-4ce0-82e8-af2bc923555c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:13.040618 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-942a93aa-dd22-4ce0-82e8-af2bc923555c None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:13.041509 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990c8d8-9156-497c-92d5-df4610c83f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:13.042240 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990c8d8-9156-497c-92d5-df4610c83f67 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:13.042531 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990c8d8-9156-497c-92d5-df4610c83f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:13.042825 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990c8d8-9156-497c-92d5-df4610c83f67 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:13.043017 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-942a93aa-dd22-4ce0-82e8-af2bc923555c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:13.043653 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990c8d8-9156-497c-92d5-df4610c83f67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:13.043969 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990c8d8-9156-497c-92d5-df4610c83f67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:13.045356 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990c8d8-9156-497c-92d5-df4610c83f67 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:13.055159 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 111/223] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:13.056158 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990c8d8-9156-497c-92d5-df4610c83f67 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:13.081638 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:13.133803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 113/224] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:13.135154 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a93aa-dd22-4ce0-82e8-af2bc923555c None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:13.169418 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990c8d8-9156-497c-92d5-df4610c83f67 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:13.172041 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:13.206093 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0502f-5879-40e0-aa79-507107729661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:13.207001 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0502f-5879-40e0-aa79-507107729661 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:13.207289 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0502f-5879-40e0-aa79-507107729661 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:13.207566 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0502f-5879-40e0-aa79-507107729661 None admin] PATH_INFO: `/v3/projects/fb8c135f505f41c49fcaeb13354bca87` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:13.209516 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0502f-5879-40e0-aa79-507107729661 None admin] RBAC: Authorizing `identity:get_project(project_id=fb8c135f505f41c49fcaeb13354bca87)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:13.211304 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0502f-5879-40e0-aa79-507107729661 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:13.214159 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 112/225] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:13 2022] GET /identity/v3/projects/fb8c135f505f41c49fcaeb13354bca87 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:13.215108 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0502f-5879-40e0-aa79-507107729661 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:13.260926 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a93aa-dd22-4ce0-82e8-af2bc923555c None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:13.310669 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d27f0-7741-42d2-a7ae-4498c425ca71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:13.312284 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d27f0-7741-42d2-a7ae-4498c425ca71 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:13.312811 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d27f0-7741-42d2-a7ae-4498c425ca71 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:13.313279 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d27f0-7741-42d2-a7ae-4498c425ca71 None admin] PATH_INFO: `/v3/users/ab5dcae07958489babd17815a1d58875` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:13.315200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d27f0-7741-42d2-a7ae-4498c425ca71 None admin] RBAC: Authorizing `identity:get_user(user_id=ab5dcae07958489babd17815a1d58875)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:13.318489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d27f0-7741-42d2-a7ae-4498c425ca71 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:13.320926 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 114/226] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:05:13 2022] GET /identity/v3/users/ab5dcae07958489babd17815a1d58875 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:13.322295 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d27f0-7741-42d2-a7ae-4498c425ca71 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:13.331476 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0502f-5879-40e0-aa79-507107729661 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:13.367521 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d8f40-9d2a-4010-9f80-8e050a6fd877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:13.368377 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d8f40-9d2a-4010-9f80-8e050a6fd877 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:13.368706 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d8f40-9d2a-4010-9f80-8e050a6fd877 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:13.368991 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d8f40-9d2a-4010-9f80-8e050a6fd877 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:13.370919 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:13.381045 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d8f40-9d2a-4010-9f80-8e050a6fd877 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:13.389293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-5e4d8f40-9d2a-4010-9f80-8e050a6fd877 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:05:13.389293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:13.389293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:13.389293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:13.389293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:13.389293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:13.389293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:13.389293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:13.389293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:13.389293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:13.389293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:13.389293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:13.389293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:13.389293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:13.389293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:13.389293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:13.390193 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:13.390193 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:13.390193 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:13.390193 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:13.390193 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:13.390193 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:13.390193 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:13.390193 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:13.390193 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:13.390193 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:13.390193 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:13.390193 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:13.390193 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:13.390193 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:13.390193 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:13.390193 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:13.390975 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:13.390975 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:13.390975 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:13.390975 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:13.390975 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:13.390975 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:13.390975 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:13.390975 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:13.390975 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:13.390975 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:13.390975 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:05:13.390975 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:13.390975 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 113/227] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jul 11 11:05:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:13.391624 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d8f40-9d2a-4010-9f80-8e050a6fd877 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:13.428839 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:13.463808 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d27f0-7741-42d2-a7ae-4498c425ca71 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:13.503150 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d8f40-9d2a-4010-9f80-8e050a6fd877 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:13.511583 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c633cb4-3b85-4498-a29a-6860ff68df7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:13.513008 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c633cb4-3b85-4498-a29a-6860ff68df7a None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:13.513488 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c633cb4-3b85-4498-a29a-6860ff68df7a None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:13.513985 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c633cb4-3b85-4498-a29a-6860ff68df7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:13.515448 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c633cb4-3b85-4498-a29a-6860ff68df7a None admin] RBAC: Adding query filter params (role.id=16b11a05b5da4287bdd74d219dde5fb1, scope.project.id=fb8c135f505f41c49fcaeb13354bca87, user.id=82510dbf52084ee5939590a7c268c053) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:13.516358 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c633cb4-3b85-4498-a29a-6860ff68df7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:13.518566 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c633cb4-3b85-4498-a29a-6860ff68df7a None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:13.526946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 115/228] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:05:13 2022] GET /identity/v3/role_assignments?user.id=82510dbf52084ee5939590a7c268c053&scope.project.id=fb8c135f505f41c49fcaeb13354bca87&role.id=16b11a05b5da4287bdd74d219dde5fb1 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:13.528308 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c633cb4-3b85-4498-a29a-6860ff68df7a None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:13.544447 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa3ea5-954f-4973-8aa4-616d70bc140d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:13.545496 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa3ea5-954f-4973-8aa4-616d70bc140d None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:13.546302 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa3ea5-954f-4973-8aa4-616d70bc140d None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:13.546511 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa3ea5-954f-4973-8aa4-616d70bc140d None admin] PATH_INFO: `/v3/projects/fb8c135f505f41c49fcaeb13354bca87` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:13.547843 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa3ea5-954f-4973-8aa4-616d70bc140d None admin] RBAC: Authorizing `identity:get_project(project_id=fb8c135f505f41c49fcaeb13354bca87)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:13.549664 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa3ea5-954f-4973-8aa4-616d70bc140d None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:13.551874 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 114/229] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:13 2022] GET /identity/v3/projects/fb8c135f505f41c49fcaeb13354bca87 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:13.557637 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa3ea5-954f-4973-8aa4-616d70bc140d None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:13.659466 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:13.664884 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c633cb4-3b85-4498-a29a-6860ff68df7a None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:13.680080 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:13.685042 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa3ea5-954f-4973-8aa4-616d70bc140d None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:13.706227 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6bb62-2a90-44a3-b896-627f6374c5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:13.707208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6bb62-2a90-44a3-b896-627f6374c5c6 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:13.707315 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6bb62-2a90-44a3-b896-627f6374c5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:13.707529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6bb62-2a90-44a3-b896-627f6374c5c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:13.709536 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b6bb62-2a90-44a3-b896-627f6374c5c6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:13.712032 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b6bb62-2a90-44a3-b896-627f6374c5c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:13.712032 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b6bb62-2a90-44a3-b896-627f6374c5c6 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:13.721342 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 116/230] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:05:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:13.728054 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6bb62-2a90-44a3-b896-627f6374c5c6 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:13.737310 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51587b-8f22-480c-8281-78df5aae41e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:13.740520 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51587b-8f22-480c-8281-78df5aae41e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:13.740826 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51587b-8f22-480c-8281-78df5aae41e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:13.741120 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51587b-8f22-480c-8281-78df5aae41e9 None admin] PATH_INFO: `/v3/projects/fb8c135f505f41c49fcaeb13354bca87/users/ab5dcae07958489babd17815a1d58875/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:13.746785 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51587b-8f22-480c-8281-78df5aae41e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb8c135f505f41c49fcaeb13354bca87, user_id=ab5dcae07958489babd17815a1d58875, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:13.748302 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51587b-8f22-480c-8281-78df5aae41e9 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:13.848892 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 115/231] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jul 11 11:05:13 2022] PUT /identity/v3/projects/fb8c135f505f41c49fcaeb13354bca87/users/ab5dcae07958489babd17815a1d58875/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:05:13.875694 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6bb62-2a90-44a3-b896-627f6374c5c6 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:13.921585 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84430c0-7bd9-476e-a92b-04a198e73340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:13.923570 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84430c0-7bd9-476e-a92b-04a198e73340 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:13.924077 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84430c0-7bd9-476e-a92b-04a198e73340 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:13.924542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84430c0-7bd9-476e-a92b-04a198e73340 None admin] PATH_INFO: `/v3/users/ab5dcae07958489babd17815a1d58875` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:13.926570 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84430c0-7bd9-476e-a92b-04a198e73340 None admin] RBAC: Authorizing `identity:get_user(user_id=ab5dcae07958489babd17815a1d58875)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:13.928871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84430c0-7bd9-476e-a92b-04a198e73340 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:13.930897 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 117/232] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:05:13 2022] GET /identity/v3/users/ab5dcae07958489babd17815a1d58875 => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:13.940206 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51587b-8f22-480c-8281-78df5aae41e9 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:14.094512 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51587b-8f22-480c-8281-78df5aae41e9 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:14.134229 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80dcf97-f06b-403d-bd74-d2b27fd3636a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:14.135165 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dcf97-f06b-403d-bd74-d2b27fd3636a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:14.135457 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dcf97-f06b-403d-bd74-d2b27fd3636a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:14.135739 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dcf97-f06b-403d-bd74-d2b27fd3636a None admin] PATH_INFO: `/v3/projects/fb8c135f505f41c49fcaeb13354bca87` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:14.137003 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80dcf97-f06b-403d-bd74-d2b27fd3636a None admin] RBAC: Authorizing `identity:get_project(project_id=fb8c135f505f41c49fcaeb13354bca87)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:14.138617 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80dcf97-f06b-403d-bd74-d2b27fd3636a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:14.140648 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 116/233] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:13 2022] GET /identity/v3/projects/fb8c135f505f41c49fcaeb13354bca87 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:14.146417 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84430c0-7bd9-476e-a92b-04a198e73340 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:14.192374 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:14.278861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84430c0-7bd9-476e-a92b-04a198e73340 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:14.321639 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eaabb6-dc54-49be-bc17-82525572c812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:14.322919 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eaabb6-dc54-49be-bc17-82525572c812 None admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:14.323417 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eaabb6-dc54-49be-bc17-82525572c812 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:14.323907 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eaabb6-dc54-49be-bc17-82525572c812 None admin] PATH_INFO: `/v3/projects/fb8c135f505f41c49fcaeb13354bca87/users/ab5dcae07958489babd17815a1d58875/roles/da398232f5f14edc908b967ea8653212` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:14.331614 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eaabb6-dc54-49be-bc17-82525572c812 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb8c135f505f41c49fcaeb13354bca87, user_id=ab5dcae07958489babd17815a1d58875, role_id=da398232f5f14edc908b967ea8653212)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:14.334055 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eaabb6-dc54-49be-bc17-82525572c812 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:14.410542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 118/234] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jul 11 11:05:14 2022] PUT /identity/v3/projects/fb8c135f505f41c49fcaeb13354bca87/users/ab5dcae07958489babd17815a1d58875/roles/da398232f5f14edc908b967ea8653212 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:05:14.939206 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824c49c-74ea-4630-96d2-693d028762b9 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:14.939593 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824c49c-74ea-4630-96d2-693d028762b9 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:14.939767 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824c49c-74ea-4630-96d2-693d028762b9 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:14.941430 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 117/235] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:14.951381 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76ddfd-4c1d-4581-bbeb-1d20a7e0a6e5 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:14.952268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76ddfd-4c1d-4581-bbeb-1d20a7e0a6e5 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:14.952739 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76ddfd-4c1d-4581-bbeb-1d20a7e0a6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:14.977600 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-5a76ddfd-4c1d-4581-bbeb-1d20a7e0a6e5 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:14.979200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-5a76ddfd-4c1d-4581-bbeb-1d20a7e0a6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:15.063985 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 119/236] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:15.097800 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76ddfd-4c1d-4581-bbeb-1d20a7e0a6e5 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:15.097975 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09806b-b46e-4984-b383-d2156a689f2b None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:15.098374 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09806b-b46e-4984-b383-d2156a689f2b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:15.098709 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09806b-b46e-4984-b383-d2156a689f2b None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:15.100106 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 118/237] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:15.116527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9c11d-b52e-4898-aee4-a2e0f1c0d186 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:15.116819 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9c11d-b52e-4898-aee4-a2e0f1c0d186 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:15.117107 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9c11d-b52e-4898-aee4-a2e0f1c0d186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:15.123128 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:15.147044 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-63d9c11d-b52e-4898-aee4-a2e0f1c0d186 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:15.148305 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-63d9c11d-b52e-4898-aee4-a2e0f1c0d186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:15.200497 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:15.209674 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76ddfd-4c1d-4581-bbeb-1d20a7e0a6e5 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:15.245886 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184bddb-d7af-4de3-a735-0a67b551addb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:15.247032 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184bddb-d7af-4de3-a735-0a67b551addb None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:15.247533 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184bddb-d7af-4de3-a735-0a67b551addb None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:15.248002 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184bddb-d7af-4de3-a735-0a67b551addb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:15.258764 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184bddb-d7af-4de3-a735-0a67b551addb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:15.266712 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-e184bddb-d7af-4de3-a735-0a67b551addb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:05:15.266712 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:15.266712 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:15.266712 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:15.266712 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:15.266712 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:15.266712 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:15.266712 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:15.266712 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:15.266712 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:15.266712 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:15.266712 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:15.266712 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:15.266712 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:15.266712 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:15.266712 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:15.267578 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:15.267578 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:15.267578 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:15.267578 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:15.267578 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:15.267578 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:15.267578 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:15.267578 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:15.267578 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:15.267578 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:15.267578 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:15.267578 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:15.267578 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:15.267578 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:15.267578 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:15.267578 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:15.268356 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:15.268356 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:15.268356 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:15.268356 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:15.268356 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:15.268356 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:15.268356 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:15.268356 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:15.268356 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:15.268356 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:15.268356 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:05:15.268356 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:15.271365 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 120/238] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:05:15.277146 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184bddb-d7af-4de3-a735-0a67b551addb None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:15.306327 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 119/239] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:05:15.379378 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9c11d-b52e-4898-aee4-a2e0f1c0d186 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:15.384701 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:15.407286 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184bddb-d7af-4de3-a735-0a67b551addb None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:15.443177 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4b851-f320-4c95-b185-3a720ba67ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:15.444188 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4b851-f320-4c95-b185-3a720ba67ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:15.444697 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4b851-f320-4c95-b185-3a720ba67ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:15.445168 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4b851-f320-4c95-b185-3a720ba67ca5 None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:15.446170 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f4b851-f320-4c95-b185-3a720ba67ca5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:15.446671 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f4b851-f320-4c95-b185-3a720ba67ca5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:15.448254 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f4b851-f320-4c95-b185-3a720ba67ca5 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:15.457018 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 121/240] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jul 11 11:05:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:15.468480 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4b851-f320-4c95-b185-3a720ba67ca5 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:15.577206 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9c11d-b52e-4898-aee4-a2e0f1c0d186 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:15.626480 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1885601-608e-401a-82e3-43217da803f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:15.627620 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1885601-608e-401a-82e3-43217da803f0 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:15.628948 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1885601-608e-401a-82e3-43217da803f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:15.631412 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1885601-608e-401a-82e3-43217da803f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:15.633062 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1885601-608e-401a-82e3-43217da803f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:15.635967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1885601-608e-401a-82e3-43217da803f0 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:15.639270 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 120/241] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:05:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:15.646521 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1885601-608e-401a-82e3-43217da803f0 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:15.675598 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4b851-f320-4c95-b185-3a720ba67ca5 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:15.679057 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:15.774697 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1885601-608e-401a-82e3-43217da803f0 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:15.794702 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df5455-8d3b-4f59-b969-8e52f46c7d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:15.795497 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df5455-8d3b-4f59-b969-8e52f46c7d44 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:15.795787 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df5455-8d3b-4f59-b969-8e52f46c7d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:15.796067 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df5455-8d3b-4f59-b969-8e52f46c7d44 None admin] PATH_INFO: `/v3/users/f8b23e9308ad4039bed253b984cf32d2` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:15.817162 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbd647-611f-403e-8d85-49c977bd88c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:15.818358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbd647-611f-403e-8d85-49c977bd88c5 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:15.818902 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbd647-611f-403e-8d85-49c977bd88c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:15.819369 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbd647-611f-403e-8d85-49c977bd88c5 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:15.820351 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bbd647-611f-403e-8d85-49c977bd88c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:15.822048 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bbd647-611f-403e-8d85-49c977bd88c5 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:15.831472 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:15.839025 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df5455-8d3b-4f59-b969-8e52f46c7d44 None admin] RBAC: Authorizing `identity:get_user(user_id=f8b23e9308ad4039bed253b984cf32d2)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:15.840504 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df5455-8d3b-4f59-b969-8e52f46c7d44 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:15.842459 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 122/242] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:05:15 2022] GET /identity/v3/users/f8b23e9308ad4039bed253b984cf32d2 => generated 297 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:15.848400 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df5455-8d3b-4f59-b969-8e52f46c7d44 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:15.920772 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 121/243] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jul 11 11:05:15 2022] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:05:15.980154 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df5455-8d3b-4f59-b969-8e52f46c7d44 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:16.020263 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c80b1f-89cb-4ede-8cd3-1b9c7cc598b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:16.022111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c80b1f-89cb-4ede-8cd3-1b9c7cc598b7 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:16.022595 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c80b1f-89cb-4ede-8cd3-1b9c7cc598b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:16.023063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c80b1f-89cb-4ede-8cd3-1b9c7cc598b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:16.094336 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:16.106142 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c80b1f-89cb-4ede-8cd3-1b9c7cc598b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:16.108040 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c80b1f-89cb-4ede-8cd3-1b9c7cc598b7 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:16.132701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b7aaa-f372-4d88-9bff-05af1c6956df None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:16.133210 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b7aaa-f372-4d88-9bff-05af1c6956df None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:16.133282 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b7aaa-f372-4d88-9bff-05af1c6956df None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:16.135053 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 122/244] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:05:16.140289 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925a7d8-ab13-4ffb-bedd-c6e12b1b681b None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:16.140585 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925a7d8-ab13-4ffb-bedd-c6e12b1b681b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:16.140868 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925a7d8-ab13-4ffb-bedd-c6e12b1b681b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:16.162690 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-d925a7d8-ab13-4ffb-bedd-c6e12b1b681b None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:16.164873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d925a7d8-ab13-4ffb-bedd-c6e12b1b681b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:16.250300 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 123/245] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:05:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 11:05:16.257999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c80b1f-89cb-4ede-8cd3-1b9c7cc598b7 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:16.287653 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 123/246] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:16.312896 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925a7d8-ab13-4ffb-bedd-c6e12b1b681b None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:16.329248 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:16.373443 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:16.378294 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c80b1f-89cb-4ede-8cd3-1b9c7cc598b7 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:16.421819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024996a1-ec30-494b-b5e5-4e99d4d6edaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:16.421819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024996a1-ec30-494b-b5e5-4e99d4d6edaa None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:16.421819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024996a1-ec30-494b-b5e5-4e99d4d6edaa None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:16.421819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024996a1-ec30-494b-b5e5-4e99d4d6edaa None admin] PATH_INFO: `/v3/projects/fb8c135f505f41c49fcaeb13354bca87` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:16.422562 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024996a1-ec30-494b-b5e5-4e99d4d6edaa None admin] RBAC: Authorizing `identity:get_project(project_id=fb8c135f505f41c49fcaeb13354bca87)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:16.424478 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024996a1-ec30-494b-b5e5-4e99d4d6edaa None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:16.426575 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 124/247] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:16 2022] GET /identity/v3/projects/fb8c135f505f41c49fcaeb13354bca87 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:16.427914 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0083a0-8268-4e49-bb35-3077934aacff None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:16.428205 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0083a0-8268-4e49-bb35-3077934aacff None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:16.428489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0083a0-8268-4e49-bb35-3077934aacff None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:16.429831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 125/248] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:16.433266 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0083a0-8268-4e49-bb35-3077934aacff None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:16.440342 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925a7d8-ab13-4ffb-bedd-c6e12b1b681b None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:16.495196 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400e6c4-3b4a-4a65-8c80-8154614f41d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:16.496017 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400e6c4-3b4a-4a65-8c80-8154614f41d3 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:16.496300 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400e6c4-3b4a-4a65-8c80-8154614f41d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:16.496589 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400e6c4-3b4a-4a65-8c80-8154614f41d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:16.508805 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400e6c4-3b4a-4a65-8c80-8154614f41d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:16.517461 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-1400e6c4-3b4a-4a65-8c80-8154614f41d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:05:16.517461 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:16.517461 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:16.517461 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:16.517461 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:16.517461 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:16.517461 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:16.517461 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:16.517461 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:16.517461 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:16.517461 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:16.517461 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:16.517461 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:16.517461 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:16.517461 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:16.517461 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:16.518439 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:16.518439 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:16.518439 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:16.518439 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:16.518439 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:16.518439 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:16.518439 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:16.518439 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:16.518439 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:16.518439 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:16.518439 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:16.518439 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:16.518439 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:16.518439 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:16.518439 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:16.518439 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:16.519226 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:16.519226 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:16.519226 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:16.519226 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:16.519226 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:16.519226 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:16.519226 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:16.519226 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:16.519226 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:16.519226 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:16.519226 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:05:16.519226 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:16.519226 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 124/249] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:16.520617 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7795d4e-0421-4c6e-b6de-8341ffa9a707 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:16.520617 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7795d4e-0421-4c6e-b6de-8341ffa9a707 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:16.520617 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7795d4e-0421-4c6e-b6de-8341ffa9a707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:16.542764 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-a7795d4e-0421-4c6e-b6de-8341ffa9a707 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:16.543735 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a7795d4e-0421-4c6e-b6de-8341ffa9a707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:16.576757 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0083a0-8268-4e49-bb35-3077934aacff None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:16.615582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53b4f6-990c-48f9-aa07-4187e0a7a1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:16.616243 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53b4f6-990c-48f9-aa07-4187e0a7a1dd None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:16.616582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53b4f6-990c-48f9-aa07-4187e0a7a1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:16.616862 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53b4f6-990c-48f9-aa07-4187e0a7a1dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:16.617757 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53b4f6-990c-48f9-aa07-4187e0a7a1dd None admin] RBAC: Adding query filter params (role.id=ebafad9871bc4983849d1e2efaf955f2, scope.project.id=fb8c135f505f41c49fcaeb13354bca87, user.id=f8b23e9308ad4039bed253b984cf32d2) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:16.618172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53b4f6-990c-48f9-aa07-4187e0a7a1dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:16.619633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53b4f6-990c-48f9-aa07-4187e0a7a1dd None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:16.626860 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 126/250] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:05:16 2022] GET /identity/v3/role_assignments?user.id=f8b23e9308ad4039bed253b984cf32d2&scope.project.id=fb8c135f505f41c49fcaeb13354bca87&role.id=ebafad9871bc4983849d1e2efaf955f2 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:16.627508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53b4f6-990c-48f9-aa07-4187e0a7a1dd None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:16.653216 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 125/251] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:16.677300 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7795d4e-0421-4c6e-b6de-8341ffa9a707 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:16.679959 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:16.690222 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:16.828036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7795d4e-0421-4c6e-b6de-8341ffa9a707 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:16.846927 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53b4f6-990c-48f9-aa07-4187e0a7a1dd None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:16.870679 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120ea01-5b96-4a3e-99c3-37dcde7aa064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:16.871547 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120ea01-5b96-4a3e-99c3-37dcde7aa064 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:16.871889 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120ea01-5b96-4a3e-99c3-37dcde7aa064 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:16.872167 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120ea01-5b96-4a3e-99c3-37dcde7aa064 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:16.882977 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120ea01-5b96-4a3e-99c3-37dcde7aa064 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:16.886873 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4a54e-c9c7-40ce-97ab-2e4d13a08cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:16.887791 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4a54e-c9c7-40ce-97ab-2e4d13a08cda None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:16.888269 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4a54e-c9c7-40ce-97ab-2e4d13a08cda None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:16.888755 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4a54e-c9c7-40ce-97ab-2e4d13a08cda None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:16.889697 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4a54e-c9c7-40ce-97ab-2e4d13a08cda None admin] RBAC: Adding query filter params (name=member) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:16.890228 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4a54e-c9c7-40ce-97ab-2e4d13a08cda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:16.891765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-9120ea01-5b96-4a3e-99c3-37dcde7aa064 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:05:16.891765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:16.891765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:16.891765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:16.891765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:16.891765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:16.891765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:16.891765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:16.891765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:16.891765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:16.891765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:16.891765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:16.891765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:16.891765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:16.891765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:16.891765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:16.892619 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:16.892619 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:16.892619 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:16.892619 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:16.892619 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:16.892619 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:16.892619 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:16.892619 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:16.892619 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:16.892619 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:16.892619 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:16.892619 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:16.892619 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:16.892619 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:16.892619 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:16.892619 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:16.893407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:16.893407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:16.893407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:16.893407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:16.893407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:16.893407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:16.893407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:16.893407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:16.893407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:16.893407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:16.893407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:05:16.893407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:16.893407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 126/252] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:05:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:16.894618 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4a54e-c9c7-40ce-97ab-2e4d13a08cda None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:16.894788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64c13f-4ed8-4dfa-86ad-9f45be86d574 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:16.895037 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64c13f-4ed8-4dfa-86ad-9f45be86d574 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:16.895329 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64c13f-4ed8-4dfa-86ad-9f45be86d574 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:16.897410 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 127/253] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:16.902083 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa64c13f-4ed8-4dfa-86ad-9f45be86d574 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:16.906687 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 127/254] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jul 11 11:05:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:16.908205 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a72929-9358-49d1-ab09-104d8091ce4d None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:16.913325 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a72929-9358-49d1-ab09-104d8091ce4d None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:16.914020 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a72929-9358-49d1-ab09-104d8091ce4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:16.933376 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-32a72929-9358-49d1-ab09-104d8091ce4d None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:16.935427 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-32a72929-9358-49d1-ab09-104d8091ce4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:16.971089 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:17.016717 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa64c13f-4ed8-4dfa-86ad-9f45be86d574 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:17.077969 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314305ec-5f7b-4abc-b2c5-f1c163fb88b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:17.079935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314305ec-5f7b-4abc-b2c5-f1c163fb88b3 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:17.080225 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314305ec-5f7b-4abc-b2c5-f1c163fb88b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:17.080510 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314305ec-5f7b-4abc-b2c5-f1c163fb88b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:17.083613 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314305ec-5f7b-4abc-b2c5-f1c163fb88b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:17.084142 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314305ec-5f7b-4abc-b2c5-f1c163fb88b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:17.085574 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314305ec-5f7b-4abc-b2c5-f1c163fb88b3 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:17.091994 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 128/255] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:17.096698 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a72929-9358-49d1-ab09-104d8091ce4d None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:17.106224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 128/256] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:17.111820 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314305ec-5f7b-4abc-b2c5-f1c163fb88b3 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:17.146214 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:17.299647 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a72929-9358-49d1-ab09-104d8091ce4d None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:17.315467 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314305ec-5f7b-4abc-b2c5-f1c163fb88b3 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:17.357493 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a2045-9456-499e-8d68-fed4e8d8c589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:17.358761 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a2045-9456-499e-8d68-fed4e8d8c589 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:17.359280 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a2045-9456-499e-8d68-fed4e8d8c589 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:17.359750 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a2045-9456-499e-8d68-fed4e8d8c589 None admin] PATH_INFO: `/v3/users/82510dbf52084ee5939590a7c268c053` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:17.361146 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a2045-9456-499e-8d68-fed4e8d8c589 None admin] RBAC: Authorizing `identity:get_user(user_id=82510dbf52084ee5939590a7c268c053)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:17.362815 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a2045-9456-499e-8d68-fed4e8d8c589 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:17.364855 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 129/257] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:05:17 2022] GET /identity/v3/users/82510dbf52084ee5939590a7c268c053 => generated 297 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:17.370636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a2045-9456-499e-8d68-fed4e8d8c589 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:17.371884 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:17.392465 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe8f48-c819-4a3f-8e4b-369101b9b4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:17.394776 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe8f48-c819-4a3f-8e4b-369101b9b4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:17.396435 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe8f48-c819-4a3f-8e4b-369101b9b4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:17.396932 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe8f48-c819-4a3f-8e4b-369101b9b4b6 None admin] PATH_INFO: `/v3/users/ab5dcae07958489babd17815a1d58875` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:17.400561 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe8f48-c819-4a3f-8e4b-369101b9b4b6 None admin] RBAC: Authorizing `identity:get_user(user_id=ab5dcae07958489babd17815a1d58875)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:17.402306 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe8f48-c819-4a3f-8e4b-369101b9b4b6 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:17.405959 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 129/258] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:05:17 2022] GET /identity/v3/users/ab5dcae07958489babd17815a1d58875 => generated 283 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:17.409660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe8f48-c819-4a3f-8e4b-369101b9b4b6 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:17.511564 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:17.530432 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a2045-9456-499e-8d68-fed4e8d8c589 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:17.597029 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a555b-87d0-4b50-8bd5-a8345ac7a52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:17.597873 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a555b-87d0-4b50-8bd5-a8345ac7a52d None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:17.598179 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a555b-87d0-4b50-8bd5-a8345ac7a52d None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:17.598463 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a555b-87d0-4b50-8bd5-a8345ac7a52d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:17.600696 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe8f48-c819-4a3f-8e4b-369101b9b4b6 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:17.622822 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a555b-87d0-4b50-8bd5-a8345ac7a52d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:17.637789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-d34a555b-87d0-4b50-8bd5-a8345ac7a52d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:05:17.637789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:17.637789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:17.637789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:17.637789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:17.637789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:17.637789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:17.637789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:17.637789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:17.637789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:17.637789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:17.637789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:17.637789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:17.637789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:17.637789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:17.637789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:17.638788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:17.638788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:17.638788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:17.638788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:17.638788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:17.638788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:17.638788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:17.638788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:17.638788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:17.638788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:17.638788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:17.638788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:17.638788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:17.638788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:17.638788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:17.638788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:17.639605 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:17.639605 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:17.639605 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:17.639605 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:17.639605 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:17.639605 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:17.639605 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:17.639605 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:17.639605 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:17.639605 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:17.639605 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:05:17.639605 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:17.639605 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 130/259] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jul 11 11:05:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:17.639605 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a555b-87d0-4b50-8bd5-a8345ac7a52d None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:17.654276 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f8bcc-3716-41be-98cf-15b327e8c8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:17.655491 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f8bcc-3716-41be-98cf-15b327e8c8dc None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:17.655980 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f8bcc-3716-41be-98cf-15b327e8c8dc None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:17.656502 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f8bcc-3716-41be-98cf-15b327e8c8dc None admin] PATH_INFO: `/v3/projects/fb8c135f505f41c49fcaeb13354bca87` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:17.660869 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f8bcc-3716-41be-98cf-15b327e8c8dc None admin] RBAC: Authorizing `identity:get_project(project_id=fb8c135f505f41c49fcaeb13354bca87)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:17.663887 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f8bcc-3716-41be-98cf-15b327e8c8dc None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:17.666302 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 130/260] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:17 2022] GET /identity/v3/projects/fb8c135f505f41c49fcaeb13354bca87 => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:17.667285 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f8bcc-3716-41be-98cf-15b327e8c8dc None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:17.751077 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:17.777883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a555b-87d0-4b50-8bd5-a8345ac7a52d None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:17.845363 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181672c-5807-4c9a-8dfa-289df325bd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:17.846459 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181672c-5807-4c9a-8dfa-289df325bd0e None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:17.846920 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181672c-5807-4c9a-8dfa-289df325bd0e None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:17.847532 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181672c-5807-4c9a-8dfa-289df325bd0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:17.859677 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f8bcc-3716-41be-98cf-15b327e8c8dc None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:17.870272 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:17.928780 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181672c-5807-4c9a-8dfa-289df325bd0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:17.930789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181672c-5807-4c9a-8dfa-289df325bd0e None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:17.950487 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a6d7d-44ee-46d4-9c83-7d30bac02abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:17.951183 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a6d7d-44ee-46d4-9c83-7d30bac02abd None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:17.951472 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a6d7d-44ee-46d4-9c83-7d30bac02abd None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:17.951755 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a6d7d-44ee-46d4-9c83-7d30bac02abd None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:17.952526 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a6d7d-44ee-46d4-9c83-7d30bac02abd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:17.952842 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a6d7d-44ee-46d4-9c83-7d30bac02abd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:17.954471 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a6d7d-44ee-46d4-9c83-7d30bac02abd None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:17.973062 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 131/261] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:05:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:17.974662 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a6d7d-44ee-46d4-9c83-7d30bac02abd None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:18.065676 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 131/262] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:05:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:05:18.066858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181672c-5807-4c9a-8dfa-289df325bd0e None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:18.143269 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a6d7d-44ee-46d4-9c83-7d30bac02abd None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:18.182216 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:18.197608 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:18.205310 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba797014-9179-4d1b-8c98-2385b47debe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:18.206242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba797014-9179-4d1b-8c98-2385b47debe2 None admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:18.206524 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba797014-9179-4d1b-8c98-2385b47debe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:18.206809 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba797014-9179-4d1b-8c98-2385b47debe2 None admin] PATH_INFO: `/v3/projects/fb8c135f505f41c49fcaeb13354bca87/users/82510dbf52084ee5939590a7c268c053/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:18.211998 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba797014-9179-4d1b-8c98-2385b47debe2 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb8c135f505f41c49fcaeb13354bca87, user_id=82510dbf52084ee5939590a7c268c053, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:18.213448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba797014-9179-4d1b-8c98-2385b47debe2 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:18.261132 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181672c-5807-4c9a-8dfa-289df325bd0e None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:18.295600 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e789a-d6aa-4d87-926f-b29f91b72b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:18.296734 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e789a-d6aa-4d87-926f-b29f91b72b45 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:18.297018 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e789a-d6aa-4d87-926f-b29f91b72b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:18.297296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e789a-d6aa-4d87-926f-b29f91b72b45 None admin] PATH_INFO: `/v3/users/ab5dcae07958489babd17815a1d58875` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:18.298576 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e789a-d6aa-4d87-926f-b29f91b72b45 None admin] RBAC: Authorizing `identity:get_user(user_id=ab5dcae07958489babd17815a1d58875)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:18.300107 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e789a-d6aa-4d87-926f-b29f91b72b45 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:18.302732 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 132/263] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:05:18 2022] GET /identity/v3/users/ab5dcae07958489babd17815a1d58875 => generated 283 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:18.303965 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e789a-d6aa-4d87-926f-b29f91b72b45 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:18.326664 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 132/264] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jul 11 11:05:17 2022] PUT /identity/v3/projects/fb8c135f505f41c49fcaeb13354bca87/users/82510dbf52084ee5939590a7c268c053/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:05:18.327516 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba797014-9179-4d1b-8c98-2385b47debe2 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:18.445299 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e789a-d6aa-4d87-926f-b29f91b72b45 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:18.478173 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:18.484406 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4b529-77e3-480c-a1fd-3ff465795fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:18.485386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4b529-77e3-480c-a1fd-3ff465795fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:18.485672 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4b529-77e3-480c-a1fd-3ff465795fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:18.485978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4b529-77e3-480c-a1fd-3ff465795fc8 None admin] PATH_INFO: `/v3/projects/fb8c135f505f41c49fcaeb13354bca87` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:18.487284 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4b529-77e3-480c-a1fd-3ff465795fc8 None admin] RBAC: Authorizing `identity:get_project(project_id=fb8c135f505f41c49fcaeb13354bca87)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:18.488943 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4b529-77e3-480c-a1fd-3ff465795fc8 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:18.491127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 133/265] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:18 2022] GET /identity/v3/projects/fb8c135f505f41c49fcaeb13354bca87 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:18.496969 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4b529-77e3-480c-a1fd-3ff465795fc8 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:18.543877 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba797014-9179-4d1b-8c98-2385b47debe2 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:18.608351 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4b529-77e3-480c-a1fd-3ff465795fc8 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:18.623979 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31abc5-7142-4d68-852a-e3a177c6dfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:18.624670 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31abc5-7142-4d68-852a-e3a177c6dfce None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:18.624961 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31abc5-7142-4d68-852a-e3a177c6dfce None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:18.625249 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31abc5-7142-4d68-852a-e3a177c6dfce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:18.648792 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7e50a-da4b-487c-bf71-413ef480a3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:18.649457 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7e50a-da4b-487c-bf71-413ef480a3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:18.649812 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7e50a-da4b-487c-bf71-413ef480a3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:18.650101 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7e50a-da4b-487c-bf71-413ef480a3f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:18.651100 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7e50a-da4b-487c-bf71-413ef480a3f3 None admin] RBAC: Adding query filter params (role.id=736e70deba004b9289c2fed43eb107f7, scope.project.id=fb8c135f505f41c49fcaeb13354bca87, user.id=ab5dcae07958489babd17815a1d58875) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:18.651458 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7e50a-da4b-487c-bf71-413ef480a3f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:18.653084 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7e50a-da4b-487c-bf71-413ef480a3f3 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:18.660329 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 134/266] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:05:18 2022] GET /identity/v3/role_assignments?user.id=ab5dcae07958489babd17815a1d58875&scope.project.id=fb8c135f505f41c49fcaeb13354bca87&role.id=736e70deba004b9289c2fed43eb107f7 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:18.721171 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:18.746520 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31abc5-7142-4d68-852a-e3a177c6dfce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:18.748036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31abc5-7142-4d68-852a-e3a177c6dfce None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:18.862195 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 133/267] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:05:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:05:18.868487 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7e50a-da4b-487c-bf71-413ef480a3f3 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:18.960727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:19.003955 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd235f3-0998-4e41-891c-c8908840edca None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:19.004264 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd235f3-0998-4e41-891c-c8908840edca None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:19.004447 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd235f3-0998-4e41-891c-c8908840edca None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:19.006725 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 134/268] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:05:19.012524 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630824b-d8a6-4f7d-896a-8a1eb315c90a None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:19.012813 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630824b-d8a6-4f7d-896a-8a1eb315c90a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:19.013099 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630824b-d8a6-4f7d-896a-8a1eb315c90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:19.020461 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7e50a-da4b-487c-bf71-413ef480a3f3 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:19.031891 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-5630824b-d8a6-4f7d-896a-8a1eb315c90a None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:19.033108 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-5630824b-d8a6-4f7d-896a-8a1eb315c90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:19.068774 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e03db-5642-4324-a12b-12cb80405a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:19.069898 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e03db-5642-4324-a12b-12cb80405a35 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:19.070324 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e03db-5642-4324-a12b-12cb80405a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:19.070602 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e03db-5642-4324-a12b-12cb80405a35 None admin] PATH_INFO: `/v3/projects/fb8c135f505f41c49fcaeb13354bca87` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:19.071801 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e03db-5642-4324-a12b-12cb80405a35 None admin] RBAC: Authorizing `identity:get_project(project_id=fb8c135f505f41c49fcaeb13354bca87)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:19.073461 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e03db-5642-4324-a12b-12cb80405a35 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:19.075412 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 135/269] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:18 2022] GET /identity/v3/projects/fb8c135f505f41c49fcaeb13354bca87 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:19.076568 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af255ee8-70a8-4662-bb0b-5a06833831b8 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:19.076844 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af255ee8-70a8-4662-bb0b-5a06833831b8 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:19.077126 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af255ee8-70a8-4662-bb0b-5a06833831b8 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:19.078447 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 136/270] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:19.084266 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af13b49-440e-4e8e-9c77-da9ac6a59299 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:19.084585 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af13b49-440e-4e8e-9c77-da9ac6a59299 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:19.084885 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af13b49-440e-4e8e-9c77-da9ac6a59299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:19.103552 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-2af13b49-440e-4e8e-9c77-da9ac6a59299 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:19.104742 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-2af13b49-440e-4e8e-9c77-da9ac6a59299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:19.113870 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 135/271] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:19.115665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630824b-d8a6-4f7d-896a-8a1eb315c90a None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:19.130488 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:19.194215 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 137/272] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:05:19.195220 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af13b49-440e-4e8e-9c77-da9ac6a59299 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:19.231823 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630824b-d8a6-4f7d-896a-8a1eb315c90a None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:19.255603 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:19.265664 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8a4f0-599e-4888-9a54-23df1257d3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:19.266361 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8a4f0-599e-4888-9a54-23df1257d3f5 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:19.266647 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8a4f0-599e-4888-9a54-23df1257d3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:19.266925 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8a4f0-599e-4888-9a54-23df1257d3f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:19.267753 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a8a4f0-599e-4888-9a54-23df1257d3f5 None admin] RBAC: Adding query filter params (role.id=da398232f5f14edc908b967ea8653212, scope.project.id=fb8c135f505f41c49fcaeb13354bca87, user.id=ab5dcae07958489babd17815a1d58875) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:19.268067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a8a4f0-599e-4888-9a54-23df1257d3f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:19.269502 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a8a4f0-599e-4888-9a54-23df1257d3f5 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:19.285796 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 136/273] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:05:19 2022] GET /identity/v3/role_assignments?user.id=ab5dcae07958489babd17815a1d58875&scope.project.id=fb8c135f505f41c49fcaeb13354bca87&role.id=da398232f5f14edc908b967ea8653212 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:19.285796 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2580a-1990-4796-98bd-3210ee2703d6 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:19.285796 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2580a-1990-4796-98bd-3210ee2703d6 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:19.285796 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2580a-1990-4796-98bd-3210ee2703d6 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:19.285796 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 137/274] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:19.285796 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2580a-1990-4796-98bd-3210ee2703d6 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:19.338189 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af13b49-440e-4e8e-9c77-da9ac6a59299 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:19.386016 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62592fc3-d948-405d-942d-58e6d6a800e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:19.387481 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62592fc3-d948-405d-942d-58e6d6a800e1 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:19.387772 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62592fc3-d948-405d-942d-58e6d6a800e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:19.388049 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62592fc3-d948-405d-942d-58e6d6a800e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:19.403347 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:19.405647 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62592fc3-d948-405d-942d-58e6d6a800e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:19.416919 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-62592fc3-d948-405d-942d-58e6d6a800e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:05:19.416919 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:19.416919 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:19.416919 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:19.416919 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:19.416919 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:19.416919 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:19.416919 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:19.416919 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:19.416919 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:19.416919 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:19.416919 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:19.416919 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:19.416919 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:19.416919 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:19.416919 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:19.419460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:19.419460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:19.419460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:19.419460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:19.419460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:19.419460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:19.419460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:19.419460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:19.419460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:19.419460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:19.419460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:19.419460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:19.419460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:19.419460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:19.419460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:19.419460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:19.420519 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:19.420519 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:19.420519 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:19.420519 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:19.420519 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:19.420519 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:19.420519 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:19.420519 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:19.420519 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:19.420519 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:19.420519 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:05:19.420519 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:19.422067 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 138/275] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:19.423586 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de710c2d-56f9-4135-b236-c455ad5fcdf6 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:19.424048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de710c2d-56f9-4135-b236-c455ad5fcdf6 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:19.424471 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de710c2d-56f9-4135-b236-c455ad5fcdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:19.440428 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2580a-1990-4796-98bd-3210ee2703d6 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:19.446118 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-de710c2d-56f9-4135-b236-c455ad5fcdf6 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:19.447628 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-de710c2d-56f9-4135-b236-c455ad5fcdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:19.477588 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cb918-7887-41f9-a8b5-64c090d8493b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:19.478506 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cb918-7887-41f9-a8b5-64c090d8493b None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:19.478867 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cb918-7887-41f9-a8b5-64c090d8493b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:19.479218 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cb918-7887-41f9-a8b5-64c090d8493b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:19.480494 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977cb918-7887-41f9-a8b5-64c090d8493b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:19.482048 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977cb918-7887-41f9-a8b5-64c090d8493b None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:19.484167 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 138/276] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:05:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:19.484968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cb918-7887-41f9-a8b5-64c090d8493b None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:19.539688 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 139/277] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:19.540958 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de710c2d-56f9-4135-b236-c455ad5fcdf6 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:19.600955 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:19.611180 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cb918-7887-41f9-a8b5-64c090d8493b None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:19.645138 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee857f-5d83-491e-8ee1-fa97c3394ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:19.646457 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee857f-5d83-491e-8ee1-fa97c3394ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:19.646739 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee857f-5d83-491e-8ee1-fa97c3394ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:19.647015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee857f-5d83-491e-8ee1-fa97c3394ec7 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:19.647765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee857f-5d83-491e-8ee1-fa97c3394ec7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:19.648078 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee857f-5d83-491e-8ee1-fa97c3394ec7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:19.649445 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee857f-5d83-491e-8ee1-fa97c3394ec7 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:19.657684 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 139/278] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jul 11 11:05:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:19.659313 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee857f-5d83-491e-8ee1-fa97c3394ec7 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:19.668768 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:19.670584 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de710c2d-56f9-4135-b236-c455ad5fcdf6 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:19.708590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006df73d-ecb0-4dfb-a68f-54a6bba815dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:19.709624 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006df73d-ecb0-4dfb-a68f-54a6bba815dc None admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:19.710075 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006df73d-ecb0-4dfb-a68f-54a6bba815dc None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:19.710361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006df73d-ecb0-4dfb-a68f-54a6bba815dc None admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:19.711073 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006df73d-ecb0-4dfb-a68f-54a6bba815dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:19.712602 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006df73d-ecb0-4dfb-a68f-54a6bba815dc None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:19.762752 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee857f-5d83-491e-8ee1-fa97c3394ec7 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:19.792500 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 140/279] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jul 11 11:05:19 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:05:19.793466 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006df73d-ecb0-4dfb-a68f-54a6bba815dc None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:19.809596 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fcec1-5fcd-4f7f-ad24-e93ffa54e13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:19.810472 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fcec1-5fcd-4f7f-ad24-e93ffa54e13b None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:19.810759 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fcec1-5fcd-4f7f-ad24-e93ffa54e13b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:19.812585 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fcec1-5fcd-4f7f-ad24-e93ffa54e13b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:19.823568 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fcec1-5fcd-4f7f-ad24-e93ffa54e13b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:19.831420 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-1a7fcec1-5fcd-4f7f-ad24-e93ffa54e13b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:05:19.831420 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:19.831420 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:19.831420 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:19.831420 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:19.831420 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:19.831420 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:19.831420 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:19.831420 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:19.831420 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:19.831420 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:19.831420 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:19.831420 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:19.831420 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:19.831420 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:19.831420 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:19.832370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:19.832370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:19.832370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:19.832370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:19.832370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:19.832370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:19.832370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:19.832370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:19.832370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:19.832370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:19.832370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:19.832370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:19.832370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:19.832370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:19.832370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:19.832370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:19.833401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:19.833401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:19.833401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:19.833401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:19.833401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:19.833401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:19.833401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:19.833401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:19.833401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:19.833401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:19.833401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:05:19.833401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:19.833401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 140/280] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:19.838857 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fcec1-5fcd-4f7f-ad24-e93ffa54e13b None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:19.929665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:19.972724 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fcec1-5fcd-4f7f-ad24-e93ffa54e13b None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:19.983734 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:19.989837 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006df73d-ecb0-4dfb-a68f-54a6bba815dc None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:20.017291 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1a39d-b33c-4a12-862b-0ce33b10c96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:20.018520 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1a39d-b33c-4a12-862b-0ce33b10c96c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:20.018981 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1a39d-b33c-4a12-862b-0ce33b10c96c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:20.019429 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1a39d-b33c-4a12-862b-0ce33b10c96c None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:20.020853 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b1a39d-b33c-4a12-862b-0ce33b10c96c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:20.021169 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b1a39d-b33c-4a12-862b-0ce33b10c96c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:20.022689 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b1a39d-b33c-4a12-862b-0ce33b10c96c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:20.031418 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 141/281] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jul 11 11:05:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:20.033442 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df2c95-547d-4a21-b098-4e9db915a5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:20.034351 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df2c95-547d-4a21-b098-4e9db915a5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:20.034635 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df2c95-547d-4a21-b098-4e9db915a5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:20.034913 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df2c95-547d-4a21-b098-4e9db915a5e7 None admin] PATH_INFO: `/v3/users/a68430ad30a04dcea49bb03144afd126` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:20.037534 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1a39d-b33c-4a12-862b-0ce33b10c96c None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:20.051491 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df2c95-547d-4a21-b098-4e9db915a5e7 None admin] RBAC: Authorizing `identity:get_user(user_id=a68430ad30a04dcea49bb03144afd126)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:20.053161 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df2c95-547d-4a21-b098-4e9db915a5e7 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:20.056738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 141/282] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:05:19 2022] GET /identity/v3/users/a68430ad30a04dcea49bb03144afd126 => generated 293 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:20.062657 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df2c95-547d-4a21-b098-4e9db915a5e7 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:20.162389 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1a39d-b33c-4a12-862b-0ce33b10c96c None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:20.200026 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:20.203893 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df2c95-547d-4a21-b098-4e9db915a5e7 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:20.210283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcfae1-3106-46d2-ac1e-93bb7d361b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:20.214465 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcfae1-3106-46d2-ac1e-93bb7d361b2a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:20.214465 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcfae1-3106-46d2-ac1e-93bb7d361b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:20.214465 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcfae1-3106-46d2-ac1e-93bb7d361b2a None admin] PATH_INFO: `/v3/users/f8b23e9308ad4039bed253b984cf32d2` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:20.214465 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbcfae1-3106-46d2-ac1e-93bb7d361b2a None admin] RBAC: Authorizing `identity:get_user(user_id=f8b23e9308ad4039bed253b984cf32d2)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:20.214465 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbcfae1-3106-46d2-ac1e-93bb7d361b2a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:20.216387 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 142/283] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:05:20 2022] GET /identity/v3/users/f8b23e9308ad4039bed253b984cf32d2 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:20.222173 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcfae1-3106-46d2-ac1e-93bb7d361b2a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:20.270489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc5de8-e8ce-405c-b63f-f0b6a1f177da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:20.271154 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc5de8-e8ce-405c-b63f-f0b6a1f177da None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:20.271440 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc5de8-e8ce-405c-b63f-f0b6a1f177da None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:20.271719 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc5de8-e8ce-405c-b63f-f0b6a1f177da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:20.272569 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc5de8-e8ce-405c-b63f-f0b6a1f177da None admin] RBAC: Adding query filter params (role.id=16b11a05b5da4287bdd74d219dde5fb1, user.id=a68430ad30a04dcea49bb03144afd126, scope.system=all) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:20.272881 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc5de8-e8ce-405c-b63f-f0b6a1f177da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:20.274353 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc5de8-e8ce-405c-b63f-f0b6a1f177da None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:20.284014 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 142/284] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Jul 11 11:05:20 2022] GET /identity/v3/role_assignments?user.id=a68430ad30a04dcea49bb03144afd126&scope.system=all&role.id=16b11a05b5da4287bdd74d219dde5fb1 => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:20.440338 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcfae1-3106-46d2-ac1e-93bb7d361b2a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:20.487910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4ae44-6712-43a6-80ff-53942fe6e9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:20.489675 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4ae44-6712-43a6-80ff-53942fe6e9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:20.490163 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4ae44-6712-43a6-80ff-53942fe6e9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:20.490638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4ae44-6712-43a6-80ff-53942fe6e9d5 None admin] PATH_INFO: `/v3/projects/fb8c135f505f41c49fcaeb13354bca87` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:20.492125 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4ae44-6712-43a6-80ff-53942fe6e9d5 None admin] RBAC: Authorizing `identity:get_project(project_id=fb8c135f505f41c49fcaeb13354bca87)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:20.493801 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4ae44-6712-43a6-80ff-53942fe6e9d5 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:20.495815 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 143/285] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:20 2022] GET /identity/v3/projects/fb8c135f505f41c49fcaeb13354bca87 => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:20.501782 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc5de8-e8ce-405c-b63f-f0b6a1f177da None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:20.538309 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:20.650790 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc5de8-e8ce-405c-b63f-f0b6a1f177da None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:20.695988 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d2f81-4328-43eb-aa63-06f47aa1da55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:20.696798 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d2f81-4328-43eb-aa63-06f47aa1da55 None admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:20.697082 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d2f81-4328-43eb-aa63-06f47aa1da55 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:20.697357 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d2f81-4328-43eb-aa63-06f47aa1da55 None admin] PATH_INFO: `/v3/projects/fb8c135f505f41c49fcaeb13354bca87/users/f8b23e9308ad4039bed253b984cf32d2/roles/ebafad9871bc4983849d1e2efaf955f2` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:20.699367 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d2f81-4328-43eb-aa63-06f47aa1da55 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb8c135f505f41c49fcaeb13354bca87, user_id=f8b23e9308ad4039bed253b984cf32d2, role_id=ebafad9871bc4983849d1e2efaf955f2)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:20.700818 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d2f81-4328-43eb-aa63-06f47aa1da55 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:20.784118 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 143/286] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jul 11 11:05:20 2022] PUT /identity/v3/projects/fb8c135f505f41c49fcaeb13354bca87/users/f8b23e9308ad4039bed253b984cf32d2/roles/ebafad9871bc4983849d1e2efaf955f2 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:05:21.180047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37565a-f202-46a7-b5fc-ac35f081f25b None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:21.180605 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37565a-f202-46a7-b5fc-ac35f081f25b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:21.181028 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37565a-f202-46a7-b5fc-ac35f081f25b None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:21.182589 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 144/287] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:21.187971 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ebd67-5fd1-4799-a1ee-9d6a59bc37f8 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:21.188266 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ebd67-5fd1-4799-a1ee-9d6a59bc37f8 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:21.188549 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ebd67-5fd1-4799-a1ee-9d6a59bc37f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:21.214717 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-f00ebd67-5fd1-4799-a1ee-9d6a59bc37f8 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:21.215894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-f00ebd67-5fd1-4799-a1ee-9d6a59bc37f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:21.335290 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 144/288] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:21.367634 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37565a-f202-46a7-b5fc-ac35f081f25b None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:21.449974 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:21.488781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37565a-f202-46a7-b5fc-ac35f081f25b None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:21.523952 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f82e6b-2fad-4ed9-b9db-fea67a51ee08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:21.524753 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f82e6b-2fad-4ed9-b9db-fea67a51ee08 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:21.525042 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f82e6b-2fad-4ed9-b9db-fea67a51ee08 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:21.525325 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f82e6b-2fad-4ed9-b9db-fea67a51ee08 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:21.536608 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f82e6b-2fad-4ed9-b9db-fea67a51ee08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:21.544279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-16f82e6b-2fad-4ed9-b9db-fea67a51ee08 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:05:21.544279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:21.544279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:21.544279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:21.544279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:21.544279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:21.544279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:21.544279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:21.544279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:21.544279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:21.544279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:21.544279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:21.544279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:21.544279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:21.544279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:21.544279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:21.545224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:21.545224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:21.545224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:21.545224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:21.545224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:21.545224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:21.545224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:21.545224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:21.545224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:21.545224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:21.545224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:21.545224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:21.545224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:21.545224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:21.545224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:21.545224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:21.546049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:21.546049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:21.546049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:21.546049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:21.546049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:21.546049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:21.546049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:21.546049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:21.546049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:21.546049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:21.546049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:05:21.546049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:21.546049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 145/289] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:21.554190 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ebd67-5fd1-4799-a1ee-9d6a59bc37f8 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:21.581806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:21.728963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ebd67-5fd1-4799-a1ee-9d6a59bc37f8 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:21.771688 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2e3a6-0ac8-43bb-ace3-f76984d9ec12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:21.772728 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2e3a6-0ac8-43bb-ace3-f76984d9ec12 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:21.773233 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2e3a6-0ac8-43bb-ace3-f76984d9ec12 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:21.773742 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2e3a6-0ac8-43bb-ace3-f76984d9ec12 None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:21.774702 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2e3a6-0ac8-43bb-ace3-f76984d9ec12 None admin] RBAC: Adding query filter params (name=member) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:21.775195 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2e3a6-0ac8-43bb-ace3-f76984d9ec12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:21.776740 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2e3a6-0ac8-43bb-ace3-f76984d9ec12 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:21.786378 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 145/290] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jul 11 11:05:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:21.793900 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f82e6b-2fad-4ed9-b9db-fea67a51ee08 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:21.904228 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f82e6b-2fad-4ed9-b9db-fea67a51ee08 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:21.930227 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:21.943611 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3c34e-4761-4dfa-8568-a9255903749c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:21.948135 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3c34e-4761-4dfa-8568-a9255903749c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:21.948135 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3c34e-4761-4dfa-8568-a9255903749c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:21.948135 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3c34e-4761-4dfa-8568-a9255903749c None admin] PATH_INFO: `/v3/users/82510dbf52084ee5939590a7c268c053` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:21.948135 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3c34e-4761-4dfa-8568-a9255903749c None admin] RBAC: Authorizing `identity:get_user(user_id=82510dbf52084ee5939590a7c268c053)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:21.948135 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3c34e-4761-4dfa-8568-a9255903749c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:21.949674 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 146/291] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:05:21 2022] GET /identity/v3/users/82510dbf52084ee5939590a7c268c053 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:21.955410 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2e3a6-0ac8-43bb-ace3-f76984d9ec12 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:22.051847 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:22.093079 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2e3a6-0ac8-43bb-ace3-f76984d9ec12 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:22.139221 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59e657-1a6d-4c22-9c7e-21140202daaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:22.140220 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59e657-1a6d-4c22-9c7e-21140202daaf None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:22.140722 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59e657-1a6d-4c22-9c7e-21140202daaf None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:22.141189 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59e657-1a6d-4c22-9c7e-21140202daaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:22.237187 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59e657-1a6d-4c22-9c7e-21140202daaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:22.239143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59e657-1a6d-4c22-9c7e-21140202daaf None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:22.331102 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:22.368065 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 146/292] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:05:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:05:22.372847 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcf9df-5cdd-47e7-a090-9ffa86d826fe None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:22.373139 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcf9df-5cdd-47e7-a090-9ffa86d826fe None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:22.373417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcf9df-5cdd-47e7-a090-9ffa86d826fe None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:22.374946 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 147/293] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:22.375703 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59e657-1a6d-4c22-9c7e-21140202daaf None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:22.382461 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f720d8-37cd-4ebb-b802-2c697f7a91c0 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:22.382744 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f720d8-37cd-4ebb-b802-2c697f7a91c0 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:22.383114 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f720d8-37cd-4ebb-b802-2c697f7a91c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:22.406632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-91f720d8-37cd-4ebb-b802-2c697f7a91c0 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:22.407830 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-91f720d8-37cd-4ebb-b802-2c697f7a91c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:22.530994 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 148/294] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 11 11:05:22.547164 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8cac2-acb9-4698-be27-b8148ec146ed None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:22.547891 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8cac2-acb9-4698-be27-b8148ec146ed None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:22.548406 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8cac2-acb9-4698-be27-b8148ec146ed None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:22.551261 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 149/295] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:05:22.556753 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0d6e6-7432-4036-934f-00b2e1851cca None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:22.557306 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0d6e6-7432-4036-934f-00b2e1851cca None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:22.557819 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0d6e6-7432-4036-934f-00b2e1851cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:22.567985 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59e657-1a6d-4c22-9c7e-21140202daaf None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:22.586237 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-81e0d6e6-7432-4036-934f-00b2e1851cca None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:22.588375 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-81e0d6e6-7432-4036-934f-00b2e1851cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:22.612091 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde83c44-e088-4f10-88d8-6dfa1b5bcab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:22.612947 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde83c44-e088-4f10-88d8-6dfa1b5bcab2 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:22.613231 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde83c44-e088-4f10-88d8-6dfa1b5bcab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:22.613505 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde83c44-e088-4f10-88d8-6dfa1b5bcab2 None admin] PATH_INFO: `/v3/projects/fb8c135f505f41c49fcaeb13354bca87` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:22.615492 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde83c44-e088-4f10-88d8-6dfa1b5bcab2 None admin] RBAC: Authorizing `identity:get_project(project_id=fb8c135f505f41c49fcaeb13354bca87)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:22.616922 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde83c44-e088-4f10-88d8-6dfa1b5bcab2 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:22.621922 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 147/296] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:22 2022] GET /identity/v3/projects/fb8c135f505f41c49fcaeb13354bca87 => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:22.622722 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde83c44-e088-4f10-88d8-6dfa1b5bcab2 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:22.661477 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:22.670784 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 150/297] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:05:22.670784 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08357de7-29e3-437c-84db-c859f7afdbc9 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:22.670784 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08357de7-29e3-437c-84db-c859f7afdbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:22.670784 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08357de7-29e3-437c-84db-c859f7afdbc9 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:22.670784 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 151/298] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:22.670784 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08357de7-29e3-437c-84db-c859f7afdbc9 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:22.734316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde83c44-e088-4f10-88d8-6dfa1b5bcab2 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:22.741267 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:22.773252 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6e32c-69e3-4858-9f0c-afa9d989ae84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:22.774160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6e32c-69e3-4858-9f0c-afa9d989ae84 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:22.774707 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6e32c-69e3-4858-9f0c-afa9d989ae84 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:22.774707 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6e32c-69e3-4858-9f0c-afa9d989ae84 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:22.785314 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6e32c-69e3-4858-9f0c-afa9d989ae84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:22.793153 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-13c6e32c-69e3-4858-9f0c-afa9d989ae84 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:05:22.793153 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:22.793153 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:22.793153 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:22.793153 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:22.793153 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:22.793153 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:22.793153 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:22.793153 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:22.793153 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:22.793153 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:22.793153 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:22.793153 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:22.793153 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:22.793153 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:22.793153 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:22.794051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:22.794051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:22.794051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:22.794051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:22.794051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:22.794051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:22.794051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:22.794051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:22.794051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:22.794051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:22.794051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:22.794051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:22.794051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:22.794051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:22.794051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:22.794051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:22.794820 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:22.794820 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:22.794820 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:22.794820 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:22.794820 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:22.794820 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:22.794820 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:22.794820 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:22.794820 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:22.794820 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:22.794820 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:05:22.794820 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:22.794820 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 148/299] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:22.796317 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e9398-9c3e-45ab-906b-d6d7356b9910 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:22.796317 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e9398-9c3e-45ab-906b-d6d7356b9910 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:22.796317 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e9398-9c3e-45ab-906b-d6d7356b9910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:22.802673 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08357de7-29e3-437c-84db-c859f7afdbc9 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:22.813478 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-576e9398-9c3e-45ab-906b-d6d7356b9910 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:22.814741 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-576e9398-9c3e-45ab-906b-d6d7356b9910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:22.839424 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24dd92-2cbc-4566-b43b-6f483e62900a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:22.840012 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24dd92-2cbc-4566-b43b-6f483e62900a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:22.840293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24dd92-2cbc-4566-b43b-6f483e62900a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:22.840568 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24dd92-2cbc-4566-b43b-6f483e62900a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:22.841407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24dd92-2cbc-4566-b43b-6f483e62900a None admin] RBAC: Adding query filter params (role.id=16b11a05b5da4287bdd74d219dde5fb1, scope.project.id=fb8c135f505f41c49fcaeb13354bca87, user.id=82510dbf52084ee5939590a7c268c053) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:22.841702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24dd92-2cbc-4566-b43b-6f483e62900a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:22.843149 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24dd92-2cbc-4566-b43b-6f483e62900a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:22.849262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 152/300] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:05:22 2022] GET /identity/v3/role_assignments?user.id=82510dbf52084ee5939590a7c268c053&scope.project.id=fb8c135f505f41c49fcaeb13354bca87&role.id=16b11a05b5da4287bdd74d219dde5fb1 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:22.850628 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24dd92-2cbc-4566-b43b-6f483e62900a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:22.889615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 149/301] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:22.890810 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e9398-9c3e-45ab-906b-d6d7356b9910 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:22.931262 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:22.997166 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24dd92-2cbc-4566-b43b-6f483e62900a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:23.018384 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:23.022430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e9398-9c3e-45ab-906b-d6d7356b9910 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:23.049120 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ee6d5-b0aa-488c-b307-55c27d73d709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:23.050279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ee6d5-b0aa-488c-b307-55c27d73d709 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:23.051155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ee6d5-b0aa-488c-b307-55c27d73d709 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:23.051155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ee6d5-b0aa-488c-b307-55c27d73d709 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:23.052733 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ee6d5-b0aa-488c-b307-55c27d73d709 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:23.054466 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ee6d5-b0aa-488c-b307-55c27d73d709 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:23.056281 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 153/302] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:05:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:23.061303 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ee6d5-b0aa-488c-b307-55c27d73d709 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:23.067953 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f239c2-ea4c-4538-bb49-5024e36d27e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:23.068632 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f239c2-ea4c-4538-bb49-5024e36d27e0 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:23.068912 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f239c2-ea4c-4538-bb49-5024e36d27e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:23.069185 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f239c2-ea4c-4538-bb49-5024e36d27e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:23.071622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f239c2-ea4c-4538-bb49-5024e36d27e0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:23.071622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f239c2-ea4c-4538-bb49-5024e36d27e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:23.071892 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f239c2-ea4c-4538-bb49-5024e36d27e0 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:23.080883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 150/303] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jul 11 11:05:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:23.081620 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f239c2-ea4c-4538-bb49-5024e36d27e0 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:23.183289 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ee6d5-b0aa-488c-b307-55c27d73d709 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:23.186141 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:23.199093 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f239c2-ea4c-4538-bb49-5024e36d27e0 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:23.218077 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69aaf7b-7dc1-4f36-a8b1-3397ca36f53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:23.219182 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69aaf7b-7dc1-4f36-a8b1-3397ca36f53a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:23.219657 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69aaf7b-7dc1-4f36-a8b1-3397ca36f53a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:23.220125 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69aaf7b-7dc1-4f36-a8b1-3397ca36f53a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:23.234089 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69aaf7b-7dc1-4f36-a8b1-3397ca36f53a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:23.235208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9b7e9-e275-4b21-b16e-8ae0cc2ef49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:23.235874 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9b7e9-e275-4b21-b16e-8ae0cc2ef49d None admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:23.236164 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9b7e9-e275-4b21-b16e-8ae0cc2ef49d None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:23.236439 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9b7e9-e275-4b21-b16e-8ae0cc2ef49d None admin] PATH_INFO: `/v3/groups` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:23.237123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9b7e9-e275-4b21-b16e-8ae0cc2ef49d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:23.238609 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9b7e9-e275-4b21-b16e-8ae0cc2ef49d None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:23.243437 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-a69aaf7b-7dc1-4f36-a8b1-3397ca36f53a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:05:23.243437 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:23.243437 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:23.243437 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:23.243437 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:23.243437 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:23.243437 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:23.243437 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:23.243437 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:23.243437 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:23.243437 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:23.243437 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:23.243437 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:23.243437 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:23.243437 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:23.243437 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:23.244296 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:23.244296 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:23.244296 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:23.244296 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:23.244296 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:23.244296 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:23.244296 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:23.244296 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:23.244296 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:23.244296 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:23.244296 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:23.244296 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:23.244296 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:23.244296 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:23.244296 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:23.244296 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:23.245082 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:23.245082 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:23.245082 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:23.245082 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:23.245082 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:23.245082 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:23.245082 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:23.245082 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:23.245082 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:23.245082 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:23.245082 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:05:23.245082 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:23.245082 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 154/304] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:23.245720 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69aaf7b-7dc1-4f36-a8b1-3397ca36f53a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:23.291983 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:23.310118 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 151/305] 10.222.0.23 () {60 vars in 1134 bytes} [Mon Jul 11 11:05:23 2022] POST /identity/v3/groups => generated 229 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:05:23.311117 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9b7e9-e275-4b21-b16e-8ae0cc2ef49d None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:23.364830 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69aaf7b-7dc1-4f36-a8b1-3397ca36f53a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:23.408190 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95c986-de6b-48cb-8095-c95c64ecdbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:23.409554 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95c986-de6b-48cb-8095-c95c64ecdbad None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:23.410052 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95c986-de6b-48cb-8095-c95c64ecdbad None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:23.410554 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95c986-de6b-48cb-8095-c95c64ecdbad None admin] PATH_INFO: `/v3/users/8d4110809c324a0db0fa6efc6a4c1d6d` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:23.430389 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95c986-de6b-48cb-8095-c95c64ecdbad None admin] RBAC: Authorizing `identity:get_user(user_id=8d4110809c324a0db0fa6efc6a4c1d6d)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:23.432795 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95c986-de6b-48cb-8095-c95c64ecdbad None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:23.435629 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 155/306] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:05:23 2022] GET /identity/v3/users/8d4110809c324a0db0fa6efc6a4c1d6d => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:23.441625 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95c986-de6b-48cb-8095-c95c64ecdbad None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:23.465456 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9b7e9-e275-4b21-b16e-8ae0cc2ef49d None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:23.513640 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24587d14-9604-4c92-a32e-da92cc30b759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:23.514727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24587d14-9604-4c92-a32e-da92cc30b759 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:23.515125 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24587d14-9604-4c92-a32e-da92cc30b759 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:23.515406 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24587d14-9604-4c92-a32e-da92cc30b759 None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:23.516167 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24587d14-9604-4c92-a32e-da92cc30b759 None admin] RBAC: Adding query filter params (name=member) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:23.516476 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24587d14-9604-4c92-a32e-da92cc30b759 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:23.517904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24587d14-9604-4c92-a32e-da92cc30b759 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:23.528986 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 152/307] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jul 11 11:05:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:23.534711 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24587d14-9604-4c92-a32e-da92cc30b759 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:23.548454 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:23.559168 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95c986-de6b-48cb-8095-c95c64ecdbad None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:23.596379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7e928-b8a6-4a83-b844-2d3cb1ea013a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:23.597316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7e928-b8a6-4a83-b844-2d3cb1ea013a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:23.597742 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7e928-b8a6-4a83-b844-2d3cb1ea013a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:23.598198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7e928-b8a6-4a83-b844-2d3cb1ea013a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:23.599364 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7e928-b8a6-4a83-b844-2d3cb1ea013a None admin] RBAC: Adding query filter params (role.id=ebafad9871bc4983849d1e2efaf955f2, user.id=8d4110809c324a0db0fa6efc6a4c1d6d, scope.system=all) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:23.600201 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7e928-b8a6-4a83-b844-2d3cb1ea013a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:23.600751 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:23.602476 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7e928-b8a6-4a83-b844-2d3cb1ea013a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:23.609181 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 156/308] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Jul 11 11:05:23 2022] GET /identity/v3/role_assignments?user.id=8d4110809c324a0db0fa6efc6a4c1d6d&scope.system=all&role.id=ebafad9871bc4983849d1e2efaf955f2 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:23.610443 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b93574-7251-4503-8957-5b6a5b5ed21a None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:23.610704 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b93574-7251-4503-8957-5b6a5b5ed21a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:23.610983 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b93574-7251-4503-8957-5b6a5b5ed21a None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:23.612562 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 157/309] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:23.620683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9344b-6f61-4252-8e71-d556b8803496 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:23.620980 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9344b-6f61-4252-8e71-d556b8803496 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:23.621265 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9344b-6f61-4252-8e71-d556b8803496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:23.641185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-ffb9344b-6f61-4252-8e71-d556b8803496 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:23.642564 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ffb9344b-6f61-4252-8e71-d556b8803496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:23.650993 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24587d14-9604-4c92-a32e-da92cc30b759 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:23.693019 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a0faa-7471-4e43-81b1-d0d59659a539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:23.693862 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a0faa-7471-4e43-81b1-d0d59659a539 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:23.694154 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a0faa-7471-4e43-81b1-d0d59659a539 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:23.694434 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a0faa-7471-4e43-81b1-d0d59659a539 None admin] PATH_INFO: `/v3/users/a68430ad30a04dcea49bb03144afd126` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:23.695711 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a0faa-7471-4e43-81b1-d0d59659a539 None admin] RBAC: Authorizing `identity:get_user(user_id=a68430ad30a04dcea49bb03144afd126)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:23.697249 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a0faa-7471-4e43-81b1-d0d59659a539 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:23.703725 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 153/310] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:05:23 2022] GET /identity/v3/users/a68430ad30a04dcea49bb03144afd126 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:23.704704 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a0faa-7471-4e43-81b1-d0d59659a539 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:23.723204 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 158/311] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:05:23.747724 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9344b-6f61-4252-8e71-d556b8803496 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:23.796928 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:23.825041 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a0faa-7471-4e43-81b1-d0d59659a539 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:23.862201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6c9b2-7fb7-4d30-9e28-e53d2dcb08df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:23.863067 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6c9b2-7fb7-4d30-9e28-e53d2dcb08df None admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:23.863350 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6c9b2-7fb7-4d30-9e28-e53d2dcb08df None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:23.863627 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6c9b2-7fb7-4d30-9e28-e53d2dcb08df None admin] PATH_INFO: `/v3/system/users/a68430ad30a04dcea49bb03144afd126/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:23.865195 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a6c9b2-7fb7-4d30-9e28-e53d2dcb08df None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a68430ad30a04dcea49bb03144afd126, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:23.866651 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a6c9b2-7fb7-4d30-9e28-e53d2dcb08df None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:23.874861 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:23.878929 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9344b-6f61-4252-8e71-d556b8803496 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:23.915175 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4196269-54d4-4237-ac0c-6f73624d2914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:23.916327 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4196269-54d4-4237-ac0c-6f73624d2914 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:23.916839 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4196269-54d4-4237-ac0c-6f73624d2914 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:23.917343 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4196269-54d4-4237-ac0c-6f73624d2914 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:23.928610 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4196269-54d4-4237-ac0c-6f73624d2914 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:23.937178 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-d4196269-54d4-4237-ac0c-6f73624d2914 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:05:23.937178 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:23.937178 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:23.937178 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:23.937178 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:23.937178 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:23.937178 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:23.937178 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:23.937178 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:23.937178 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:23.937178 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:23.937178 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:23.937178 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:23.937178 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:23.937178 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:23.937178 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:23.938242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:23.938242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:23.938242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:23.938242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:23.938242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:23.938242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:23.938242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:23.938242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:23.938242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:23.938242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:23.938242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:23.938242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:23.938242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:23.938242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:23.938242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:23.938242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:23.939278 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:23.939278 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:23.939278 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:23.939278 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:23.939278 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:23.939278 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:23.939278 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:23.939278 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:23.939278 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:23.939278 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:23.939278 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:05:23.939278 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:23.941682 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 159/312] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:05:23.947696 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4196269-54d4-4237-ac0c-6f73624d2914 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:23.964652 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 154/313] 10.222.0.23 () {58 vars in 1334 bytes} [Mon Jul 11 11:05:23 2022] PUT /identity/v3/system/users/a68430ad30a04dcea49bb03144afd126/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:05:24.074222 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4196269-54d4-4237-ac0c-6f73624d2914 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:24.115187 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26220af-efdf-454b-bacb-24c7fd322e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:24.115187 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26220af-efdf-454b-bacb-24c7fd322e69 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:24.115187 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26220af-efdf-454b-bacb-24c7fd322e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:24.115187 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26220af-efdf-454b-bacb-24c7fd322e69 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:24.116043 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26220af-efdf-454b-bacb-24c7fd322e69 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:24.116356 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26220af-efdf-454b-bacb-24c7fd322e69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:24.117899 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26220af-efdf-454b-bacb-24c7fd322e69 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:24.128000 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 160/314] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jul 11 11:05:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:24.134061 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6c9b2-7fb7-4d30-9e28-e53d2dcb08df None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:24.242631 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6c9b2-7fb7-4d30-9e28-e53d2dcb08df None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:24.277212 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f70ee2-82ca-4914-8c20-43c7e301a9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:24.278113 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f70ee2-82ca-4914-8c20-43c7e301a9db None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:24.278398 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f70ee2-82ca-4914-8c20-43c7e301a9db None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:24.278673 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f70ee2-82ca-4914-8c20-43c7e301a9db None admin] PATH_INFO: `/v3/users/f8b23e9308ad4039bed253b984cf32d2` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:24.279865 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f70ee2-82ca-4914-8c20-43c7e301a9db None admin] RBAC: Authorizing `identity:get_user(user_id=f8b23e9308ad4039bed253b984cf32d2)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:24.281318 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f70ee2-82ca-4914-8c20-43c7e301a9db None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:24.286961 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 155/315] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:05:24 2022] GET /identity/v3/users/f8b23e9308ad4039bed253b984cf32d2 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:24.289133 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26220af-efdf-454b-bacb-24c7fd322e69 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:24.309752 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:24.400499 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26220af-efdf-454b-bacb-24c7fd322e69 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:24.438618 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8be036-7a21-4883-a804-f06971303712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:24.439542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8be036-7a21-4883-a804-f06971303712 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:24.439976 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8be036-7a21-4883-a804-f06971303712 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:24.440402 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8be036-7a21-4883-a804-f06971303712 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:24.513246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8be036-7a21-4883-a804-f06971303712 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:24.515014 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8be036-7a21-4883-a804-f06971303712 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:24.535261 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:24.619731 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 161/316] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:05:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:05:24.626290 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f70ee2-82ca-4914-8c20-43c7e301a9db None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:24.640043 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:24.740963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f70ee2-82ca-4914-8c20-43c7e301a9db None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:24.780339 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd233c-3768-4edc-9db2-2c53ddc2d95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:24.781235 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd233c-3768-4edc-9db2-2c53ddc2d95d None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:24.781520 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd233c-3768-4edc-9db2-2c53ddc2d95d None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:24.781821 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd233c-3768-4edc-9db2-2c53ddc2d95d None admin] PATH_INFO: `/v3/projects/fb8c135f505f41c49fcaeb13354bca87` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:24.783035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd233c-3768-4edc-9db2-2c53ddc2d95d None admin] RBAC: Authorizing `identity:get_project(project_id=fb8c135f505f41c49fcaeb13354bca87)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:24.784599 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd233c-3768-4edc-9db2-2c53ddc2d95d None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:24.787415 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 156/317] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:24 2022] GET /identity/v3/projects/fb8c135f505f41c49fcaeb13354bca87 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:24.794870 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8be036-7a21-4883-a804-f06971303712 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:24.899711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8be036-7a21-4883-a804-f06971303712 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:24.917328 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:24.934682 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d61ece-c286-487b-be2b-51201b1e63d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:24.935337 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d61ece-c286-487b-be2b-51201b1e63d4 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:24.935619 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d61ece-c286-487b-be2b-51201b1e63d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:24.935896 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d61ece-c286-487b-be2b-51201b1e63d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:24.936718 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d61ece-c286-487b-be2b-51201b1e63d4 None admin] RBAC: Adding query filter params (role.id=ebafad9871bc4983849d1e2efaf955f2, scope.project.id=fb8c135f505f41c49fcaeb13354bca87, user.id=f8b23e9308ad4039bed253b984cf32d2) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:24.937030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d61ece-c286-487b-be2b-51201b1e63d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:24.938487 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d61ece-c286-487b-be2b-51201b1e63d4 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:24.944714 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 162/318] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:05:24 2022] GET /identity/v3/role_assignments?user.id=f8b23e9308ad4039bed253b984cf32d2&scope.project.id=fb8c135f505f41c49fcaeb13354bca87&role.id=ebafad9871bc4983849d1e2efaf955f2 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:25.507855 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8758f4c-38e5-43d3-ad05-286980b7db00 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:25.508284 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8758f4c-38e5-43d3-ad05-286980b7db00 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:25.508528 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8758f4c-38e5-43d3-ad05-286980b7db00 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:25.509988 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 157/319] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:25.514975 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09e1e8-cd98-45a5-973d-49fba187e632 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:25.515267 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09e1e8-cd98-45a5-973d-49fba187e632 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:25.515547 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09e1e8-cd98-45a5-973d-49fba187e632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:25.532126 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-fe09e1e8-cd98-45a5-973d-49fba187e632 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:25.533311 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-fe09e1e8-cd98-45a5-973d-49fba187e632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:25.603595 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 163/320] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:25.625982 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8758f4c-38e5-43d3-ad05-286980b7db00 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:25.689080 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dca6f1-f4ca-42b5-9f30-caae9bf79a1a None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:25.689626 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dca6f1-f4ca-42b5-9f30-caae9bf79a1a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:25.689719 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dca6f1-f4ca-42b5-9f30-caae9bf79a1a None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:25.691199 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 164/321] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:05:25.696200 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270e953-bdf5-48a1-b2fd-a8cd62968fa5 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:25.696487 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270e953-bdf5-48a1-b2fd-a8cd62968fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:25.696764 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270e953-bdf5-48a1-b2fd-a8cd62968fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:25.714753 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-c270e953-bdf5-48a1-b2fd-a8cd62968fa5 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:25.714963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:25.716036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c270e953-bdf5-48a1-b2fd-a8cd62968fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:25.743044 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8758f4c-38e5-43d3-ad05-286980b7db00 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:25.787924 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 165/322] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:05:25.792721 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef85189-0318-4ce3-9a04-1f93a981d2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:25.792721 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef85189-0318-4ce3-9a04-1f93a981d2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:25.792721 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef85189-0318-4ce3-9a04-1f93a981d2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:25.792721 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef85189-0318-4ce3-9a04-1f93a981d2b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:25.793021 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef85189-0318-4ce3-9a04-1f93a981d2b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:25.793021 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef85189-0318-4ce3-9a04-1f93a981d2b2 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:25.793527 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 158/323] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:05:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:25.798782 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270e953-bdf5-48a1-b2fd-a8cd62968fa5 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:25.812342 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef85189-0318-4ce3-9a04-1f93a981d2b2 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:25.845434 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:25.904296 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270e953-bdf5-48a1-b2fd-a8cd62968fa5 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:25.920898 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef85189-0318-4ce3-9a04-1f93a981d2b2 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:25.940157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85494e45-0977-4337-ac1d-6af0a27e82dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:25.940948 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85494e45-0977-4337-ac1d-6af0a27e82dc None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:25.941234 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85494e45-0977-4337-ac1d-6af0a27e82dc None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:25.941513 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85494e45-0977-4337-ac1d-6af0a27e82dc None admin] PATH_INFO: `/v3/groups` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:25.942844 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85494e45-0977-4337-ac1d-6af0a27e82dc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:25.944525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85494e45-0977-4337-ac1d-6af0a27e82dc None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:25.955204 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a3263-7e22-47d5-b5a4-f33616dbb1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:25.955997 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a3263-7e22-47d5-b5a4-f33616dbb1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:25.956349 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a3263-7e22-47d5-b5a4-f33616dbb1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:25.956690 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a3263-7e22-47d5-b5a4-f33616dbb1a8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:25.967290 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a3263-7e22-47d5-b5a4-f33616dbb1a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:25.975593 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-da4a3263-7e22-47d5-b5a4-f33616dbb1a8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:05:25.975593 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:25.975593 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:25.975593 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:25.975593 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:25.975593 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:25.975593 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:25.975593 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:25.975593 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:25.975593 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:25.975593 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:25.975593 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:25.975593 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:25.975593 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:25.975593 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:25.975593 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:25.976506 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:25.976506 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:25.976506 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:25.976506 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:25.976506 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:25.976506 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:25.976506 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:25.976506 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:25.976506 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:25.976506 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:25.976506 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:25.976506 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:25.976506 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:25.976506 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:25.976506 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:25.976506 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:25.977304 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:25.977304 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:25.977304 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:25.977304 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:25.977304 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:25.977304 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:25.977304 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:25.977304 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:25.977304 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:25.977304 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:25.977304 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:05:25.977304 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:25.977304 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 159/324] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:05:25.982589 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a3263-7e22-47d5-b5a4-f33616dbb1a8 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:25.992546 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:26.049523 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 166/325] 10.222.0.23 () {60 vars in 1134 bytes} [Mon Jul 11 11:05:25 2022] POST /identity/v3/groups => generated 226 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:05:26.087806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a3263-7e22-47d5-b5a4-f33616dbb1a8 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:26.127481 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443b6d2-54aa-4c10-9f0b-4d60e63b57a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:26.128166 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443b6d2-54aa-4c10-9f0b-4d60e63b57a8 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:26.128452 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443b6d2-54aa-4c10-9f0b-4d60e63b57a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:26.128729 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443b6d2-54aa-4c10-9f0b-4d60e63b57a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:26.129526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443b6d2-54aa-4c10-9f0b-4d60e63b57a8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:26.129874 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443b6d2-54aa-4c10-9f0b-4d60e63b57a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:26.131293 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443b6d2-54aa-4c10-9f0b-4d60e63b57a8 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:26.140256 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b001a3-7996-45ae-bfa4-3eadeb207a64 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:26.140614 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b001a3-7996-45ae-bfa4-3eadeb207a64 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:26.140827 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b001a3-7996-45ae-bfa4-3eadeb207a64 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:26.141237 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 160/326] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jul 11 11:05:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:26.142358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 167/327] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:05:26.147980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7de57-6a68-49bd-ac87-d885dcc15da4 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:26.148274 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7de57-6a68-49bd-ac87-d885dcc15da4 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:26.148553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7de57-6a68-49bd-ac87-d885dcc15da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:26.150649 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b001a3-7996-45ae-bfa4-3eadeb207a64 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:26.167637 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-10e7de57-6a68-49bd-ac87-d885dcc15da4 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:26.168887 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-10e7de57-6a68-49bd-ac87-d885dcc15da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:26.238378 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:26.244307 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 161/328] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:05:26.268261 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7de57-6a68-49bd-ac87-d885dcc15da4 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:26.276405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b001a3-7996-45ae-bfa4-3eadeb207a64 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:26.278037 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:26.324622 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fafe49-1cb7-4d57-a515-4225f4a9b70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:26.325440 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fafe49-1cb7-4d57-a515-4225f4a9b70a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:26.325727 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fafe49-1cb7-4d57-a515-4225f4a9b70a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:26.326031 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fafe49-1cb7-4d57-a515-4225f4a9b70a None admin] PATH_INFO: `/v3/users/8d4110809c324a0db0fa6efc6a4c1d6d` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:26.327986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fafe49-1cb7-4d57-a515-4225f4a9b70a None admin] RBAC: Authorizing `identity:get_user(user_id=8d4110809c324a0db0fa6efc6a4c1d6d)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:26.329431 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fafe49-1cb7-4d57-a515-4225f4a9b70a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:26.331119 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 168/329] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:05:26 2022] GET /identity/v3/users/8d4110809c324a0db0fa6efc6a4c1d6d => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:26.337411 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fafe49-1cb7-4d57-a515-4225f4a9b70a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:26.392576 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7de57-6a68-49bd-ac87-d885dcc15da4 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:26.432552 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64205b-8231-4e0d-ab35-76fb362c5edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:26.433959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64205b-8231-4e0d-ab35-76fb362c5edf None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:26.434435 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64205b-8231-4e0d-ab35-76fb362c5edf None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:26.434883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64205b-8231-4e0d-ab35-76fb362c5edf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:26.447478 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64205b-8231-4e0d-ab35-76fb362c5edf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:26.455738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-9f64205b-8231-4e0d-ab35-76fb362c5edf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:05:26.455738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:26.455738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:26.455738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:26.455738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:26.455738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:26.455738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:26.455738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:26.455738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:26.455738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:26.455738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:26.455738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:26.455738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:26.455738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:26.455738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:26.455738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:26.456609 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:26.456609 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:26.456609 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:26.456609 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:26.456609 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:26.456609 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:26.456609 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:26.456609 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:26.456609 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:26.456609 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:26.456609 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:26.456609 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:26.456609 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:26.456609 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:26.456609 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:26.456609 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:26.457389 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:26.457389 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:26.457389 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:26.457389 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:26.457389 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:26.457389 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:26.457389 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:26.457389 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:26.457389 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:26.457389 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:26.457389 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:05:26.457389 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:26.459807 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 162/330] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:05:26.461801 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fafe49-1cb7-4d57-a515-4225f4a9b70a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:26.465602 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64205b-8231-4e0d-ab35-76fb362c5edf None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:26.506261 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5f1bf-733a-430b-adbf-42697fe1bffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:26.507654 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5f1bf-733a-430b-adbf-42697fe1bffd None admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:26.507838 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5f1bf-733a-430b-adbf-42697fe1bffd None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:26.508118 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5f1bf-733a-430b-adbf-42697fe1bffd None admin] PATH_INFO: `/v3/system/users/8d4110809c324a0db0fa6efc6a4c1d6d/roles/ebafad9871bc4983849d1e2efaf955f2` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:26.509813 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5f1bf-733a-430b-adbf-42697fe1bffd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8d4110809c324a0db0fa6efc6a4c1d6d, role_id=ebafad9871bc4983849d1e2efaf955f2)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:26.511545 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5f1bf-733a-430b-adbf-42697fe1bffd None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:26.539469 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:26.582383 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 169/331] 10.222.0.23 () {58 vars in 1334 bytes} [Mon Jul 11 11:05:26 2022] PUT /identity/v3/system/users/8d4110809c324a0db0fa6efc6a4c1d6d/roles/ebafad9871bc4983849d1e2efaf955f2 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:05:26.585792 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64205b-8231-4e0d-ab35-76fb362c5edf None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:26.626611 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5637b6-49a1-4516-9ce4-bf8ce2e36a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:26.627636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5637b6-49a1-4516-9ce4-bf8ce2e36a37 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:26.628203 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5637b6-49a1-4516-9ce4-bf8ce2e36a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:26.628738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5637b6-49a1-4516-9ce4-bf8ce2e36a37 None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:26.630024 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5637b6-49a1-4516-9ce4-bf8ce2e36a37 None admin] RBAC: Adding query filter params (name=member) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:26.634873 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5637b6-49a1-4516-9ce4-bf8ce2e36a37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:26.634873 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5637b6-49a1-4516-9ce4-bf8ce2e36a37 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:26.643173 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 163/332] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jul 11 11:05:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:26.649858 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5f1bf-733a-430b-adbf-42697fe1bffd None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:26.696084 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:26.781357 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5f1bf-733a-430b-adbf-42697fe1bffd None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:26.820363 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793d3a8-0f32-49d6-a355-103a36cf13bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:26.821255 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793d3a8-0f32-49d6-a355-103a36cf13bb None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:26.821537 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793d3a8-0f32-49d6-a355-103a36cf13bb None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:26.821840 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793d3a8-0f32-49d6-a355-103a36cf13bb None admin] PATH_INFO: `/v3/users/a68430ad30a04dcea49bb03144afd126` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:26.823050 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793d3a8-0f32-49d6-a355-103a36cf13bb None admin] RBAC: Authorizing `identity:get_user(user_id=a68430ad30a04dcea49bb03144afd126)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:26.824500 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793d3a8-0f32-49d6-a355-103a36cf13bb None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:26.826518 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 170/333] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:05:26 2022] GET /identity/v3/users/a68430ad30a04dcea49bb03144afd126 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:26.831854 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5637b6-49a1-4516-9ce4-bf8ce2e36a37 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:26.941135 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5637b6-49a1-4516-9ce4-bf8ce2e36a37 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:26.963046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:26.977871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e144e-4f14-4fd6-b432-d1840924feaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:26.978587 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e144e-4f14-4fd6-b432-d1840924feaa None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:26.978870 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e144e-4f14-4fd6-b432-d1840924feaa None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:26.979198 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e144e-4f14-4fd6-b432-d1840924feaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:26.980048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e144e-4f14-4fd6-b432-d1840924feaa None admin] RBAC: Adding query filter params (role.id=16b11a05b5da4287bdd74d219dde5fb1, user.id=a68430ad30a04dcea49bb03144afd126, scope.system=all) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:26.980356 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e144e-4f14-4fd6-b432-d1840924feaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:26.981820 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e144e-4f14-4fd6-b432-d1840924feaa None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:26.995519 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 164/334] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Jul 11 11:05:26 2022] GET /identity/v3/role_assignments?user.id=a68430ad30a04dcea49bb03144afd126&scope.system=all&role.id=16b11a05b5da4287bdd74d219dde5fb1 => generated 510 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:28.546447 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7b2e3-5b4c-4edc-b8e3-41b13943098e None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:28.546987 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7b2e3-5b4c-4edc-b8e3-41b13943098e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:28.546987 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7b2e3-5b4c-4edc-b8e3-41b13943098e None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:28.548569 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 171/335] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:28.553731 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715d842-61f7-49e9-99fc-452fafb36f86 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:28.554205 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715d842-61f7-49e9-99fc-452fafb36f86 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:28.554398 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715d842-61f7-49e9-99fc-452fafb36f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:28.574741 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-e715d842-61f7-49e9-99fc-452fafb36f86 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:28.575928 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-e715d842-61f7-49e9-99fc-452fafb36f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:28.659679 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 165/336] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:28.699455 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7b2e3-5b4c-4edc-b8e3-41b13943098e None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:28.799682 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fbafc-9f56-49a5-a412-b11870ae28c5 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:28.799968 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fbafc-9f56-49a5-a412-b11870ae28c5 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:28.800149 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fbafc-9f56-49a5-a412-b11870ae28c5 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:28.802179 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 166/337] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:28.821436 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf8899-be73-43d9-922d-a2ae286de778 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:28.821751 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf8899-be73-43d9-922d-a2ae286de778 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:28.822029 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf8899-be73-43d9-922d-a2ae286de778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:28.830478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7b2e3-5b4c-4edc-b8e3-41b13943098e None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:28.835601 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:28.850878 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-2eaf8899-be73-43d9-922d-a2ae286de778 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:28.855501 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-2eaf8899-be73-43d9-922d-a2ae286de778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:28.881938 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b645c-8d74-4751-86d3-4da0c0af614e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:28.882759 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b645c-8d74-4751-86d3-4da0c0af614e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:28.883041 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b645c-8d74-4751-86d3-4da0c0af614e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:28.883319 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b645c-8d74-4751-86d3-4da0c0af614e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:28.904609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b645c-8d74-4751-86d3-4da0c0af614e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:28.917221 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-035b645c-8d74-4751-86d3-4da0c0af614e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:05:28.917221 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:28.917221 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:28.917221 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:28.917221 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:28.917221 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:28.917221 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:28.917221 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:28.917221 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:28.917221 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:28.917221 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:28.917221 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:28.917221 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:28.917221 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:28.917221 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:28.917221 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:28.918166 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:28.918166 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:28.918166 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:28.918166 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:28.918166 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:28.918166 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:28.918166 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:28.918166 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:28.918166 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:28.918166 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:28.918166 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:28.918166 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:28.918166 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:28.918166 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:28.918166 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:28.918166 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:28.918952 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:28.918952 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:28.918952 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:28.918952 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:28.918952 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:28.918952 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:28.918952 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:28.918952 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:28.918952 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:28.918952 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:28.918952 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:05:28.918952 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:28.924038 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 172/338] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:28.930780 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b645c-8d74-4751-86d3-4da0c0af614e None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:29.018892 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 167/339] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:29.068832 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf8899-be73-43d9-922d-a2ae286de778 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:29.129118 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b645c-8d74-4751-86d3-4da0c0af614e None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:29.137466 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:29.211184 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf8899-be73-43d9-922d-a2ae286de778 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:29.215126 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d774f-626b-49c1-8a43-9a84fa384956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:29.215811 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d774f-626b-49c1-8a43-9a84fa384956 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:29.216097 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d774f-626b-49c1-8a43-9a84fa384956 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:29.216375 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d774f-626b-49c1-8a43-9a84fa384956 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:29.217128 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d774f-626b-49c1-8a43-9a84fa384956 None admin] RBAC: Adding query filter params (name=member) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:29.217435 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d774f-626b-49c1-8a43-9a84fa384956 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:29.218848 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d774f-626b-49c1-8a43-9a84fa384956 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:29.240524 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 173/340] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jul 11 11:05:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:29.246334 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d774f-626b-49c1-8a43-9a84fa384956 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:29.260908 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596c863-2dd0-4cc7-bcbd-11b41e8de4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:29.262126 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596c863-2dd0-4cc7-bcbd-11b41e8de4b1 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:29.262624 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596c863-2dd0-4cc7-bcbd-11b41e8de4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:29.263096 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596c863-2dd0-4cc7-bcbd-11b41e8de4b1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:29.279019 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596c863-2dd0-4cc7-bcbd-11b41e8de4b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:29.282792 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:29.292182 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-8596c863-2dd0-4cc7-bcbd-11b41e8de4b1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:05:29.292182 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:29.292182 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:29.292182 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:29.292182 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:29.292182 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:29.292182 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:29.292182 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:29.292182 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:29.292182 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:29.292182 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:29.292182 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:29.292182 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:29.292182 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:29.292182 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:29.292182 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:29.296538 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:29.296538 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:29.296538 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:29.296538 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:29.296538 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:29.296538 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:29.296538 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:29.296538 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:29.296538 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:29.296538 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:29.296538 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:29.296538 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:29.296538 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:29.296538 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:29.296538 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:29.296538 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:29.297330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:29.297330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:29.297330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:29.297330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:29.297330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:29.297330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:29.297330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:29.297330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:29.297330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:29.297330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:29.297330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:05:29.297330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:29.297330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 168/341] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jul 11 11:05:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:05:29.299580 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596c863-2dd0-4cc7-bcbd-11b41e8de4b1 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:29.374347 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d774f-626b-49c1-8a43-9a84fa384956 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:29.414178 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5b2ce-b86d-4f13-a5db-d904259dbd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:29.414841 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5b2ce-b86d-4f13-a5db-d904259dbd2e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:29.415171 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5b2ce-b86d-4f13-a5db-d904259dbd2e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:29.415451 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5b2ce-b86d-4f13-a5db-d904259dbd2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:29.447703 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:29.452753 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596c863-2dd0-4cc7-bcbd-11b41e8de4b1 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:29.492184 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e18d53-8a91-4c67-b27f-4e47b6985d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:29.493235 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e18d53-8a91-4c67-b27f-4e47b6985d07 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:29.493721 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e18d53-8a91-4c67-b27f-4e47b6985d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:29.494228 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e18d53-8a91-4c67-b27f-4e47b6985d07 None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:29.495448 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e18d53-8a91-4c67-b27f-4e47b6985d07 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:29.496575 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e18d53-8a91-4c67-b27f-4e47b6985d07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:29.498481 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e18d53-8a91-4c67-b27f-4e47b6985d07 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:29.498602 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5b2ce-b86d-4f13-a5db-d904259dbd2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:29.499927 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5b2ce-b86d-4f13-a5db-d904259dbd2e None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:29.512371 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 169/342] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:05:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:29.514754 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda99127-d5a1-4302-b068-e222957a7a36 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:29.515264 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda99127-d5a1-4302-b068-e222957a7a36 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:29.515999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda99127-d5a1-4302-b068-e222957a7a36 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:29.518246 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 170/343] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:29.519457 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda99127-d5a1-4302-b068-e222957a7a36 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:29.528257 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:29.631483 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 174/344] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:05:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 11:05:29.633893 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57046a34-d994-464a-af3a-41708d95c5fb None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:29.634406 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57046a34-d994-464a-af3a-41708d95c5fb None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:29.635357 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57046a34-d994-464a-af3a-41708d95c5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:29.648688 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda99127-d5a1-4302-b068-e222957a7a36 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:29.657861 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-57046a34-d994-464a-af3a-41708d95c5fb None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:29.659331 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-57046a34-d994-464a-af3a-41708d95c5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:29.692640 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963036b9-ae39-41df-8195-276f43cbfb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:29.693304 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963036b9-ae39-41df-8195-276f43cbfb23 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:29.693641 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963036b9-ae39-41df-8195-276f43cbfb23 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:29.693951 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963036b9-ae39-41df-8195-276f43cbfb23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:29.738664 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:29.750770 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 175/345] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:29.754243 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2822d8-0afc-4a25-ac16-9c361e28a7ea None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:29.754243 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2822d8-0afc-4a25-ac16-9c361e28a7ea None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:29.754243 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2822d8-0afc-4a25-ac16-9c361e28a7ea None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:29.754243 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 176/346] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:29.755537 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2822d8-0afc-4a25-ac16-9c361e28a7ea None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:29.809274 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963036b9-ae39-41df-8195-276f43cbfb23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:29.810862 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963036b9-ae39-41df-8195-276f43cbfb23 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:29.829575 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:29.882489 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2822d8-0afc-4a25-ac16-9c361e28a7ea None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:29.922960 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6bbc1-37f4-4809-847d-b48ee834adb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:29.924087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6bbc1-37f4-4809-847d-b48ee834adb4 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:29.924625 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6bbc1-37f4-4809-847d-b48ee834adb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:29.925136 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6bbc1-37f4-4809-847d-b48ee834adb4 None admin] PATH_INFO: `/v3/projects/0ad20973f17243d0959845935c042b0f` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:29.926793 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6bbc1-37f4-4809-847d-b48ee834adb4 None admin] RBAC: Authorizing `identity:get_project(project_id=0ad20973f17243d0959845935c042b0f)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:29.928570 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6bbc1-37f4-4809-847d-b48ee834adb4 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:29.931055 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 177/347] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:29 2022] GET /identity/v3/projects/0ad20973f17243d0959845935c042b0f => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:29.932405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78cc0d-d7dc-4b37-8571-997997a1edc8 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:29.932897 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78cc0d-d7dc-4b37-8571-997997a1edc8 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:29.933580 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78cc0d-d7dc-4b37-8571-997997a1edc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:29.944980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 171/348] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:05:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:05:29.946276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963036b9-ae39-41df-8195-276f43cbfb23 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:29.953208 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-7a78cc0d-d7dc-4b37-8571-997997a1edc8 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:29.954648 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7a78cc0d-d7dc-4b37-8571-997997a1edc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:30.009563 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:30.030543 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 178/349] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:30.031729 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78cc0d-d7dc-4b37-8571-997997a1edc8 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:30.053701 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963036b9-ae39-41df-8195-276f43cbfb23 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:30.092280 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb905ffe-5d13-438b-bbff-9cbcd63de802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:30.093184 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb905ffe-5d13-438b-bbff-9cbcd63de802 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:30.093545 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb905ffe-5d13-438b-bbff-9cbcd63de802 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:30.093929 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb905ffe-5d13-438b-bbff-9cbcd63de802 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:30.099526 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:30.106127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb905ffe-5d13-438b-bbff-9cbcd63de802 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:30.114157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-bb905ffe-5d13-438b-bbff-9cbcd63de802 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:05:30.114157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:30.114157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:30.114157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:30.114157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:30.114157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:30.114157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:30.114157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:30.114157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:30.114157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:30.114157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:30.114157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:30.114157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:30.114157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:30.114157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:30.114157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:30.115989 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:30.115989 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:30.115989 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:30.115989 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:30.115989 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:30.115989 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:30.115989 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:30.115989 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:30.115989 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:30.115989 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:30.115989 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:30.115989 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:30.115989 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:30.115989 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:30.115989 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:30.115989 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:30.116797 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:30.116797 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:30.116797 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:30.116797 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:30.116797 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:30.116797 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:30.116797 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:30.116797 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:30.116797 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:30.116797 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:30.116797 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:05:30.116797 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:30.116797 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 172/350] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:30.117454 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb905ffe-5d13-438b-bbff-9cbcd63de802 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:30.156344 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78cc0d-d7dc-4b37-8571-997997a1edc8 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:30.195243 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237f9d3-13bb-4471-b55e-806e52592cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:30.196350 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237f9d3-13bb-4471-b55e-806e52592cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:30.196779 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237f9d3-13bb-4471-b55e-806e52592cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:30.197224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237f9d3-13bb-4471-b55e-806e52592cb9 None admin] PATH_INFO: `/v3/groups/cc9a7af5740c4c66987618df2aa7249d` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:30.204081 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237f9d3-13bb-4471-b55e-806e52592cb9 None admin] RBAC: Authorizing `identity:get_group(group_id=cc9a7af5740c4c66987618df2aa7249d)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:30.205807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237f9d3-13bb-4471-b55e-806e52592cb9 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:30.208196 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 179/351] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Jul 11 11:05:30 2022] GET /identity/v3/groups/cc9a7af5740c4c66987618df2aa7249d => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:30.209217 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237f9d3-13bb-4471-b55e-806e52592cb9 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:30.227395 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb905ffe-5d13-438b-bbff-9cbcd63de802 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:30.251694 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:30.266756 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a89dfd-8aa5-4e5b-af2d-593ac3032e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:30.267620 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a89dfd-8aa5-4e5b-af2d-593ac3032e09 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:30.267908 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a89dfd-8aa5-4e5b-af2d-593ac3032e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:30.268189 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a89dfd-8aa5-4e5b-af2d-593ac3032e09 None admin] PATH_INFO: `/v3/projects/0ad20973f17243d0959845935c042b0f` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:30.269391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a89dfd-8aa5-4e5b-af2d-593ac3032e09 None admin] RBAC: Authorizing `identity:get_project(project_id=0ad20973f17243d0959845935c042b0f)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:30.271101 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a89dfd-8aa5-4e5b-af2d-593ac3032e09 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:30.273127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 173/352] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:30 2022] GET /identity/v3/projects/0ad20973f17243d0959845935c042b0f => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:30.273656 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a89dfd-8aa5-4e5b-af2d-593ac3032e09 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:30.327586 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237f9d3-13bb-4471-b55e-806e52592cb9 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:30.346656 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:30.367723 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d640b4-a077-4c48-9e37-21e987f08f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:30.368791 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d640b4-a077-4c48-9e37-21e987f08f13 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:30.369203 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d640b4-a077-4c48-9e37-21e987f08f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:30.369625 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d640b4-a077-4c48-9e37-21e987f08f13 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:30.384679 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d640b4-a077-4c48-9e37-21e987f08f13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:30.387590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a89dfd-8aa5-4e5b-af2d-593ac3032e09 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:30.395823 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-65d640b4-a077-4c48-9e37-21e987f08f13 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:05:30.395823 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:30.395823 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:30.395823 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:30.395823 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:30.395823 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:30.395823 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:30.395823 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:30.395823 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:30.395823 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:30.395823 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:30.395823 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:30.395823 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:30.395823 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:30.395823 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:30.395823 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:30.396888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:30.396888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:30.396888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:30.396888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:30.396888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:30.396888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:30.396888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:30.396888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:30.396888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:30.396888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:30.396888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:30.396888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:30.396888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:30.396888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:30.396888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:30.396888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:30.397874 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:30.397874 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:30.397874 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:30.397874 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:30.397874 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:30.397874 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:30.397874 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:30.397874 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:30.397874 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:30.397874 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:30.397874 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:05:30.397874 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:30.400836 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 180/353] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:30.402293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d640b4-a077-4c48-9e37-21e987f08f13 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:30.430638 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54431cc-6888-4b38-88e9-431018de84a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:30.431397 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54431cc-6888-4b38-88e9-431018de84a5 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:30.431824 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54431cc-6888-4b38-88e9-431018de84a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:30.432563 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54431cc-6888-4b38-88e9-431018de84a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:30.433452 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54431cc-6888-4b38-88e9-431018de84a5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:30.433934 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54431cc-6888-4b38-88e9-431018de84a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:30.435504 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54431cc-6888-4b38-88e9-431018de84a5 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:30.448911 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 174/354] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jul 11 11:05:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:30.449199 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54431cc-6888-4b38-88e9-431018de84a5 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:30.513420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:30.531377 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d640b4-a077-4c48-9e37-21e987f08f13 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:30.577261 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85352c7e-ce29-463d-8d3c-872fe1d54d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:30.578084 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85352c7e-ce29-463d-8d3c-872fe1d54d9d None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:30.578439 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85352c7e-ce29-463d-8d3c-872fe1d54d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:30.578813 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85352c7e-ce29-463d-8d3c-872fe1d54d9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:30.579907 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85352c7e-ce29-463d-8d3c-872fe1d54d9d None admin] RBAC: Adding query filter params (group.id=cc9a7af5740c4c66987618df2aa7249d, role.id=16b11a05b5da4287bdd74d219dde5fb1, scope.project.id=0ad20973f17243d0959845935c042b0f) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:30.580598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85352c7e-ce29-463d-8d3c-872fe1d54d9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:30.582421 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85352c7e-ce29-463d-8d3c-872fe1d54d9d None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:30.583793 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54431cc-6888-4b38-88e9-431018de84a5 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:30.589938 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 181/355] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Jul 11 11:05:30 2022] GET /identity/v3/role_assignments?group.id=cc9a7af5740c4c66987618df2aa7249d&scope.project.id=0ad20973f17243d0959845935c042b0f&role.id=16b11a05b5da4287bdd74d219dde5fb1 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:30.591163 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85352c7e-ce29-463d-8d3c-872fe1d54d9d None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:30.625557 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4bccd-3322-4e2e-9fb1-14535d436bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:30.626881 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4bccd-3322-4e2e-9fb1-14535d436bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:30.627250 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4bccd-3322-4e2e-9fb1-14535d436bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:30.627582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4bccd-3322-4e2e-9fb1-14535d436bc3 None admin] PATH_INFO: `/v3/groups/cc9a7af5740c4c66987618df2aa7249d` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:30.629140 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4bccd-3322-4e2e-9fb1-14535d436bc3 None admin] RBAC: Authorizing `identity:get_group(group_id=cc9a7af5740c4c66987618df2aa7249d)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:30.632520 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4bccd-3322-4e2e-9fb1-14535d436bc3 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:30.637800 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 175/356] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Jul 11 11:05:30 2022] GET /identity/v3/groups/cc9a7af5740c4c66987618df2aa7249d => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:30.637800 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4bccd-3322-4e2e-9fb1-14535d436bc3 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:30.652593 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:30.744079 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85352c7e-ce29-463d-8d3c-872fe1d54d9d None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:30.795107 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4bccd-3322-4e2e-9fb1-14535d436bc3 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:30.796088 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eafb8a-2ec5-4577-ac92-b40bd0a3cd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:30.796844 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eafb8a-2ec5-4577-ac92-b40bd0a3cd3a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:30.797130 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eafb8a-2ec5-4577-ac92-b40bd0a3cd3a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:30.797412 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eafb8a-2ec5-4577-ac92-b40bd0a3cd3a None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:30.798261 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eafb8a-2ec5-4577-ac92-b40bd0a3cd3a None admin] RBAC: Adding query filter params (name=member) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:30.798581 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eafb8a-2ec5-4577-ac92-b40bd0a3cd3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:30.800026 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eafb8a-2ec5-4577-ac92-b40bd0a3cd3a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:30.809359 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 182/357] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jul 11 11:05:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:30.810793 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b03a36-117f-4dad-9d9f-844b6f39ebdd None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:30.811080 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b03a36-117f-4dad-9d9f-844b6f39ebdd None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:30.811448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b03a36-117f-4dad-9d9f-844b6f39ebdd None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:30.812984 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 183/358] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:30.813706 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b03a36-117f-4dad-9d9f-844b6f39ebdd None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:30.823487 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:30.857865 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab054d3-d70a-448b-b390-a7ca5465de2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:30.859181 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab054d3-d70a-448b-b390-a7ca5465de2c None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:30.859670 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab054d3-d70a-448b-b390-a7ca5465de2c None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:30.859975 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab054d3-d70a-448b-b390-a7ca5465de2c None admin] PATH_INFO: `/v3/users/8d4110809c324a0db0fa6efc6a4c1d6d` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:30.863493 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab054d3-d70a-448b-b390-a7ca5465de2c None admin] RBAC: Authorizing `identity:get_user(user_id=8d4110809c324a0db0fa6efc6a4c1d6d)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:30.865893 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab054d3-d70a-448b-b390-a7ca5465de2c None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:30.868031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 176/359] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:05:30 2022] GET /identity/v3/users/8d4110809c324a0db0fa6efc6a4c1d6d => generated 293 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:30.868747 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab054d3-d70a-448b-b390-a7ca5465de2c None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:30.942898 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b03a36-117f-4dad-9d9f-844b6f39ebdd None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:30.944776 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:30.982911 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f3522-ca2c-435b-a8d0-93c902c4fd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:30.983123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab054d3-d70a-448b-b390-a7ca5465de2c None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:30.983926 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f3522-ca2c-435b-a8d0-93c902c4fd6f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:30.984386 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f3522-ca2c-435b-a8d0-93c902c4fd6f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:30.984917 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f3522-ca2c-435b-a8d0-93c902c4fd6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:30.987185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f3522-ca2c-435b-a8d0-93c902c4fd6f None admin] RBAC: Adding query filter params (group.id=cc9a7af5740c4c66987618df2aa7249d, role.id=da398232f5f14edc908b967ea8653212, scope.project.id=0ad20973f17243d0959845935c042b0f) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:30.987673 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f3522-ca2c-435b-a8d0-93c902c4fd6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:30.989909 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f3522-ca2c-435b-a8d0-93c902c4fd6f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:30.996742 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 184/360] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Jul 11 11:05:30 2022] GET /identity/v3/role_assignments?group.id=cc9a7af5740c4c66987618df2aa7249d&scope.project.id=0ad20973f17243d0959845935c042b0f&role.id=da398232f5f14edc908b967ea8653212 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:30.998281 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541d8bd-8b41-4dc0-974b-94cf1b0a3369 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:30.998845 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541d8bd-8b41-4dc0-974b-94cf1b0a3369 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:30.999339 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541d8bd-8b41-4dc0-974b-94cf1b0a3369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:31.018600 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-4541d8bd-8b41-4dc0-974b-94cf1b0a3369 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:31.020864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4541d8bd-8b41-4dc0-974b-94cf1b0a3369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:31.024203 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004e8d3-f9a5-403f-ae0c-1832ba6c6bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:31.025569 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004e8d3-f9a5-403f-ae0c-1832ba6c6bfa None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:31.025569 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004e8d3-f9a5-403f-ae0c-1832ba6c6bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:31.025569 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004e8d3-f9a5-403f-ae0c-1832ba6c6bfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:31.096572 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:31.106657 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 185/361] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:31.107876 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541d8bd-8b41-4dc0-974b-94cf1b0a3369 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:31.112537 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004e8d3-f9a5-403f-ae0c-1832ba6c6bfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:31.119038 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004e8d3-f9a5-403f-ae0c-1832ba6c6bfa None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:31.221867 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:31.229840 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541d8bd-8b41-4dc0-974b-94cf1b0a3369 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:31.233062 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 177/362] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:05:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:05:31.236055 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc2255-fc2d-44b9-98fc-9dfc622016f5 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:31.236055 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc2255-fc2d-44b9-98fc-9dfc622016f5 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:31.236055 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc2255-fc2d-44b9-98fc-9dfc622016f5 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:31.236055 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 178/363] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:31.236368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc2255-fc2d-44b9-98fc-9dfc622016f5 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:31.268694 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a77701-9dcd-4932-9d30-1468ea9db53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:31.270644 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a77701-9dcd-4932-9d30-1468ea9db53d None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:31.271782 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a77701-9dcd-4932-9d30-1468ea9db53d None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:31.272432 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a77701-9dcd-4932-9d30-1468ea9db53d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:31.274576 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a77701-9dcd-4932-9d30-1468ea9db53d None admin] RBAC: Adding query filter params (role.id=ebafad9871bc4983849d1e2efaf955f2, user.id=8d4110809c324a0db0fa6efc6a4c1d6d, scope.system=all) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:31.275788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a77701-9dcd-4932-9d30-1468ea9db53d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:31.277432 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a77701-9dcd-4932-9d30-1468ea9db53d None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:31.294692 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 186/364] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Jul 11 11:05:31 2022] GET /identity/v3/role_assignments?user.id=8d4110809c324a0db0fa6efc6a4c1d6d&scope.system=all&role.id=ebafad9871bc4983849d1e2efaf955f2 => generated 510 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:31.295838 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a77701-9dcd-4932-9d30-1468ea9db53d None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:31.363091 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:31.396187 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc2255-fc2d-44b9-98fc-9dfc622016f5 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:31.471590 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a77701-9dcd-4932-9d30-1468ea9db53d None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:31.478215 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf3f78-c953-48d4-9ea8-b52d8207eae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:31.479342 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf3f78-c953-48d4-9ea8-b52d8207eae9 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:31.479808 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf3f78-c953-48d4-9ea8-b52d8207eae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:31.480269 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf3f78-c953-48d4-9ea8-b52d8207eae9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:31.500307 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf3f78-c953-48d4-9ea8-b52d8207eae9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:31.512113 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-0ccf3f78-c953-48d4-9ea8-b52d8207eae9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:05:31.512113 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:31.512113 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:31.512113 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:31.512113 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:31.512113 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:31.512113 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:31.512113 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:31.512113 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:31.512113 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:31.512113 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:31.512113 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:31.512113 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:31.512113 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:31.512113 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:31.512113 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:31.513048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:31.513048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:31.513048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:31.513048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:31.513048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:31.513048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:31.513048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:31.513048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:31.513048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:31.513048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:31.513048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:31.513048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:31.513048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:31.513048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:31.513048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:31.513048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:31.513865 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:31.513865 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:31.513865 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:31.513865 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:31.513865 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:31.513865 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:31.513865 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:31.513865 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:31.513865 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:31.513865 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:31.513865 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:05:31.513865 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:31.515957 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 179/365] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jul 11 11:05:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:31.517403 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96e34f-73f9-457d-a5b3-fb0bf4cb0f03 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:31.517861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96e34f-73f9-457d-a5b3-fb0bf4cb0f03 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:31.518301 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96e34f-73f9-457d-a5b3-fb0bf4cb0f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:31.523066 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0150c26-4254-4348-8582-bf59f6e71f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:31.523880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0150c26-4254-4348-8582-bf59f6e71f32 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:31.524168 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0150c26-4254-4348-8582-bf59f6e71f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:31.524443 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0150c26-4254-4348-8582-bf59f6e71f32 None admin] PATH_INFO: `/v3/projects/fb8c135f505f41c49fcaeb13354bca87` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:31.525994 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0150c26-4254-4348-8582-bf59f6e71f32 None admin] RBAC: Authorizing `identity:get_project(project_id=fb8c135f505f41c49fcaeb13354bca87)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:31.527366 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0150c26-4254-4348-8582-bf59f6e71f32 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:31.531676 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 187/366] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:31 2022] GET /identity/v3/projects/fb8c135f505f41c49fcaeb13354bca87 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:31.532983 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0150c26-4254-4348-8582-bf59f6e71f32 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:31.538529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-ae96e34f-73f9-457d-a5b3-fb0bf4cb0f03 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:31.539940 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-ae96e34f-73f9-457d-a5b3-fb0bf4cb0f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:31.563689 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:31.621784 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 180/367] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:31.622860 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96e34f-73f9-457d-a5b3-fb0bf4cb0f03 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:31.679061 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0150c26-4254-4348-8582-bf59f6e71f32 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:31.723760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede708a1-e21f-491c-ac44-3b38644e8cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:31.724817 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede708a1-e21f-491c-ac44-3b38644e8cbe None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:31.725475 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede708a1-e21f-491c-ac44-3b38644e8cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:31.726015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede708a1-e21f-491c-ac44-3b38644e8cbe None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:31.726983 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede708a1-e21f-491c-ac44-3b38644e8cbe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:31.727513 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede708a1-e21f-491c-ac44-3b38644e8cbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:31.729099 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede708a1-e21f-491c-ac44-3b38644e8cbe None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:31.735943 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:31.742487 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 188/368] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:05:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:31.743617 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede708a1-e21f-491c-ac44-3b38644e8cbe None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:31.778904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96e34f-73f9-457d-a5b3-fb0bf4cb0f03 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:31.828795 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1be1a1-bf72-4182-9d75-459c1c968678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:31.829663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1be1a1-bf72-4182-9d75-459c1c968678 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:31.829967 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1be1a1-bf72-4182-9d75-459c1c968678 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:31.830240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1be1a1-bf72-4182-9d75-459c1c968678 None admin] PATH_INFO: `/v3/groups/cc9a7af5740c4c66987618df2aa7249d` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:31.831675 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1be1a1-bf72-4182-9d75-459c1c968678 None admin] RBAC: Authorizing `identity:get_group(group_id=cc9a7af5740c4c66987618df2aa7249d)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:31.834491 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1be1a1-bf72-4182-9d75-459c1c968678 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:31.836662 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 181/369] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Jul 11 11:05:31 2022] GET /identity/v3/groups/cc9a7af5740c4c66987618df2aa7249d => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:31.837543 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1be1a1-bf72-4182-9d75-459c1c968678 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:31.872672 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:31.895413 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede708a1-e21f-491c-ac44-3b38644e8cbe None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:31.944526 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b58091-3a96-4aea-a1f3-72b368c1ec17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:31.945347 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b58091-3a96-4aea-a1f3-72b368c1ec17 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:31.945834 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b58091-3a96-4aea-a1f3-72b368c1ec17 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:31.946126 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b58091-3a96-4aea-a1f3-72b368c1ec17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:31.958691 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b58091-3a96-4aea-a1f3-72b368c1ec17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:31.968598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-36b58091-3a96-4aea-a1f3-72b368c1ec17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:05:31.968598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:31.968598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:31.968598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:31.968598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:31.968598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:31.968598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:31.968598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:31.968598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:31.968598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:31.968598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:31.968598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:31.968598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:31.968598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:31.968598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:31.968598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:31.969501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:31.969501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:31.969501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:31.969501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:31.969501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:31.969501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:31.969501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:31.969501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:31.969501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:31.969501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:31.969501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:31.969501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:31.969501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:31.969501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:31.969501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:31.969501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:31.970370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:31.970370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:31.970370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:31.970370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:31.970370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:31.970370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:31.970370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:31.970370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:31.970370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:31.970370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:31.970370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:05:31.970370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:31.970370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 189/370] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:05:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:31.971036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b58091-3a96-4aea-a1f3-72b368c1ec17 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:31.972568 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1be1a1-bf72-4182-9d75-459c1c968678 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:32.022231 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a24847a-326e-4c98-843b-46b356f364cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:32.023244 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24847a-326e-4c98-843b-46b356f364cc None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:32.023711 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24847a-326e-4c98-843b-46b356f364cc None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:32.024577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24847a-326e-4c98-843b-46b356f364cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:32.045380 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:32.106312 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b58091-3a96-4aea-a1f3-72b368c1ec17 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:32.111503 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a24847a-326e-4c98-843b-46b356f364cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:32.112969 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a24847a-326e-4c98-843b-46b356f364cc None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:32.152111 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c6bc9-efda-4192-b6ad-d85a8a1e73af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:32.153115 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c6bc9-efda-4192-b6ad-d85a8a1e73af None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:32.153889 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c6bc9-efda-4192-b6ad-d85a8a1e73af None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:32.154408 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c6bc9-efda-4192-b6ad-d85a8a1e73af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:32.156256 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c6bc9-efda-4192-b6ad-d85a8a1e73af None admin] RBAC: Adding query filter params (group.id=cc9a7af5740c4c66987618df2aa7249d, role.id=16b11a05b5da4287bdd74d219dde5fb1, scope.project.id=fb8c135f505f41c49fcaeb13354bca87) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:32.156786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c6bc9-efda-4192-b6ad-d85a8a1e73af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:32.158494 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c6bc9-efda-4192-b6ad-d85a8a1e73af None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:32.167616 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 190/371] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Jul 11 11:05:31 2022] GET /identity/v3/role_assignments?group.id=cc9a7af5740c4c66987618df2aa7249d&scope.project.id=fb8c135f505f41c49fcaeb13354bca87&role.id=16b11a05b5da4287bdd74d219dde5fb1 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:32.168777 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c6bc9-efda-4192-b6ad-d85a8a1e73af None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:32.182812 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:32.263604 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 182/372] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:05:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:05:32.280158 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a24847a-326e-4c98-843b-46b356f364cc None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:32.309129 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c6bc9-efda-4192-b6ad-d85a8a1e73af None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:32.352476 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5b5c1-d570-4fa6-b227-dadb9a6adead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:32.353492 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5b5c1-d570-4fa6-b227-dadb9a6adead None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:32.354925 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5b5c1-d570-4fa6-b227-dadb9a6adead None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:32.355366 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5b5c1-d570-4fa6-b227-dadb9a6adead None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:32.356298 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5b5c1-d570-4fa6-b227-dadb9a6adead None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:32.356783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5b5c1-d570-4fa6-b227-dadb9a6adead None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:32.358365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5b5c1-d570-4fa6-b227-dadb9a6adead None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:32.370622 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 191/373] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:32.372639 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:32.382862 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5b5c1-d570-4fa6-b227-dadb9a6adead None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:32.463490 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a24847a-326e-4c98-843b-46b356f364cc None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:32.472498 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:32.508634 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc0b02-af57-49e2-9c0e-e2a713241ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:32.509499 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5b5c1-d570-4fa6-b227-dadb9a6adead None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:32.509611 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc0b02-af57-49e2-9c0e-e2a713241ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:32.510287 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc0b02-af57-49e2-9c0e-e2a713241ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:32.510287 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc0b02-af57-49e2-9c0e-e2a713241ba7 None admin] PATH_INFO: `/v3/projects/fb8c135f505f41c49fcaeb13354bca87` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:32.511337 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc0b02-af57-49e2-9c0e-e2a713241ba7 None admin] RBAC: Authorizing `identity:get_project(project_id=fb8c135f505f41c49fcaeb13354bca87)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:32.512995 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc0b02-af57-49e2-9c0e-e2a713241ba7 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:32.515973 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 183/374] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:32 2022] GET /identity/v3/projects/fb8c135f505f41c49fcaeb13354bca87 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:32.524270 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc0b02-af57-49e2-9c0e-e2a713241ba7 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:32.556930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d0071-7d68-4147-bca6-327db0c6dfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:32.557617 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d0071-7d68-4147-bca6-327db0c6dfdb None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:32.557950 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d0071-7d68-4147-bca6-327db0c6dfdb None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:32.558493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d0071-7d68-4147-bca6-327db0c6dfdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:32.643317 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d0071-7d68-4147-bca6-327db0c6dfdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:32.646633 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d0071-7d68-4147-bca6-327db0c6dfdb None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:32.664798 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc0b02-af57-49e2-9c0e-e2a713241ba7 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:32.681503 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:32.704346 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016cf6a5-7449-44ec-91f8-34152a3253cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:32.705727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cf6a5-7449-44ec-91f8-34152a3253cf None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:32.706407 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cf6a5-7449-44ec-91f8-34152a3253cf None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:32.706857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cf6a5-7449-44ec-91f8-34152a3253cf None admin] PATH_INFO: `/v3/groups/cc9a7af5740c4c66987618df2aa7249d` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:32.708846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016cf6a5-7449-44ec-91f8-34152a3253cf None admin] RBAC: Authorizing `identity:get_group(group_id=cc9a7af5740c4c66987618df2aa7249d)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:32.711020 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016cf6a5-7449-44ec-91f8-34152a3253cf None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:32.713635 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 184/375] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Jul 11 11:05:32 2022] GET /identity/v3/groups/cc9a7af5740c4c66987618df2aa7249d => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:32.719609 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016cf6a5-7449-44ec-91f8-34152a3253cf None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:32.726610 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:32.773452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 192/376] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:05:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:05:32.783318 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d0071-7d68-4147-bca6-327db0c6dfdb None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:32.852894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016cf6a5-7449-44ec-91f8-34152a3253cf None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:32.892086 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89af2e-9572-48c3-a7df-92670a88c04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:32.892924 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89af2e-9572-48c3-a7df-92670a88c04e None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:32.893503 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89af2e-9572-48c3-a7df-92670a88c04e None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:32.893965 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89af2e-9572-48c3-a7df-92670a88c04e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:32.894977 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89af2e-9572-48c3-a7df-92670a88c04e None admin] RBAC: Adding query filter params (group.id=cc9a7af5740c4c66987618df2aa7249d, role.id=da398232f5f14edc908b967ea8653212, scope.project.id=fb8c135f505f41c49fcaeb13354bca87) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:32.901816 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89af2e-9572-48c3-a7df-92670a88c04e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:32.901816 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89af2e-9572-48c3-a7df-92670a88c04e None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:32.904092 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 185/377] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Jul 11 11:05:32 2022] GET /identity/v3/role_assignments?group.id=cc9a7af5740c4c66987618df2aa7249d&scope.project.id=fb8c135f505f41c49fcaeb13354bca87&role.id=da398232f5f14edc908b967ea8653212 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:32.990962 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d0071-7d68-4147-bca6-327db0c6dfdb None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:33.040636 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cf38a-f1d3-4919-9acc-d4f6247c8fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:33.041809 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cf38a-f1d3-4919-9acc-d4f6247c8fbc None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:33.042242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cf38a-f1d3-4919-9acc-d4f6247c8fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:33.042662 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cf38a-f1d3-4919-9acc-d4f6247c8fbc None admin] PATH_INFO: `/v3/projects/88f214658e46461082860991a2c6d4f3` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:33.044012 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cf38a-f1d3-4919-9acc-d4f6247c8fbc None admin] RBAC: Authorizing `identity:get_project(project_id=88f214658e46461082860991a2c6d4f3)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:33.045700 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cf38a-f1d3-4919-9acc-d4f6247c8fbc None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:33.047676 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 193/378] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:32 2022] GET /identity/v3/projects/88f214658e46461082860991a2c6d4f3 => generated 344 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:33.053453 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89af2e-9572-48c3-a7df-92670a88c04e None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:33.127089 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:33.173010 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde0017-03c7-48cf-a4ac-5f640e49a7a4 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:33.173623 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde0017-03c7-48cf-a4ac-5f640e49a7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:33.174178 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde0017-03c7-48cf-a4ac-5f640e49a7a4 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:33.176147 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 194/379] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:33.181846 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d78e77-7271-4e8a-808e-684b15ee28d2 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:33.182419 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d78e77-7271-4e8a-808e-684b15ee28d2 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:33.182922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d78e77-7271-4e8a-808e-684b15ee28d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:33.212012 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89af2e-9572-48c3-a7df-92670a88c04e None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:33.216432 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-b2d78e77-7271-4e8a-808e-684b15ee28d2 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:33.217989 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b2d78e77-7271-4e8a-808e-684b15ee28d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:33.259320 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd9e7d-4bb2-4d50-8a5f-31f551322fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:33.260245 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd9e7d-4bb2-4d50-8a5f-31f551322fda None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:33.260532 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd9e7d-4bb2-4d50-8a5f-31f551322fda None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:33.260808 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd9e7d-4bb2-4d50-8a5f-31f551322fda None admin] PATH_INFO: `/v3/groups/e9a2a2d2cf474477805a40cfd32e7636` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:33.272066 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd9e7d-4bb2-4d50-8a5f-31f551322fda None admin] RBAC: Authorizing `identity:get_group(group_id=e9a2a2d2cf474477805a40cfd32e7636)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:33.273440 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:33.273553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd9e7d-4bb2-4d50-8a5f-31f551322fda None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:33.275572 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 186/380] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Jul 11 11:05:33 2022] GET /identity/v3/groups/e9a2a2d2cf474477805a40cfd32e7636 => generated 229 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:33.281355 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd9e7d-4bb2-4d50-8a5f-31f551322fda None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:33.347895 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 195/381] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:33.407949 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd9e7d-4bb2-4d50-8a5f-31f551322fda None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:33.418217 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:33.436631 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d78e77-7271-4e8a-808e-684b15ee28d2 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:33.455185 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1fce9-e5f0-45e0-b45b-113964739473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:33.455859 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1fce9-e5f0-45e0-b45b-113964739473 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:33.456148 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1fce9-e5f0-45e0-b45b-113964739473 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:33.456418 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1fce9-e5f0-45e0-b45b-113964739473 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:33.461788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1fce9-e5f0-45e0-b45b-113964739473 None admin] RBAC: Adding query filter params (group.id=e9a2a2d2cf474477805a40cfd32e7636, role.id=736e70deba004b9289c2fed43eb107f7, scope.project.id=88f214658e46461082860991a2c6d4f3) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:33.461788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1fce9-e5f0-45e0-b45b-113964739473 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:33.461788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1fce9-e5f0-45e0-b45b-113964739473 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:33.469684 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 187/382] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Jul 11 11:05:33 2022] GET /identity/v3/role_assignments?group.id=e9a2a2d2cf474477805a40cfd32e7636&scope.project.id=88f214658e46461082860991a2c6d4f3&role.id=736e70deba004b9289c2fed43eb107f7 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:33.530917 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092242c-1f94-4044-ba19-903ea5305120 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:33.531239 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092242c-1f94-4044-ba19-903ea5305120 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:33.531486 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092242c-1f94-4044-ba19-903ea5305120 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:33.534377 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 188/383] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:33.538996 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30d130-4b97-4018-ad33-602fdd080cb2 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:33.539289 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30d130-4b97-4018-ad33-602fdd080cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:33.539575 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30d130-4b97-4018-ad33-602fdd080cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:33.559480 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-ef30d130-4b97-4018-ad33-602fdd080cb2 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:33.561051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-ef30d130-4b97-4018-ad33-602fdd080cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:33.580508 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d78e77-7271-4e8a-808e-684b15ee28d2 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:33.621315 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857382f-a804-4465-86b7-c751a1b12830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:33.622476 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857382f-a804-4465-86b7-c751a1b12830 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:33.622975 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857382f-a804-4465-86b7-c751a1b12830 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:33.623428 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857382f-a804-4465-86b7-c751a1b12830 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:33.638869 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857382f-a804-4465-86b7-c751a1b12830 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:33.643451 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 189/384] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:05:33.647866 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-f857382f-a804-4465-86b7-c751a1b12830 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:05:33.647866 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:33.647866 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:33.647866 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:33.647866 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:33.647866 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:33.647866 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:33.647866 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:33.647866 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:33.647866 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:33.647866 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:33.647866 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:33.647866 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:33.647866 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:33.647866 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:33.647866 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:33.648826 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:33.648826 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:33.648826 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:33.648826 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:33.648826 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:33.648826 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:33.648826 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:33.648826 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:33.648826 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:33.648826 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:33.648826 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:33.648826 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:33.648826 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:33.648826 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:33.648826 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:33.648826 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:33.649632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:33.649632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:33.649632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:33.649632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:33.649632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:33.649632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:33.649632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:33.649632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:33.649632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:33.649632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:33.649632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:05:33.649632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:33.653539 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 196/385] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:05:33.659298 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30d130-4b97-4018-ad33-602fdd080cb2 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:33.718047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857382f-a804-4465-86b7-c751a1b12830 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:33.778231 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:33.783878 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30d130-4b97-4018-ad33-602fdd080cb2 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:33.794768 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:33.821481 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678674d-f8f2-4e4f-8dbe-47eb57625744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:33.822226 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678674d-f8f2-4e4f-8dbe-47eb57625744 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:33.822498 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678674d-f8f2-4e4f-8dbe-47eb57625744 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:33.828636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678674d-f8f2-4e4f-8dbe-47eb57625744 None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:33.828636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678674d-f8f2-4e4f-8dbe-47eb57625744 None admin] RBAC: Adding query filter params (name=member) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:33.828636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678674d-f8f2-4e4f-8dbe-47eb57625744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:33.828636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678674d-f8f2-4e4f-8dbe-47eb57625744 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:33.835155 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 190/386] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jul 11 11:05:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:33.840189 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678674d-f8f2-4e4f-8dbe-47eb57625744 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:33.947730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857382f-a804-4465-86b7-c751a1b12830 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:33.955203 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678674d-f8f2-4e4f-8dbe-47eb57625744 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:33.995787 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6270ea-ddf6-41fa-9be2-3983f1346f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:33.996791 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6270ea-ddf6-41fa-9be2-3983f1346f84 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:33.997174 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6270ea-ddf6-41fa-9be2-3983f1346f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:33.997550 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6270ea-ddf6-41fa-9be2-3983f1346f84 None admin] PATH_INFO: `/v3/groups/cc9a7af5740c4c66987618df2aa7249d` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:33.998938 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6270ea-ddf6-41fa-9be2-3983f1346f84 None admin] RBAC: Authorizing `identity:get_group(group_id=cc9a7af5740c4c66987618df2aa7249d)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:34.000486 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6270ea-ddf6-41fa-9be2-3983f1346f84 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:34.002828 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 191/387] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Jul 11 11:05:33 2022] GET /identity/v3/groups/cc9a7af5740c4c66987618df2aa7249d => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:34.007127 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eae698-d4b8-4786-be3e-d292e3f1863b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:34.007966 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eae698-d4b8-4786-be3e-d292e3f1863b None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:34.008097 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6270ea-ddf6-41fa-9be2-3983f1346f84 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:34.008271 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eae698-d4b8-4786-be3e-d292e3f1863b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:34.008513 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eae698-d4b8-4786-be3e-d292e3f1863b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:34.040997 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eae698-d4b8-4786-be3e-d292e3f1863b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:34.049179 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-e6eae698-d4b8-4786-be3e-d292e3f1863b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:05:34.049179 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:34.049179 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:34.049179 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:34.049179 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:34.049179 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:34.049179 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:34.049179 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:34.049179 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:34.049179 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:34.049179 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:34.049179 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:34.049179 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:34.049179 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:34.049179 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:34.049179 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:34.050079 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:34.050079 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:34.050079 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:34.050079 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:34.050079 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:34.050079 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:34.050079 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:34.050079 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:34.050079 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:34.050079 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:34.050079 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:34.050079 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:34.050079 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:34.050079 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:34.050079 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:34.050079 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:34.050888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:34.050888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:34.050888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:34.050888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:34.050888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:34.050888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:34.050888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:34.050888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:34.050888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:34.050888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:34.050888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:05:34.050888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:34.054848 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 197/388] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jul 11 11:05:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:34.061742 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eae698-d4b8-4786-be3e-d292e3f1863b None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:34.063908 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:34.141420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6270ea-ddf6-41fa-9be2-3983f1346f84 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:34.201346 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94ad71-ea8f-4c0d-a86e-3a01686b0cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:34.202593 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94ad71-ea8f-4c0d-a86e-3a01686b0cbb None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:34.204433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94ad71-ea8f-4c0d-a86e-3a01686b0cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:34.204939 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94ad71-ea8f-4c0d-a86e-3a01686b0cbb None admin] PATH_INFO: `/v3/projects/0ad20973f17243d0959845935c042b0f` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:34.207252 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94ad71-ea8f-4c0d-a86e-3a01686b0cbb None admin] RBAC: Authorizing `identity:get_project(project_id=0ad20973f17243d0959845935c042b0f)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:34.214473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94ad71-ea8f-4c0d-a86e-3a01686b0cbb None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:34.216517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 192/389] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:34 2022] GET /identity/v3/projects/0ad20973f17243d0959845935c042b0f => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:34.222297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94ad71-ea8f-4c0d-a86e-3a01686b0cbb None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:34.243159 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:34.267227 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eae698-d4b8-4786-be3e-d292e3f1863b None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:34.335857 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90a040-b06b-4e89-bc23-1e8cf925d38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:34.337879 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90a040-b06b-4e89-bc23-1e8cf925d38b None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:34.338555 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90a040-b06b-4e89-bc23-1e8cf925d38b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:34.339813 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90a040-b06b-4e89-bc23-1e8cf925d38b None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:34.341407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90a040-b06b-4e89-bc23-1e8cf925d38b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:34.342104 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90a040-b06b-4e89-bc23-1e8cf925d38b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:34.344621 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90a040-b06b-4e89-bc23-1e8cf925d38b None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:34.359320 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 198/390] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:05:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:34.366567 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90a040-b06b-4e89-bc23-1e8cf925d38b None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:34.424478 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:34.430265 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94ad71-ea8f-4c0d-a86e-3a01686b0cbb None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:34.499748 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc80c7-e259-4f62-a2e8-0da7ef8ecb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:34.501040 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc80c7-e259-4f62-a2e8-0da7ef8ecb9e None admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:34.501526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc80c7-e259-4f62-a2e8-0da7ef8ecb9e None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:34.504110 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc80c7-e259-4f62-a2e8-0da7ef8ecb9e None admin] PATH_INFO: `/v3/projects/0ad20973f17243d0959845935c042b0f/groups/cc9a7af5740c4c66987618df2aa7249d/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:34.509205 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc80c7-e259-4f62-a2e8-0da7ef8ecb9e None admin] RBAC: Authorizing `identity:create_grant(project_id=0ad20973f17243d0959845935c042b0f, group_id=cc9a7af5740c4c66987618df2aa7249d, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:34.510926 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc80c7-e259-4f62-a2e8-0da7ef8ecb9e None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:34.549543 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90a040-b06b-4e89-bc23-1e8cf925d38b None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:34.586025 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f98b73-8adb-46aa-b9e1-15fef788299f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:34.587306 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f98b73-8adb-46aa-b9e1-15fef788299f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:34.587793 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f98b73-8adb-46aa-b9e1-15fef788299f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:34.588269 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f98b73-8adb-46aa-b9e1-15fef788299f None admin] PATH_INFO: `/v3/groups/cc9a7af5740c4c66987618df2aa7249d` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:34.589668 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f98b73-8adb-46aa-b9e1-15fef788299f None admin] RBAC: Authorizing `identity:get_group(group_id=cc9a7af5740c4c66987618df2aa7249d)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:34.591346 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f98b73-8adb-46aa-b9e1-15fef788299f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:34.593626 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 199/391] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Jul 11 11:05:34 2022] GET /identity/v3/groups/cc9a7af5740c4c66987618df2aa7249d => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:34.601802 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f98b73-8adb-46aa-b9e1-15fef788299f None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:34.607600 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 193/392] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Jul 11 11:05:34 2022] PUT /identity/v3/projects/0ad20973f17243d0959845935c042b0f/groups/cc9a7af5740c4c66987618df2aa7249d/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:05:34.629910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:34.722636 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f98b73-8adb-46aa-b9e1-15fef788299f None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:34.768251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8740eac-0ea4-436e-af52-577a6aec7fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:34.769241 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8740eac-0ea4-436e-af52-577a6aec7fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:34.769534 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8740eac-0ea4-436e-af52-577a6aec7fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:34.769842 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8740eac-0ea4-436e-af52-577a6aec7fc2 None admin] PATH_INFO: `/v3/projects/0ad20973f17243d0959845935c042b0f` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:34.771295 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8740eac-0ea4-436e-af52-577a6aec7fc2 None admin] RBAC: Authorizing `identity:get_project(project_id=0ad20973f17243d0959845935c042b0f)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:34.772757 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8740eac-0ea4-436e-af52-577a6aec7fc2 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:34.774867 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 200/393] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:34 2022] GET /identity/v3/projects/0ad20973f17243d0959845935c042b0f => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:34.781322 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc80c7-e259-4f62-a2e8-0da7ef8ecb9e None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:34.916600 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc80c7-e259-4f62-a2e8-0da7ef8ecb9e None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:34.960208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58f8d8-e69f-46d9-9359-9e0c6cc932b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:34.961178 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58f8d8-e69f-46d9-9359-9e0c6cc932b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:34.961468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58f8d8-e69f-46d9-9359-9e0c6cc932b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:34.961747 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58f8d8-e69f-46d9-9359-9e0c6cc932b1 None admin] PATH_INFO: `/v3/projects/0ad20973f17243d0959845935c042b0f/groups/cc9a7af5740c4c66987618df2aa7249d/roles/da398232f5f14edc908b967ea8653212` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:34.964505 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58f8d8-e69f-46d9-9359-9e0c6cc932b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ad20973f17243d0959845935c042b0f, group_id=cc9a7af5740c4c66987618df2aa7249d, role_id=da398232f5f14edc908b967ea8653212)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:34.966070 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58f8d8-e69f-46d9-9359-9e0c6cc932b1 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:35.044629 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 194/394] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Jul 11 11:05:34 2022] PUT /identity/v3/projects/0ad20973f17243d0959845935c042b0f/groups/cc9a7af5740c4c66987618df2aa7249d/roles/da398232f5f14edc908b967ea8653212 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:05:35.196247 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16484c1c-f05d-435b-b5f8-4ed35552e7f5 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:35.196758 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16484c1c-f05d-435b-b5f8-4ed35552e7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:35.196758 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16484c1c-f05d-435b-b5f8-4ed35552e7f5 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:35.198539 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 201/395] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:35.204167 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13347a92-258b-4494-8223-25591331b5ba None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:35.204459 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13347a92-258b-4494-8223-25591331b5ba None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:35.204746 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13347a92-258b-4494-8223-25591331b5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:35.226980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-13347a92-258b-4494-8223-25591331b5ba None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:35.228213 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-13347a92-258b-4494-8223-25591331b5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:35.249468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:35.321922 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 195/396] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:35.345828 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16484c1c-f05d-435b-b5f8-4ed35552e7f5 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:35.459288 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:35.478432 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16484c1c-f05d-435b-b5f8-4ed35552e7f5 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:35.523409 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e3571-2045-4a17-8178-955f0275acd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:35.524412 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e3571-2045-4a17-8178-955f0275acd0 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:35.524709 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e3571-2045-4a17-8178-955f0275acd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:35.524991 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e3571-2045-4a17-8178-955f0275acd0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:35.542587 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e3571-2045-4a17-8178-955f0275acd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:35.550565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-4b2e3571-2045-4a17-8178-955f0275acd0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:05:35.550565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:35.550565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:35.550565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:35.550565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:35.550565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:35.550565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:35.550565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:35.550565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:35.550565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:35.550565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:35.550565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:35.550565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:35.550565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:35.550565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:35.550565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:35.551954 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:35.551954 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:35.551954 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:35.551954 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:35.551954 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:35.551954 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:35.551954 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:35.551954 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:35.551954 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:35.551954 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:35.551954 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:35.551954 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:35.551954 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:35.551954 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:35.551954 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:35.551954 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:35.552781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:35.552781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:35.552781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:35.552781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:35.552781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:35.552781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:35.552781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:35.552781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:35.552781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:35.552781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:35.552781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:05:35.552781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:35.554884 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 202/397] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:35.560247 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13347a92-258b-4494-8223-25591331b5ba None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:35.714083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13347a92-258b-4494-8223-25591331b5ba None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:35.766918 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed364b-a69e-4e5e-888e-e8ccdb6816fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:35.767649 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed364b-a69e-4e5e-888e-e8ccdb6816fe None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:35.767980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed364b-a69e-4e5e-888e-e8ccdb6816fe None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:35.768261 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed364b-a69e-4e5e-888e-e8ccdb6816fe None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:35.769028 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed364b-a69e-4e5e-888e-e8ccdb6816fe None admin] RBAC: Adding query filter params (name=member) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:35.769337 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed364b-a69e-4e5e-888e-e8ccdb6816fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:35.770817 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed364b-a69e-4e5e-888e-e8ccdb6816fe None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:35.784332 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 196/398] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jul 11 11:05:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:35.791002 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e3571-2045-4a17-8178-955f0275acd0 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:35.817972 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db1f6c-9265-4777-b594-21c7c926dab7 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:35.818341 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db1f6c-9265-4777-b594-21c7c926dab7 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:35.818623 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db1f6c-9265-4777-b594-21c7c926dab7 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:35.820326 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 197/399] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:35.826338 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e079f30-f37f-4c8b-ab25-342f3d164758 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:35.826645 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e079f30-f37f-4c8b-ab25-342f3d164758 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:35.826881 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e079f30-f37f-4c8b-ab25-342f3d164758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:35.855789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-2e079f30-f37f-4c8b-ab25-342f3d164758 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:35.857002 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-2e079f30-f37f-4c8b-ab25-342f3d164758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:35.865297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:35.912972 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e3571-2045-4a17-8178-955f0275acd0 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:35.945026 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 198/400] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:05:35.953150 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87fb3e-9a64-4fa4-81a2-f322a93fa154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:35.954337 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87fb3e-9a64-4fa4-81a2-f322a93fa154 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:35.954629 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87fb3e-9a64-4fa4-81a2-f322a93fa154 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:35.954907 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87fb3e-9a64-4fa4-81a2-f322a93fa154 None admin] PATH_INFO: `/v3/groups/cc9a7af5740c4c66987618df2aa7249d` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:35.956099 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f87fb3e-9a64-4fa4-81a2-f322a93fa154 None admin] RBAC: Authorizing `identity:get_group(group_id=cc9a7af5740c4c66987618df2aa7249d)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:35.957827 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f87fb3e-9a64-4fa4-81a2-f322a93fa154 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:35.959715 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 203/401] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Jul 11 11:05:35 2022] GET /identity/v3/groups/cc9a7af5740c4c66987618df2aa7249d => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:35.965240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e079f30-f37f-4c8b-ab25-342f3d164758 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:35.969703 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87fb3e-9a64-4fa4-81a2-f322a93fa154 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:35.988919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:36.087075 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e079f30-f37f-4c8b-ab25-342f3d164758 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:36.101712 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87fb3e-9a64-4fa4-81a2-f322a93fa154 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:36.134177 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd623a-48f0-4f58-a96e-2220122491cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:36.135684 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd623a-48f0-4f58-a96e-2220122491cb None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:36.135969 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd623a-48f0-4f58-a96e-2220122491cb None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:36.136320 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd623a-48f0-4f58-a96e-2220122491cb None admin] PATH_INFO: `/v3/projects/fb8c135f505f41c49fcaeb13354bca87` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:36.137432 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd623a-48f0-4f58-a96e-2220122491cb None admin] RBAC: Authorizing `identity:get_project(project_id=fb8c135f505f41c49fcaeb13354bca87)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:36.138909 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd623a-48f0-4f58-a96e-2220122491cb None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:36.139188 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a142a-7aba-4c2d-9737-000df94e8cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:36.140001 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a142a-7aba-4c2d-9737-000df94e8cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:36.140280 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a142a-7aba-4c2d-9737-000df94e8cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:36.140555 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a142a-7aba-4c2d-9737-000df94e8cd2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:36.140917 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 199/402] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:35 2022] GET /identity/v3/projects/fb8c135f505f41c49fcaeb13354bca87 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:36.142145 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba877ee-de4f-488e-9ee9-10284160bef9 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:36.142726 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba877ee-de4f-488e-9ee9-10284160bef9 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:36.143006 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba877ee-de4f-488e-9ee9-10284160bef9 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:36.145404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 200/403] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:36.151563 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e27048-50bf-4500-89d2-04c2b2a248fe None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:36.151908 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e27048-50bf-4500-89d2-04c2b2a248fe None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:36.152179 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e27048-50bf-4500-89d2-04c2b2a248fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:36.157416 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a142a-7aba-4c2d-9737-000df94e8cd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:36.167399 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-634a142a-7aba-4c2d-9737-000df94e8cd2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:05:36.167399 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:36.167399 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:36.167399 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:36.167399 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:36.167399 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:36.167399 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:36.167399 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:36.167399 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:36.167399 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:36.167399 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:36.167399 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:36.167399 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:36.167399 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:36.167399 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:36.167399 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:36.169494 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:36.169494 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:36.169494 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:36.169494 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:36.169494 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:36.169494 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:36.169494 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:36.169494 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:36.169494 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:36.169494 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:36.169494 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:36.169494 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:36.169494 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:36.169494 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:36.169494 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:36.169494 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:36.171525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:36.171525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:36.171525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:36.171525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:36.171525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:36.171525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:36.171525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:36.171525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:36.171525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:36.171525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:36.171525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:05:36.171525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:36.171525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 204/404] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jul 11 11:05:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:36.171525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a142a-7aba-4c2d-9737-000df94e8cd2 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:36.173213 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-86e27048-50bf-4500-89d2-04c2b2a248fe None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:36.173213 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-86e27048-50bf-4500-89d2-04c2b2a248fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:36.177798 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:36.262496 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 201/405] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:36.263289 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e27048-50bf-4500-89d2-04c2b2a248fe None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:36.272490 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:36.320713 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a142a-7aba-4c2d-9737-000df94e8cd2 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:36.375376 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41009ce7-0c9b-4b13-a0f8-eec196dff2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:36.376906 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41009ce7-0c9b-4b13-a0f8-eec196dff2e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:36.377193 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41009ce7-0c9b-4b13-a0f8-eec196dff2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:36.377471 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41009ce7-0c9b-4b13-a0f8-eec196dff2e0 None admin] PATH_INFO: `/v3/projects/fb8c135f505f41c49fcaeb13354bca87/groups/cc9a7af5740c4c66987618df2aa7249d/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:36.380269 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41009ce7-0c9b-4b13-a0f8-eec196dff2e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb8c135f505f41c49fcaeb13354bca87, group_id=cc9a7af5740c4c66987618df2aa7249d, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:36.382258 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41009ce7-0c9b-4b13-a0f8-eec196dff2e0 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:36.406818 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e27048-50bf-4500-89d2-04c2b2a248fe None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:36.450582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f8286-b07c-4af8-a26c-0855f15457cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:36.451258 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f8286-b07c-4af8-a26c-0855f15457cf None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:36.451543 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f8286-b07c-4af8-a26c-0855f15457cf None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:36.451819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f8286-b07c-4af8-a26c-0855f15457cf None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:36.452570 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f8286-b07c-4af8-a26c-0855f15457cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:36.452878 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f8286-b07c-4af8-a26c-0855f15457cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:36.454345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f8286-b07c-4af8-a26c-0855f15457cf None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:36.464765 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 202/406] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:05:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:36.465211 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 205/407] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Jul 11 11:05:36 2022] PUT /identity/v3/projects/fb8c135f505f41c49fcaeb13354bca87/groups/cc9a7af5740c4c66987618df2aa7249d/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:05:36.466419 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f8286-b07c-4af8-a26c-0855f15457cf None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:36.470448 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:36.472112 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41009ce7-0c9b-4b13-a0f8-eec196dff2e0 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:36.592324 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41009ce7-0c9b-4b13-a0f8-eec196dff2e0 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:36.593542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f8286-b07c-4af8-a26c-0855f15457cf None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:36.630600 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea434f9-21e8-4b49-9324-36c16b5eb901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:36.632207 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea434f9-21e8-4b49-9324-36c16b5eb901 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:36.632732 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea434f9-21e8-4b49-9324-36c16b5eb901 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:36.633202 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea434f9-21e8-4b49-9324-36c16b5eb901 None admin] PATH_INFO: `/v3/groups/cc9a7af5740c4c66987618df2aa7249d` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:36.634750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea434f9-21e8-4b49-9324-36c16b5eb901 None admin] RBAC: Authorizing `identity:get_group(group_id=cc9a7af5740c4c66987618df2aa7249d)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:36.636005 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15579fc0-5a80-4988-95ef-caf5df5cfcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:36.636701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea434f9-21e8-4b49-9324-36c16b5eb901 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:36.636874 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15579fc0-5a80-4988-95ef-caf5df5cfcf4 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:36.637152 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15579fc0-5a80-4988-95ef-caf5df5cfcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:36.637429 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15579fc0-5a80-4988-95ef-caf5df5cfcf4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:36.639459 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 206/408] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Jul 11 11:05:36 2022] GET /identity/v3/groups/cc9a7af5740c4c66987618df2aa7249d => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:36.649939 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea434f9-21e8-4b49-9324-36c16b5eb901 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:36.654127 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:36.659120 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15579fc0-5a80-4988-95ef-caf5df5cfcf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:36.668320 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-15579fc0-5a80-4988-95ef-caf5df5cfcf4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:05:36.668320 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:36.668320 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:36.668320 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:36.668320 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:36.668320 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:36.668320 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:36.668320 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:36.668320 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:36.668320 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:36.668320 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:36.668320 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:36.668320 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:36.668320 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:36.668320 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:36.668320 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:36.669375 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:36.669375 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:36.669375 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:36.669375 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:36.669375 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:36.669375 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:36.669375 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:36.669375 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:36.669375 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:36.669375 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:36.669375 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:36.669375 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:36.669375 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:36.669375 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:36.669375 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:36.669375 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:36.670192 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:36.670192 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:36.670192 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:36.670192 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:36.670192 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:36.670192 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:36.670192 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:36.670192 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:36.670192 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:36.670192 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:36.670192 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:05:36.670192 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:36.672708 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 203/409] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:05:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:36.679063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15579fc0-5a80-4988-95ef-caf5df5cfcf4 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:36.772755 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:36.795692 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea434f9-21e8-4b49-9324-36c16b5eb901 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:36.826121 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15579fc0-5a80-4988-95ef-caf5df5cfcf4 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:36.853450 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5d43e-8205-45b6-b64c-e6d31d6591d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:36.854294 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5d43e-8205-45b6-b64c-e6d31d6591d2 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:36.854586 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5d43e-8205-45b6-b64c-e6d31d6591d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:36.854861 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5d43e-8205-45b6-b64c-e6d31d6591d2 None admin] PATH_INFO: `/v3/projects/fb8c135f505f41c49fcaeb13354bca87` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:36.857130 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5d43e-8205-45b6-b64c-e6d31d6591d2 None admin] RBAC: Authorizing `identity:get_project(project_id=fb8c135f505f41c49fcaeb13354bca87)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:36.859788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5d43e-8205-45b6-b64c-e6d31d6591d2 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:36.865023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 207/410] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:36 2022] GET /identity/v3/projects/fb8c135f505f41c49fcaeb13354bca87 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:36.872911 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5d43e-8205-45b6-b64c-e6d31d6591d2 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:36.876223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdbfb1-7330-486a-8784-cb5e68f9d5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:36.878177 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdbfb1-7330-486a-8784-cb5e68f9d5ff None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:36.878694 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdbfb1-7330-486a-8784-cb5e68f9d5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:36.879217 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdbfb1-7330-486a-8784-cb5e68f9d5ff None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:36.880751 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fdbfb1-7330-486a-8784-cb5e68f9d5ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:36.881268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fdbfb1-7330-486a-8784-cb5e68f9d5ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:36.882880 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fdbfb1-7330-486a-8784-cb5e68f9d5ff None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:36.896267 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 204/411] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:36.902198 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdbfb1-7330-486a-8784-cb5e68f9d5ff None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:36.982244 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:37.017918 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5d43e-8205-45b6-b64c-e6d31d6591d2 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:37.036190 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdbfb1-7330-486a-8784-cb5e68f9d5ff None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:37.062495 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:37.064081 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa04a3-973f-427d-8a68-2c3dcfc1305f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:37.065249 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa04a3-973f-427d-8a68-2c3dcfc1305f None admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:37.065730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa04a3-973f-427d-8a68-2c3dcfc1305f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:37.066257 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa04a3-973f-427d-8a68-2c3dcfc1305f None admin] PATH_INFO: `/v3/projects/fb8c135f505f41c49fcaeb13354bca87/groups/cc9a7af5740c4c66987618df2aa7249d/roles/da398232f5f14edc908b967ea8653212` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:37.072387 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa04a3-973f-427d-8a68-2c3dcfc1305f None admin] RBAC: Authorizing `identity:create_grant(project_id=fb8c135f505f41c49fcaeb13354bca87, group_id=cc9a7af5740c4c66987618df2aa7249d, role_id=da398232f5f14edc908b967ea8653212)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:37.081901 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa04a3-973f-427d-8a68-2c3dcfc1305f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:37.082029 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acaf0f9-aaa8-4438-8f81-d5600e1a50fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:37.082029 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acaf0f9-aaa8-4438-8f81-d5600e1a50fd None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:37.082029 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acaf0f9-aaa8-4438-8f81-d5600e1a50fd None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:37.082029 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acaf0f9-aaa8-4438-8f81-d5600e1a50fd None admin] PATH_INFO: `/v3/groups/e9a2a2d2cf474477805a40cfd32e7636` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:37.082847 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acaf0f9-aaa8-4438-8f81-d5600e1a50fd None admin] RBAC: Authorizing `identity:get_group(group_id=e9a2a2d2cf474477805a40cfd32e7636)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:37.082847 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acaf0f9-aaa8-4438-8f81-d5600e1a50fd None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:37.082847 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 205/412] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Jul 11 11:05:36 2022] GET /identity/v3/groups/e9a2a2d2cf474477805a40cfd32e7636 => generated 229 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:37.086932 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acaf0f9-aaa8-4438-8f81-d5600e1a50fd None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:37.171747 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 208/413] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Jul 11 11:05:36 2022] PUT /identity/v3/projects/fb8c135f505f41c49fcaeb13354bca87/groups/cc9a7af5740c4c66987618df2aa7249d/roles/da398232f5f14edc908b967ea8653212 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:05:37.197564 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acaf0f9-aaa8-4438-8f81-d5600e1a50fd None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:37.236746 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757862e3-b47b-4bf9-9efd-256af82cd3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:37.237629 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757862e3-b47b-4bf9-9efd-256af82cd3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:37.237946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757862e3-b47b-4bf9-9efd-256af82cd3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:37.238222 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757862e3-b47b-4bf9-9efd-256af82cd3d8 None admin] PATH_INFO: `/v3/projects/88f214658e46461082860991a2c6d4f3` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:37.239747 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757862e3-b47b-4bf9-9efd-256af82cd3d8 None admin] RBAC: Authorizing `identity:get_project(project_id=88f214658e46461082860991a2c6d4f3)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:37.241280 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757862e3-b47b-4bf9-9efd-256af82cd3d8 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:37.243489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 206/414] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:37 2022] GET /identity/v3/projects/88f214658e46461082860991a2c6d4f3 => generated 344 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:37.249331 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa04a3-973f-427d-8a68-2c3dcfc1305f None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:37.373241 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa04a3-973f-427d-8a68-2c3dcfc1305f None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:37.409149 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:37.417728 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8bd2e-fd0b-470e-b916-4d23f92e2a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:37.418950 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8bd2e-fd0b-470e-b916-4d23f92e2a17 None admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:37.419391 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8bd2e-fd0b-470e-b916-4d23f92e2a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:37.419823 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8bd2e-fd0b-470e-b916-4d23f92e2a17 None admin] PATH_INFO: `/v3/projects/88f214658e46461082860991a2c6d4f3/groups/e9a2a2d2cf474477805a40cfd32e7636/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:37.423611 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8bd2e-fd0b-470e-b916-4d23f92e2a17 None admin] RBAC: Authorizing `identity:create_grant(project_id=88f214658e46461082860991a2c6d4f3, group_id=e9a2a2d2cf474477805a40cfd32e7636, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:37.425275 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8bd2e-fd0b-470e-b916-4d23f92e2a17 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:37.511452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 209/415] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Jul 11 11:05:37 2022] PUT /identity/v3/projects/88f214658e46461082860991a2c6d4f3/groups/e9a2a2d2cf474477805a40cfd32e7636/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:05:37.570978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d1584-d260-4c19-a5b6-79c0571a125d None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:37.571367 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d1584-d260-4c19-a5b6-79c0571a125d None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:37.571586 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d1584-d260-4c19-a5b6-79c0571a125d None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:37.573310 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 207/416] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:37.578589 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32389a-ee79-41f1-8bc6-4ecdc319fdbf None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:37.579115 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32389a-ee79-41f1-8bc6-4ecdc319fdbf None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:37.579588 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32389a-ee79-41f1-8bc6-4ecdc319fdbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:37.605995 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-2d32389a-ee79-41f1-8bc6-4ecdc319fdbf None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:37.607622 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2d32389a-ee79-41f1-8bc6-4ecdc319fdbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:37.702875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 210/417] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:37.727804 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d1584-d260-4c19-a5b6-79c0571a125d None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:37.802701 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:37.858106 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d1584-d260-4c19-a5b6-79c0571a125d None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:37.903744 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e418f-b979-4068-bcf6-e4b9b3eb27b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:37.904548 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e418f-b979-4068-bcf6-e4b9b3eb27b7 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:37.904836 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e418f-b979-4068-bcf6-e4b9b3eb27b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:37.905118 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e418f-b979-4068-bcf6-e4b9b3eb27b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:37.916838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e418f-b979-4068-bcf6-e4b9b3eb27b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:37.924810 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-e64e418f-b979-4068-bcf6-e4b9b3eb27b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:05:37.924810 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:37.924810 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:37.924810 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:37.924810 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:37.924810 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:37.924810 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:37.924810 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:37.924810 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:37.924810 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:37.924810 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:37.924810 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:37.924810 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:37.924810 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:37.924810 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:37.924810 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:37.925677 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:37.925677 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:37.925677 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:37.925677 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:37.925677 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:37.925677 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:37.925677 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:37.925677 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:37.925677 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:37.925677 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:37.925677 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:37.925677 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:37.925677 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:37.925677 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:37.925677 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:37.925677 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:37.926633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:37.926633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:37.926633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:37.926633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:37.926633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:37.926633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:37.926633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:37.926633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:37.926633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:37.926633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:37.926633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:05:37.926633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:37.926633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 208/418] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:37.933031 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32389a-ee79-41f1-8bc6-4ecdc319fdbf None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:37.965222 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0905a-7487-4cdf-ae37-b456518f2d1f None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:37.965710 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0905a-7487-4cdf-ae37-b456518f2d1f None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:37.965710 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0905a-7487-4cdf-ae37-b456518f2d1f None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:37.967417 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 209/419] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:05:37.978408 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec78edc-3b44-4fe4-9475-a8441e347f1f None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:37.978704 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec78edc-3b44-4fe4-9475-a8441e347f1f None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:37.978980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec78edc-3b44-4fe4-9475-a8441e347f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:38.014105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-2ec78edc-3b44-4fe4-9475-a8441e347f1f None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:38.015322 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-2ec78edc-3b44-4fe4-9475-a8441e347f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:38.108349 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32389a-ee79-41f1-8bc6-4ecdc319fdbf None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:38.138210 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:38.139039 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 210/420] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:05:38.158898 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec78edc-3b44-4fe4-9475-a8441e347f1f None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:38.175388 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af2d51-580b-4bf4-81e2-c895461933c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:38.176113 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af2d51-580b-4bf4-81e2-c895461933c5 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:38.176967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af2d51-580b-4bf4-81e2-c895461933c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:38.177261 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af2d51-580b-4bf4-81e2-c895461933c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:38.180669 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af2d51-580b-4bf4-81e2-c895461933c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:38.181000 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af2d51-580b-4bf4-81e2-c895461933c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:38.184228 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af2d51-580b-4bf4-81e2-c895461933c5 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:38.200879 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 211/421] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jul 11 11:05:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:38.202482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af2d51-580b-4bf4-81e2-c895461933c5 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:38.261704 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:38.351381 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec78edc-3b44-4fe4-9475-a8441e347f1f None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:38.399868 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af2d51-580b-4bf4-81e2-c895461933c5 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:38.429951 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce25ce-b797-4814-81b7-3f26a2342d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:38.430791 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce25ce-b797-4814-81b7-3f26a2342d8e None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:38.431053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce25ce-b797-4814-81b7-3f26a2342d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:38.431328 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce25ce-b797-4814-81b7-3f26a2342d8e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:38.454148 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce25ce-b797-4814-81b7-3f26a2342d8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:38.466847 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facfb8d-3e6b-48d3-8584-2d2d8c44090a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:38.469222 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facfb8d-3e6b-48d3-8584-2d2d8c44090a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:38.469222 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facfb8d-3e6b-48d3-8584-2d2d8c44090a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:38.469222 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facfb8d-3e6b-48d3-8584-2d2d8c44090a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:38.472433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-40ce25ce-b797-4814-81b7-3f26a2342d8e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:05:38.472433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:38.472433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:38.472433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:38.472433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:38.472433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:38.472433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:38.472433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:38.472433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:38.472433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:38.472433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:38.472433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:38.472433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:38.472433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:38.472433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:38.472433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:38.474489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:38.474489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:38.474489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:38.474489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:38.474489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:38.474489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:38.474489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:38.474489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:38.474489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:38.474489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:38.474489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:38.474489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:38.474489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:38.474489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:38.474489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:38.474489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:38.475287 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:38.475287 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:38.475287 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:38.475287 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:38.475287 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:38.475287 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:38.475287 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:38.475287 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:38.475287 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:38.475287 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:38.475287 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:05:38.475287 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:38.475287 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 211/422] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jul 11 11:05:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:38.483979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce25ce-b797-4814-81b7-3f26a2342d8e None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:38.575752 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:38.607368 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3facfb8d-3e6b-48d3-8584-2d2d8c44090a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:38.608845 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3facfb8d-3e6b-48d3-8584-2d2d8c44090a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:38.690545 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce25ce-b797-4814-81b7-3f26a2342d8e None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:38.708423 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:38.767123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403365d-1e2f-4bd0-ac17-79a9f6525ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:38.768185 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403365d-1e2f-4bd0-ac17-79a9f6525ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:38.768689 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403365d-1e2f-4bd0-ac17-79a9f6525ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:38.769198 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403365d-1e2f-4bd0-ac17-79a9f6525ec8 None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:38.770943 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403365d-1e2f-4bd0-ac17-79a9f6525ec8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:38.771869 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403365d-1e2f-4bd0-ac17-79a9f6525ec8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:38.773643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403365d-1e2f-4bd0-ac17-79a9f6525ec8 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:38.784841 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 212/423] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:05:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 11:05:38.791747 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facfb8d-3e6b-48d3-8584-2d2d8c44090a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:38.792047 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 212/424] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:05:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:38.803083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403365d-1e2f-4bd0-ac17-79a9f6525ec8 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:38.897438 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:38.912542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facfb8d-3e6b-48d3-8584-2d2d8c44090a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:38.949061 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7e4b4-c769-4d6e-9c6f-18e1b7764c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:38.950111 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7e4b4-c769-4d6e-9c6f-18e1b7764c60 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:38.950398 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7e4b4-c769-4d6e-9c6f-18e1b7764c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:38.950792 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7e4b4-c769-4d6e-9c6f-18e1b7764c60 None admin] PATH_INFO: `/v3/projects/0ad20973f17243d0959845935c042b0f` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:38.952030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7e4b4-c769-4d6e-9c6f-18e1b7764c60 None admin] RBAC: Authorizing `identity:get_project(project_id=0ad20973f17243d0959845935c042b0f)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:38.953462 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7e4b4-c769-4d6e-9c6f-18e1b7764c60 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:38.955541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 213/425] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:38 2022] GET /identity/v3/projects/0ad20973f17243d0959845935c042b0f => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:38.962793 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7e4b4-c769-4d6e-9c6f-18e1b7764c60 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:38.991605 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403365d-1e2f-4bd0-ac17-79a9f6525ec8 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:39.059225 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e44fc-67ee-4a01-90da-89a781913516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:39.059884 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e44fc-67ee-4a01-90da-89a781913516 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:39.060171 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e44fc-67ee-4a01-90da-89a781913516 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:39.060452 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e44fc-67ee-4a01-90da-89a781913516 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:39.124184 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7e4b4-c769-4d6e-9c6f-18e1b7764c60 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:39.142040 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:39.190103 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e44fc-67ee-4a01-90da-89a781913516 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:39.191534 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e44fc-67ee-4a01-90da-89a781913516 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:39.198730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f28d88-9597-4d7e-b21d-06013ce96f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:39.199590 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f28d88-9597-4d7e-b21d-06013ce96f2d None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:39.199873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f28d88-9597-4d7e-b21d-06013ce96f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:39.200150 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f28d88-9597-4d7e-b21d-06013ce96f2d None admin] PATH_INFO: `/v3/groups/cc9a7af5740c4c66987618df2aa7249d` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:39.202630 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f28d88-9597-4d7e-b21d-06013ce96f2d None admin] RBAC: Authorizing `identity:get_group(group_id=cc9a7af5740c4c66987618df2aa7249d)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:39.204060 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f28d88-9597-4d7e-b21d-06013ce96f2d None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:39.211815 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 214/426] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Jul 11 11:05:38 2022] GET /identity/v3/groups/cc9a7af5740c4c66987618df2aa7249d => generated 226 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:39.213391 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1d60d-d097-4da2-9cc5-7dd686396ef7 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:39.213924 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1d60d-d097-4da2-9cc5-7dd686396ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:39.214417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1d60d-d097-4da2-9cc5-7dd686396ef7 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:39.215919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 215/427] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:39.220898 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae2d1a-93af-41f8-8134-84af4adce242 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:39.221404 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae2d1a-93af-41f8-8134-84af4adce242 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:39.221914 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae2d1a-93af-41f8-8134-84af4adce242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:39.239890 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-ebae2d1a-93af-41f8-8134-84af4adce242 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:39.241472 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ebae2d1a-93af-41f8-8134-84af4adce242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:39.255477 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:39.320386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 213/428] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:05:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:05:39.321579 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e44fc-67ee-4a01-90da-89a781913516 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:39.340811 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 216/429] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:39.342261 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae2d1a-93af-41f8-8134-84af4adce242 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:39.402233 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:39.434354 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e44fc-67ee-4a01-90da-89a781913516 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:39.472010 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3cdae-8fbb-42e4-abfb-f08caea67c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:39.473132 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3cdae-8fbb-42e4-abfb-f08caea67c1b None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:39.473684 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3cdae-8fbb-42e4-abfb-f08caea67c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:39.474186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3cdae-8fbb-42e4-abfb-f08caea67c1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:39.475242 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3cdae-8fbb-42e4-abfb-f08caea67c1b None admin] RBAC: Adding query filter params (group.id=cc9a7af5740c4c66987618df2aa7249d, role.id=16b11a05b5da4287bdd74d219dde5fb1, scope.project.id=0ad20973f17243d0959845935c042b0f) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:39.475788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3cdae-8fbb-42e4-abfb-f08caea67c1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:39.477450 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3cdae-8fbb-42e4-abfb-f08caea67c1b None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:39.481081 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae2d1a-93af-41f8-8134-84af4adce242 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:39.485073 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 214/430] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Jul 11 11:05:39 2022] GET /identity/v3/role_assignments?group.id=cc9a7af5740c4c66987618df2aa7249d&scope.project.id=0ad20973f17243d0959845935c042b0f&role.id=16b11a05b5da4287bdd74d219dde5fb1 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:39.486233 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3cdae-8fbb-42e4-abfb-f08caea67c1b None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:39.559663 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b11452-04a7-4040-88ac-f9afd5f8a3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:39.560627 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b11452-04a7-4040-88ac-f9afd5f8a3ae None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:39.560915 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b11452-04a7-4040-88ac-f9afd5f8a3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:39.561192 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b11452-04a7-4040-88ac-f9afd5f8a3ae None admin] PATH_INFO: `/v3/projects/0ad20973f17243d0959845935c042b0f` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:39.562705 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b11452-04a7-4040-88ac-f9afd5f8a3ae None admin] RBAC: Authorizing `identity:get_project(project_id=0ad20973f17243d0959845935c042b0f)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:39.565150 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b11452-04a7-4040-88ac-f9afd5f8a3ae None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:39.570956 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 217/431] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:39 2022] GET /identity/v3/projects/0ad20973f17243d0959845935c042b0f => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:39.580105 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b11452-04a7-4040-88ac-f9afd5f8a3ae None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:39.626169 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:39.675618 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3cdae-8fbb-42e4-abfb-f08caea67c1b None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:39.716307 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a92803-57d0-4dd2-b729-d0d9ee9c3110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:39.717451 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a92803-57d0-4dd2-b729-d0d9ee9c3110 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:39.719539 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a92803-57d0-4dd2-b729-d0d9ee9c3110 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:39.720060 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a92803-57d0-4dd2-b729-d0d9ee9c3110 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:39.733110 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a92803-57d0-4dd2-b729-d0d9ee9c3110 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:39.742581 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-06a92803-57d0-4dd2-b729-d0d9ee9c3110 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:05:39.742581 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:39.742581 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:39.742581 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:39.742581 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:39.742581 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:39.742581 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:39.742581 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:39.742581 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:39.742581 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:39.742581 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:39.742581 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:39.742581 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:39.742581 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:39.742581 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:39.742581 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:39.746170 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:39.746170 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:39.746170 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:39.746170 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:39.746170 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:39.746170 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:39.746170 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:39.746170 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:39.746170 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:39.746170 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:39.746170 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:39.746170 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:39.746170 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:39.746170 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:39.746170 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:39.746170 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:39.746990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:39.746990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:39.746990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:39.746990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:39.746990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:39.746990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:39.746990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:39.746990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:39.746990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:39.746990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:39.746990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:05:39.746990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:39.746990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 215/432] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:39.746990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:39.753940 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b11452-04a7-4040-88ac-f9afd5f8a3ae None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:39.755716 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a92803-57d0-4dd2-b729-d0d9ee9c3110 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:39.794958 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20308e41-7e4b-4130-abac-0ecfedbacdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:39.794958 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20308e41-7e4b-4130-abac-0ecfedbacdfa None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:39.795254 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20308e41-7e4b-4130-abac-0ecfedbacdfa None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:39.795483 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20308e41-7e4b-4130-abac-0ecfedbacdfa None admin] PATH_INFO: `/v3/groups/cc9a7af5740c4c66987618df2aa7249d` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:39.796659 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20308e41-7e4b-4130-abac-0ecfedbacdfa None admin] RBAC: Authorizing `identity:get_group(group_id=cc9a7af5740c4c66987618df2aa7249d)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:39.798275 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20308e41-7e4b-4130-abac-0ecfedbacdfa None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:39.800358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 218/433] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Jul 11 11:05:39 2022] GET /identity/v3/groups/cc9a7af5740c4c66987618df2aa7249d => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:39.807963 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20308e41-7e4b-4130-abac-0ecfedbacdfa None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:39.916478 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a92803-57d0-4dd2-b729-d0d9ee9c3110 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:39.950159 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:39.964049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20308e41-7e4b-4130-abac-0ecfedbacdfa None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:39.972860 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538d6cc-f565-440e-b057-e6e124672619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:39.974184 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538d6cc-f565-440e-b057-e6e124672619 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:39.974475 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538d6cc-f565-440e-b057-e6e124672619 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:39.974755 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538d6cc-f565-440e-b057-e6e124672619 None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:39.975519 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538d6cc-f565-440e-b057-e6e124672619 None admin] RBAC: Adding query filter params (name=member) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:39.975830 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538d6cc-f565-440e-b057-e6e124672619 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:39.977238 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538d6cc-f565-440e-b057-e6e124672619 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:39.987189 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 216/434] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jul 11 11:05:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:39.989688 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda0050-098e-4c0d-838b-b0a4884f1db8 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:39.989688 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda0050-098e-4c0d-838b-b0a4884f1db8 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:39.989688 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda0050-098e-4c0d-838b-b0a4884f1db8 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:39.991232 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 217/435] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:39.991602 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2a341-dac4-4d34-a07f-1b502216448c None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:39.991889 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2a341-dac4-4d34-a07f-1b502216448c None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:39.992164 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2a341-dac4-4d34-a07f-1b502216448c None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:39.993380 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 218/436] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:39.994169 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2a341-dac4-4d34-a07f-1b502216448c None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:40.008256 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56813679-e793-4b02-afc5-98b1713044eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:40.008928 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56813679-e793-4b02-afc5-98b1713044eb None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:40.009213 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56813679-e793-4b02-afc5-98b1713044eb None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:40.009498 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56813679-e793-4b02-afc5-98b1713044eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:40.010374 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56813679-e793-4b02-afc5-98b1713044eb None admin] RBAC: Adding query filter params (group.id=cc9a7af5740c4c66987618df2aa7249d, role.id=da398232f5f14edc908b967ea8653212, scope.project.id=0ad20973f17243d0959845935c042b0f) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:40.010850 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56813679-e793-4b02-afc5-98b1713044eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:40.013156 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56813679-e793-4b02-afc5-98b1713044eb None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:40.020871 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 219/437] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Jul 11 11:05:39 2022] GET /identity/v3/role_assignments?group.id=cc9a7af5740c4c66987618df2aa7249d&scope.project.id=0ad20973f17243d0959845935c042b0f&role.id=da398232f5f14edc908b967ea8653212 => generated 611 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:40.021968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de3fa1-8de2-49fd-aafd-2d9e81a626e0 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:40.022263 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de3fa1-8de2-49fd-aafd-2d9e81a626e0 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:40.022545 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de3fa1-8de2-49fd-aafd-2d9e81a626e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:40.042132 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-b5de3fa1-8de2-49fd-aafd-2d9e81a626e0 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:40.043392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b5de3fa1-8de2-49fd-aafd-2d9e81a626e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:40.079675 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:40.128442 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 220/438] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:40.130702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f7b2b-ede3-4161-befd-a791c631e646 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:40.130889 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f7b2b-ede3-4161-befd-a791c631e646 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:40.131153 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f7b2b-ede3-4161-befd-a791c631e646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:40.140785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2a341-dac4-4d34-a07f-1b502216448c None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:40.148283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-e78f7b2b-ede3-4161-befd-a791c631e646 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:40.149508 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e78f7b2b-ede3-4161-befd-a791c631e646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:40.184247 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6ce16-080d-4b77-9227-426582cab25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:40.184997 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6ce16-080d-4b77-9227-426582cab25c None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:40.185290 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6ce16-080d-4b77-9227-426582cab25c None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:40.185569 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6ce16-080d-4b77-9227-426582cab25c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:40.231624 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 221/439] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:40.232923 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f7b2b-ede3-4161-befd-a791c631e646 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:40.243754 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:40.269811 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6ce16-080d-4b77-9227-426582cab25c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:40.271450 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6ce16-080d-4b77-9227-426582cab25c None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:40.344021 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:40.358372 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f7b2b-ede3-4161-befd-a791c631e646 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:40.398454 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 219/440] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:05:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:05:40.399310 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6ce16-080d-4b77-9227-426582cab25c None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:40.400673 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e56378-f3ec-47f1-a4ef-1e86111d82b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:40.401720 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e56378-f3ec-47f1-a4ef-1e86111d82b1 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:40.402148 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e56378-f3ec-47f1-a4ef-1e86111d82b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:40.402507 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e56378-f3ec-47f1-a4ef-1e86111d82b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:40.416488 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e56378-f3ec-47f1-a4ef-1e86111d82b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:40.424308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-b3e56378-f3ec-47f1-a4ef-1e86111d82b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:05:40.424308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:40.424308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:40.424308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:40.424308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:40.424308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:40.424308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:40.424308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:40.424308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:40.424308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:40.424308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:40.424308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:40.424308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:40.424308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:40.424308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:40.424308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:40.425176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:40.425176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:40.425176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:40.425176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:40.425176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:40.425176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:40.425176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:40.425176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:40.425176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:40.425176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:40.425176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:40.425176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:40.425176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:40.425176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:40.425176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:40.425176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:40.426803 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:40.426803 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:40.426803 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:40.426803 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:40.426803 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:40.426803 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:40.426803 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:40.426803 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:40.426803 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:40.426803 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:40.426803 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:05:40.426803 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:40.426803 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 222/441] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:05:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:40.427831 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e56378-f3ec-47f1-a4ef-1e86111d82b1 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:40.493071 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:40.507607 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6ce16-080d-4b77-9227-426582cab25c None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:40.527154 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e56378-f3ec-47f1-a4ef-1e86111d82b1 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:40.539661 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89df583-160a-4d64-96b9-567552e20761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:40.540494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89df583-160a-4d64-96b9-567552e20761 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:40.540782 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89df583-160a-4d64-96b9-567552e20761 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:40.541063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89df583-160a-4d64-96b9-567552e20761 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:40.551000 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89df583-160a-4d64-96b9-567552e20761 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:40.559819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-a89df583-160a-4d64-96b9-567552e20761 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:05:40.559819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:40.559819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:40.559819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:40.559819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:40.559819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:40.559819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:40.559819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:40.559819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:40.559819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:40.559819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:40.559819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:40.559819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:40.559819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:40.559819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:40.559819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:40.560738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:40.560738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:40.560738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:40.560738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:40.560738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:40.560738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:40.560738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:40.560738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:40.560738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:40.560738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:40.560738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:40.560738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:40.560738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:40.560738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:40.560738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:40.560738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:40.561530 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:40.561530 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:40.561530 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:40.561530 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:40.561530 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:40.561530 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:40.561530 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:40.561530 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:40.561530 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:40.561530 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:40.561530 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:05:40.561530 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:40.562628 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa1cba-9969-4d1b-a5ac-50f092a4efaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:40.562628 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa1cba-9969-4d1b-a5ac-50f092a4efaf None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:40.562765 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 220/442] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jul 11 11:05:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:40.562765 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89df583-160a-4d64-96b9-567552e20761 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:40.562916 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa1cba-9969-4d1b-a5ac-50f092a4efaf None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:40.562916 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa1cba-9969-4d1b-a5ac-50f092a4efaf None admin] PATH_INFO: `/v3/projects/fb8c135f505f41c49fcaeb13354bca87` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:40.564260 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa1cba-9969-4d1b-a5ac-50f092a4efaf None admin] RBAC: Authorizing `identity:get_project(project_id=fb8c135f505f41c49fcaeb13354bca87)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:40.567168 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa1cba-9969-4d1b-a5ac-50f092a4efaf None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:40.568904 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 223/443] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:40 2022] GET /identity/v3/projects/fb8c135f505f41c49fcaeb13354bca87 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:40.569662 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa1cba-9969-4d1b-a5ac-50f092a4efaf None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:40.583948 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:40.669554 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89df583-160a-4d64-96b9-567552e20761 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:40.669844 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa1cba-9969-4d1b-a5ac-50f092a4efaf None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:40.701782 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7c89d-7609-4038-aa48-2432c88cbdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:40.702059 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d5a99-58c7-4fa4-8bf8-38235426b00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:40.702460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7c89d-7609-4038-aa48-2432c88cbdea None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:40.702717 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d5a99-58c7-4fa4-8bf8-38235426b00f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:40.702806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7c89d-7609-4038-aa48-2432c88cbdea None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:40.703003 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d5a99-58c7-4fa4-8bf8-38235426b00f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:40.703089 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7c89d-7609-4038-aa48-2432c88cbdea None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:40.703283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d5a99-58c7-4fa4-8bf8-38235426b00f None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:40.703746 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7c89d-7609-4038-aa48-2432c88cbdea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:40.704026 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d5a99-58c7-4fa4-8bf8-38235426b00f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:40.704124 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7c89d-7609-4038-aa48-2432c88cbdea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:40.704338 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d5a99-58c7-4fa4-8bf8-38235426b00f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:40.705419 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7c89d-7609-4038-aa48-2432c88cbdea None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:40.705680 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d5a99-58c7-4fa4-8bf8-38235426b00f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:40.708436 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:40.713848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 221/444] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:40.721687 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 224/445] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:05:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:40.721863 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7c89d-7609-4038-aa48-2432c88cbdea None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:40.721984 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d5a99-58c7-4fa4-8bf8-38235426b00f None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:40.798255 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:40.818446 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7c89d-7609-4038-aa48-2432c88cbdea None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:40.818619 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d5a99-58c7-4fa4-8bf8-38235426b00f None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:40.851148 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ef5a0-c06b-4598-a6c6-dba2b73adcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:40.851577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093539a-91d7-47d6-a326-666e4c90248d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:40.851804 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ef5a0-c06b-4598-a6c6-dba2b73adcce None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:40.852093 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ef5a0-c06b-4598-a6c6-dba2b73adcce None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:40.852376 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ef5a0-c06b-4598-a6c6-dba2b73adcce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:40.852461 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093539a-91d7-47d6-a326-666e4c90248d None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:40.852700 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093539a-91d7-47d6-a326-666e4c90248d None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:40.852975 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093539a-91d7-47d6-a326-666e4c90248d None admin] PATH_INFO: `/v3/groups/cc9a7af5740c4c66987618df2aa7249d` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:40.854182 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093539a-91d7-47d6-a326-666e4c90248d None admin] RBAC: Authorizing `identity:get_group(group_id=cc9a7af5740c4c66987618df2aa7249d)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:40.856532 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093539a-91d7-47d6-a326-666e4c90248d None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:40.858190 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 222/446] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Jul 11 11:05:40 2022] GET /identity/v3/groups/cc9a7af5740c4c66987618df2aa7249d => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:40.858958 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093539a-91d7-47d6-a326-666e4c90248d None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:40.916679 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:40.920042 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ef5a0-c06b-4598-a6c6-dba2b73adcce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:40.921501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ef5a0-c06b-4598-a6c6-dba2b73adcce None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:40.957027 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093539a-91d7-47d6-a326-666e4c90248d None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:40.991229 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4652a9-39bb-4dc5-8bcc-07edcfda129d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:40.991871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4652a9-39bb-4dc5-8bcc-07edcfda129d None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:40.992156 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4652a9-39bb-4dc5-8bcc-07edcfda129d None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:40.992435 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4652a9-39bb-4dc5-8bcc-07edcfda129d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:41.010415 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:41.022446 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 225/447] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:05:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 11:05:41.022446 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ef5a0-c06b-4598-a6c6-dba2b73adcce None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:41.061003 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4652a9-39bb-4dc5-8bcc-07edcfda129d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:41.062489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4652a9-39bb-4dc5-8bcc-07edcfda129d None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:41.113730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:41.117327 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ef5a0-c06b-4598-a6c6-dba2b73adcce None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:41.150935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e0b43-49ff-433d-873c-e7da9cb629ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:41.151590 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e0b43-49ff-433d-873c-e7da9cb629ec None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:41.151873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e0b43-49ff-433d-873c-e7da9cb629ec None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:41.152150 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e0b43-49ff-433d-873c-e7da9cb629ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:41.152971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e0b43-49ff-433d-873c-e7da9cb629ec None admin] RBAC: Adding query filter params (group.id=cc9a7af5740c4c66987618df2aa7249d, role.id=16b11a05b5da4287bdd74d219dde5fb1, scope.project.id=fb8c135f505f41c49fcaeb13354bca87) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:41.153283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e0b43-49ff-433d-873c-e7da9cb629ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:41.154729 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e0b43-49ff-433d-873c-e7da9cb629ec None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:41.158059 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 223/448] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:05:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:05:41.158883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4652a9-39bb-4dc5-8bcc-07edcfda129d None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:41.164282 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 226/449] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Jul 11 11:05:41 2022] GET /identity/v3/role_assignments?group.id=cc9a7af5740c4c66987618df2aa7249d&scope.project.id=fb8c135f505f41c49fcaeb13354bca87&role.id=16b11a05b5da4287bdd74d219dde5fb1 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:41.164282 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e0b43-49ff-433d-873c-e7da9cb629ec None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:41.218138 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:41.276465 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4652a9-39bb-4dc5-8bcc-07edcfda129d None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:41.278902 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e0b43-49ff-433d-873c-e7da9cb629ec None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:41.316370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c61d9-9fbd-408f-8bbb-48c77e48cebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:41.317617 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c61d9-9fbd-408f-8bbb-48c77e48cebe None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:41.317926 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c61d9-9fbd-408f-8bbb-48c77e48cebe None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:41.318201 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c61d9-9fbd-408f-8bbb-48c77e48cebe None admin] PATH_INFO: `/v3/projects/fb8c135f505f41c49fcaeb13354bca87` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:41.319932 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c61d9-9fbd-408f-8bbb-48c77e48cebe None admin] RBAC: Authorizing `identity:get_project(project_id=fb8c135f505f41c49fcaeb13354bca87)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:41.320039 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007e298-64b0-4ea0-a9aa-2be80121e75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:41.321847 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007e298-64b0-4ea0-a9aa-2be80121e75c None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:41.321949 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c61d9-9fbd-408f-8bbb-48c77e48cebe None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:41.322021 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007e298-64b0-4ea0-a9aa-2be80121e75c None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:41.322021 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007e298-64b0-4ea0-a9aa-2be80121e75c None admin] PATH_INFO: `/v3/projects/88f214658e46461082860991a2c6d4f3` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:41.322482 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007e298-64b0-4ea0-a9aa-2be80121e75c None admin] RBAC: Authorizing `identity:get_project(project_id=88f214658e46461082860991a2c6d4f3)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:41.322840 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 227/450] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:41 2022] GET /identity/v3/projects/fb8c135f505f41c49fcaeb13354bca87 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:41.323950 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007e298-64b0-4ea0-a9aa-2be80121e75c None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:41.325652 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 224/451] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:05:41 2022] GET /identity/v3/projects/88f214658e46461082860991a2c6d4f3 => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:41.331078 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c61d9-9fbd-408f-8bbb-48c77e48cebe None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:41.331218 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007e298-64b0-4ea0-a9aa-2be80121e75c None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:41.372230 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:41.449130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007e298-64b0-4ea0-a9aa-2be80121e75c None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:41.455877 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c61d9-9fbd-408f-8bbb-48c77e48cebe None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:41.468480 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:41.490369 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a497fe-0088-4d03-9527-51f071847e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:41.491228 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a497fe-0088-4d03-9527-51f071847e81 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:41.491516 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a497fe-0088-4d03-9527-51f071847e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:41.491794 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a497fe-0088-4d03-9527-51f071847e81 None admin] PATH_INFO: `/v3/groups/e9a2a2d2cf474477805a40cfd32e7636` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:41.492976 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a497fe-0088-4d03-9527-51f071847e81 None admin] RBAC: Authorizing `identity:get_group(group_id=e9a2a2d2cf474477805a40cfd32e7636)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:41.494453 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a497fe-0088-4d03-9527-51f071847e81 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:41.495329 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c72bb-ef10-4c49-8d22-01705bd236ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:41.496079 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 225/452] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Jul 11 11:05:41 2022] GET /identity/v3/groups/e9a2a2d2cf474477805a40cfd32e7636 => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:41.496174 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c72bb-ef10-4c49-8d22-01705bd236ad None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:41.496563 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c72bb-ef10-4c49-8d22-01705bd236ad None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:41.496838 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c72bb-ef10-4c49-8d22-01705bd236ad None admin] PATH_INFO: `/v3/groups/cc9a7af5740c4c66987618df2aa7249d` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:41.499998 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c72bb-ef10-4c49-8d22-01705bd236ad None admin] RBAC: Authorizing `identity:get_group(group_id=cc9a7af5740c4c66987618df2aa7249d)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:41.499998 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c72bb-ef10-4c49-8d22-01705bd236ad None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:41.501446 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 228/453] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Jul 11 11:05:41 2022] GET /identity/v3/groups/cc9a7af5740c4c66987618df2aa7249d => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:41.502437 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a497fe-0088-4d03-9527-51f071847e81 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:41.508491 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c72bb-ef10-4c49-8d22-01705bd236ad None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:41.610823 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:41.611501 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a497fe-0088-4d03-9527-51f071847e81 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:41.614788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c72bb-ef10-4c49-8d22-01705bd236ad None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:41.646218 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bac232-7700-4cfa-99e2-73dcde769d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:41.646881 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bac232-7700-4cfa-99e2-73dcde769d64 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:41.647170 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bac232-7700-4cfa-99e2-73dcde769d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:41.647273 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42790993-5d62-43f0-a265-e814dc04becf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:41.647452 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bac232-7700-4cfa-99e2-73dcde769d64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:41.647923 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42790993-5d62-43f0-a265-e814dc04becf None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:41.648210 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42790993-5d62-43f0-a265-e814dc04becf None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:41.648295 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bac232-7700-4cfa-99e2-73dcde769d64 None admin] RBAC: Adding query filter params (group.id=e9a2a2d2cf474477805a40cfd32e7636, role.id=736e70deba004b9289c2fed43eb107f7, scope.project.id=88f214658e46461082860991a2c6d4f3) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:41.648493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42790993-5d62-43f0-a265-e814dc04becf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:41.648582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bac232-7700-4cfa-99e2-73dcde769d64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:41.649319 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42790993-5d62-43f0-a265-e814dc04becf None admin] RBAC: Adding query filter params (group.id=cc9a7af5740c4c66987618df2aa7249d, role.id=da398232f5f14edc908b967ea8653212, scope.project.id=fb8c135f505f41c49fcaeb13354bca87) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:41.649634 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42790993-5d62-43f0-a265-e814dc04becf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:41.650040 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bac232-7700-4cfa-99e2-73dcde769d64 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:41.651086 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42790993-5d62-43f0-a265-e814dc04becf None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:41.655809 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 226/454] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Jul 11 11:05:41 2022] GET /identity/v3/role_assignments?group.id=e9a2a2d2cf474477805a40cfd32e7636&scope.project.id=88f214658e46461082860991a2c6d4f3&role.id=736e70deba004b9289c2fed43eb107f7 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:41.657290 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 229/455] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Jul 11 11:05:41 2022] GET /identity/v3/role_assignments?group.id=cc9a7af5740c4c66987618df2aa7249d&scope.project.id=fb8c135f505f41c49fcaeb13354bca87&role.id=da398232f5f14edc908b967ea8653212 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:44.189291 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234153c-79e5-40b8-9fdd-2535ca9bc4c8 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:44.190348 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234153c-79e5-40b8-9fdd-2535ca9bc4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:44.190830 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234153c-79e5-40b8-9fdd-2535ca9bc4c8 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:44.193016 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 227/456] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:44.203106 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046b2f0-ce50-4167-a50c-614b13a03201 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:44.203944 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046b2f0-ce50-4167-a50c-614b13a03201 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:44.204430 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046b2f0-ce50-4167-a50c-614b13a03201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:44.230797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-1046b2f0-ce50-4167-a50c-614b13a03201 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:44.232351 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1046b2f0-ce50-4167-a50c-614b13a03201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:44.326837 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 230/457] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:44.369928 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234153c-79e5-40b8-9fdd-2535ca9bc4c8 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:44.447800 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:44.475230 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973f3ad-1f92-44b6-ae35-e9b26eb30fc6 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:44.475840 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973f3ad-1f92-44b6-ae35-e9b26eb30fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:44.476311 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973f3ad-1f92-44b6-ae35-e9b26eb30fc6 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:44.477988 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 231/458] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:05:44.495225 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ea55c-cab8-4ed4-b168-d12923aeb7e1 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:44.495838 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ea55c-cab8-4ed4-b168-d12923aeb7e1 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:44.496346 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ea55c-cab8-4ed4-b168-d12923aeb7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:44.521632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-113ea55c-cab8-4ed4-b168-d12923aeb7e1 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:44.522846 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-113ea55c-cab8-4ed4-b168-d12923aeb7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:44.544670 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234153c-79e5-40b8-9fdd-2535ca9bc4c8 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:44.586308 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfefaa-0fdb-4f44-b4cc-cb8233341f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:44.587113 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfefaa-0fdb-4f44-b4cc-cb8233341f68 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:44.587394 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfefaa-0fdb-4f44-b4cc-cb8233341f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:44.587667 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfefaa-0fdb-4f44-b4cc-cb8233341f68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:44.608543 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cfefaa-0fdb-4f44-b4cc-cb8233341f68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:44.610123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cfefaa-0fdb-4f44-b4cc-cb8233341f68 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:44.631849 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-98cfefaa-0fdb-4f44-b4cc-cb8233341f68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:44.631849 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:44.631849 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:44.631849 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:44.631849 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:44.631849 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:44.631849 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:44.631849 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:44.631849 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:44.631849 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:44.631849 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:44.631849 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:44.631849 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:05:44.631849 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:05:44.631849 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:05:44.633623 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:05:44.633623 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:44.633623 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:44.633623 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:44.633623 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:44.633623 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:44.633623 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:44.633623 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:44.633623 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:44.633623 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:44.633623 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:44.633623 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:44.633623 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:44.633623 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:44.633623 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:44.633623 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:44.633623 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:44.634484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:05:44.634484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:05:44.634484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:44.634484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:44.634484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 228/459] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:44.639704 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfefaa-0fdb-4f44-b4cc-cb8233341f68 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:44.691043 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 232/460] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:44.735188 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ea55c-cab8-4ed4-b168-d12923aeb7e1 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:44.770360 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:44.789055 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:44.792596 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfefaa-0fdb-4f44-b4cc-cb8233341f68 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:44.839429 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb89eb-b1e3-4a77-8f3e-000dae8ddbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:44.840678 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb89eb-b1e3-4a77-8f3e-000dae8ddbda None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:44.841460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb89eb-b1e3-4a77-8f3e-000dae8ddbda None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:44.842010 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb89eb-b1e3-4a77-8f3e-000dae8ddbda None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:44.842938 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb89eb-b1e3-4a77-8f3e-000dae8ddbda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:44.843453 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb89eb-b1e3-4a77-8f3e-000dae8ddbda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:44.845704 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb89eb-b1e3-4a77-8f3e-000dae8ddbda None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:44.857462 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ea55c-cab8-4ed4-b168-d12923aeb7e1 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:44.868643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 229/461] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:44.868643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d401f3e-770e-45b9-a375-8ad2c98e0200 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:44.868643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d401f3e-770e-45b9-a375-8ad2c98e0200 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:44.868643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d401f3e-770e-45b9-a375-8ad2c98e0200 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:44.870019 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 230/462] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:44.871023 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d401f3e-770e-45b9-a375-8ad2c98e0200 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:44.901401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca194772-2875-4858-84f5-42c87c67e025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:44.902242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca194772-2875-4858-84f5-42c87c67e025 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:44.902534 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca194772-2875-4858-84f5-42c87c67e025 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:44.902813 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca194772-2875-4858-84f5-42c87c67e025 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:44.914233 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca194772-2875-4858-84f5-42c87c67e025 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:44.915707 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca194772-2875-4858-84f5-42c87c67e025 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:44.936216 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-ca194772-2875-4858-84f5-42c87c67e025 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:44.936216 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:44.936216 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:44.936216 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:44.936216 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:44.936216 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:44.936216 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:44.936216 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:44.936216 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:44.936216 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:44.936216 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:44.936216 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:44.936216 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:05:44.936216 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:05:44.936216 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:05:44.937185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:05:44.937185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:44.937185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:44.937185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:44.937185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:44.937185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:44.937185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:44.937185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:44.937185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:44.937185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:44.937185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:44.937185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:44.937185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:44.937185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:44.937185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:44.937185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:44.937185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:44.938089 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:05:44.938089 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:05:44.938089 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:44.938089 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:44.938089 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 233/463] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:44.939493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee25573-c71d-4d68-b79c-2d8a3bbbca6b None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:44.939493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee25573-c71d-4d68-b79c-2d8a3bbbca6b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:44.939746 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee25573-c71d-4d68-b79c-2d8a3bbbca6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:44.956939 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-bee25573-c71d-4d68-b79c-2d8a3bbbca6b None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:44.958450 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-bee25573-c71d-4d68-b79c-2d8a3bbbca6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:45.012237 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d401f3e-770e-45b9-a375-8ad2c98e0200 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:45.037911 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 234/464] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:45.038870 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee25573-c71d-4d68-b79c-2d8a3bbbca6b None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:45.044805 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:45.054703 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986fff8-07a0-4eac-87ca-bbb23888b8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:45.064967 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986fff8-07a0-4eac-87ca-bbb23888b8f3 None admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:45.064967 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986fff8-07a0-4eac-87ca-bbb23888b8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:45.064967 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986fff8-07a0-4eac-87ca-bbb23888b8f3 None admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:45.064967 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986fff8-07a0-4eac-87ca-bbb23888b8f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:45.064967 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986fff8-07a0-4eac-87ca-bbb23888b8f3 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:45.157794 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 231/465] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jul 11 11:05:44 2022] POST /identity/v3/users => generated 246 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:05:45.158022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee25573-c71d-4d68-b79c-2d8a3bbbca6b None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:45.159871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516c755-36ae-40b8-84cd-f05c263397b2 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:45.160177 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516c755-36ae-40b8-84cd-f05c263397b2 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:45.161105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516c755-36ae-40b8-84cd-f05c263397b2 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:45.166762 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 232/466] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:45.166762 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516c755-36ae-40b8-84cd-f05c263397b2 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:45.192362 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:45.208193 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8bf7e-1015-4753-bc50-acf96b6b0ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:45.209757 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8bf7e-1015-4753-bc50-acf96b6b0ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:45.210246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8bf7e-1015-4753-bc50-acf96b6b0ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:45.210851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8bf7e-1015-4753-bc50-acf96b6b0ca6 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:45.212238 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8bf7e-1015-4753-bc50-acf96b6b0ca6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:45.212869 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8bf7e-1015-4753-bc50-acf96b6b0ca6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:45.214885 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8bf7e-1015-4753-bc50-acf96b6b0ca6 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:45.236102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 235/467] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:45.236102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95411c08-f2c7-4d69-9015-d386eca2b2c9 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:45.236347 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95411c08-f2c7-4d69-9015-d386eca2b2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:45.236721 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95411c08-f2c7-4d69-9015-d386eca2b2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:45.267360 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-95411c08-f2c7-4d69-9015-d386eca2b2c9 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:45.269102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-95411c08-f2c7-4d69-9015-d386eca2b2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:45.319257 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516c755-36ae-40b8-84cd-f05c263397b2 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:45.347401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:45.356759 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 236/468] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:45.357571 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95411c08-f2c7-4d69-9015-d386eca2b2c9 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:45.362826 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0b9af-5acf-49d8-823a-b89971629eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:45.363999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0b9af-5acf-49d8-823a-b89971629eca None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:45.364397 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0b9af-5acf-49d8-823a-b89971629eca None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:45.364768 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0b9af-5acf-49d8-823a-b89971629eca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:45.376058 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0b9af-5acf-49d8-823a-b89971629eca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:45.377664 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0b9af-5acf-49d8-823a-b89971629eca None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:45.400946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-a1f0b9af-5acf-49d8-823a-b89971629eca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:45.400946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:45.400946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:45.400946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:45.400946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:45.400946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:45.400946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:45.400946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:45.400946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:45.400946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:45.400946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:45.400946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:45.400946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:05:45.400946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:05:45.400946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:05:45.401882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:05:45.401882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:45.401882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:45.401882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:45.401882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:45.401882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:45.401882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:45.401882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:45.401882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:45.401882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:45.401882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:45.401882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:45.401882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:45.401882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:45.401882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:45.401882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:45.401882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:45.402738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:05:45.402738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:05:45.402738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:45.402738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:45.402738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 233/469] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:05:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:45.403435 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0b9af-5acf-49d8-823a-b89971629eca None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:45.491948 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95411c08-f2c7-4d69-9015-d386eca2b2c9 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:45.493066 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:45.530302 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0b9af-5acf-49d8-823a-b89971629eca None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:45.540575 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cdfea-a9cb-4156-a6d1-e9fb10f2c961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:45.542014 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cdfea-a9cb-4156-a6d1-e9fb10f2c961 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:45.542513 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cdfea-a9cb-4156-a6d1-e9fb10f2c961 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:45.542934 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cdfea-a9cb-4156-a6d1-e9fb10f2c961 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:45.544220 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032cdfea-a9cb-4156-a6d1-e9fb10f2c961 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:45.546121 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032cdfea-a9cb-4156-a6d1-e9fb10f2c961 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:45.579812 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e3388-55fe-4094-9a46-198c74c33015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:45.580888 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e3388-55fe-4094-9a46-198c74c33015 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:45.581325 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e3388-55fe-4094-9a46-198c74c33015 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:45.581748 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e3388-55fe-4094-9a46-198c74c33015 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:45.594521 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e3388-55fe-4094-9a46-198c74c33015 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:45.596292 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e3388-55fe-4094-9a46-198c74c33015 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:45.616965 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-fc1e3388-55fe-4094-9a46-198c74c33015 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:45.616965 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:45.616965 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:45.616965 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:45.616965 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:45.616965 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:45.616965 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:45.616965 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:45.616965 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:45.616965 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:45.616965 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:45.616965 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:45.616965 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:05:45.616965 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:05:45.616965 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:05:45.617960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:05:45.617960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:45.617960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:45.617960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:45.617960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:45.617960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:45.617960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:45.617960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:45.617960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:45.617960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:45.617960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:45.617960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:45.617960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:45.617960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:45.617960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:45.617960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:45.617960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:45.619040 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:05:45.619040 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:05:45.619040 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:45.619040 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:45.619251 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 234/470] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:05:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:45.624483 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e3388-55fe-4094-9a46-198c74c33015 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:45.638488 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 237/471] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jul 11 11:05:45 2022] POST /identity/v3/users => generated 248 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:05:45.639676 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cdfea-a9cb-4156-a6d1-e9fb10f2c961 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:45.713279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:45.781660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e3388-55fe-4094-9a46-198c74c33015 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:45.804642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cdfea-a9cb-4156-a6d1-e9fb10f2c961 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:45.806825 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:45.826188 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded76962-289b-4488-b58c-0d2f57f8b046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:45.826862 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded76962-289b-4488-b58c-0d2f57f8b046 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:45.827196 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded76962-289b-4488-b58c-0d2f57f8b046 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:45.827480 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded76962-289b-4488-b58c-0d2f57f8b046 None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:45.829108 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded76962-289b-4488-b58c-0d2f57f8b046 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:45.829450 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded76962-289b-4488-b58c-0d2f57f8b046 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:45.831503 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded76962-289b-4488-b58c-0d2f57f8b046 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:45.848523 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 235/472] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:45.849544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869c4bc-7b97-4ee8-9fca-d4ef86e9eccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:45.849919 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982a48f-643b-4b57-b456-b690f0e82f1d None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:45.850277 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982a48f-643b-4b57-b456-b690f0e82f1d None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:45.850560 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982a48f-643b-4b57-b456-b690f0e82f1d None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:45.851046 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869c4bc-7b97-4ee8-9fca-d4ef86e9eccd None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:45.851729 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869c4bc-7b97-4ee8-9fca-d4ef86e9eccd None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:45.852102 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 236/473] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:45.852415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869c4bc-7b97-4ee8-9fca-d4ef86e9eccd None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:45.853528 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869c4bc-7b97-4ee8-9fca-d4ef86e9eccd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:45.853875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869c4bc-7b97-4ee8-9fca-d4ef86e9eccd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:45.855269 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869c4bc-7b97-4ee8-9fca-d4ef86e9eccd None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:45.856753 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982a48f-643b-4b57-b456-b690f0e82f1d None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:45.872978 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 238/474] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:45.874551 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84bfc6-5b84-45af-a511-cb158ba0f4e3 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:45.874972 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84bfc6-5b84-45af-a511-cb158ba0f4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:45.875346 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84bfc6-5b84-45af-a511-cb158ba0f4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:45.892685 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-3e84bfc6-5b84-45af-a511-cb158ba0f4e3 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:45.893932 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3e84bfc6-5b84-45af-a511-cb158ba0f4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:45.977388 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982a48f-643b-4b57-b456-b690f0e82f1d None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:45.989906 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 239/475] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:45.991842 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84bfc6-5b84-45af-a511-cb158ba0f4e3 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:46.035316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b4ac9-a424-48d8-ae70-c8331e68bb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:46.036046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b4ac9-a424-48d8-ae70-c8331e68bb88 None admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:46.036486 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b4ac9-a424-48d8-ae70-c8331e68bb88 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:46.036737 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b4ac9-a424-48d8-ae70-c8331e68bb88 None admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:46.037460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b4ac9-a424-48d8-ae70-c8331e68bb88 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:46.039268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b4ac9-a424-48d8-ae70-c8331e68bb88 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:46.059492 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:46.118090 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84bfc6-5b84-45af-a511-cb158ba0f4e3 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:46.153806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 237/476] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jul 11 11:05:45 2022] POST /identity/v3/users => generated 248 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:05:46.155002 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b4ac9-a424-48d8-ae70-c8331e68bb88 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:46.156939 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c610dc6-ff20-41cf-a1ce-b36f0f831663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:46.157629 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c610dc6-ff20-41cf-a1ce-b36f0f831663 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:46.158023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c610dc6-ff20-41cf-a1ce-b36f0f831663 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:46.158316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c610dc6-ff20-41cf-a1ce-b36f0f831663 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:46.159047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c610dc6-ff20-41cf-a1ce-b36f0f831663 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:46.160647 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c610dc6-ff20-41cf-a1ce-b36f0f831663 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:46.215355 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:46.286817 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 240/477] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jul 11 11:05:45 2022] POST /identity/v3/users => generated 249 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:05:46.294316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b4ac9-a424-48d8-ae70-c8331e68bb88 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:46.333989 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5c433-9c17-4108-8e58-9f921821be57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:46.334695 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5c433-9c17-4108-8e58-9f921821be57 None admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:46.334957 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5c433-9c17-4108-8e58-9f921821be57 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:46.335227 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5c433-9c17-4108-8e58-9f921821be57 None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:46.336093 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5c433-9c17-4108-8e58-9f921821be57 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:46.337660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5c433-9c17-4108-8e58-9f921821be57 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:46.373081 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.sql.core [None req-96b5c433-9c17-4108-8e58-9f921821be57 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 11:05:46.373081 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 11 11:05:46.373081 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [parameters: {'id': 'a04d2aecfb5c4084a9406d473add4a32', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 11 11:05:46.373081 dv-cinder-848429-2-smb devstack@keystone.service[80522]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80522) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 11:05:46.391296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-96b5c433-9c17-4108-8e58-9f921821be57 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 11 11:05:46.391296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:46.391296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 11:05:46.391296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 11:05:46.391296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 11:05:46.391296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 11:05:46.391296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 11:05:46.391296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 11:05:46.391296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 11:05:46.391296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application conn.query(q) Jul 11 11:05:46.391296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 11:05:46.391296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 11:05:46.391296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 11:05:46.391296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application result.read() Jul 11 11:05:46.391296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 11:05:46.392225 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 11:05:46.392225 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 11:05:46.392225 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 11:05:46.392225 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 11:05:46.392225 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 11:05:46.392225 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 11:05:46.392225 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 11:05:46.392225 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 11:05:46.392225 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:46.392225 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 11:05:46.392225 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:46.392225 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:46.392225 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 11:05:46.392225 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 11:05:46.392225 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 11 11:05:46.392225 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return ref.to_dict() Jul 11 11:05:46.392225 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 11:05:46.392225 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application next(self.gen) Jul 11 11:05:46.393108 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 11:05:46.393108 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application yield resource Jul 11 11:05:46.393108 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 11:05:46.393108 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application next(self.gen) Jul 11 11:05:46.393108 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 11:05:46.393108 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 11:05:46.393108 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 11:05:46.393108 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 11:05:46.393108 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 11:05:46.393108 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise self.value Jul 11 11:05:46.393108 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 11:05:46.393108 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 11:05:46.393108 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 11:05:46.393108 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application session.commit() Jul 11 11:05:46.393108 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 11:05:46.393108 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 11:05:46.393108 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 11:05:46.393969 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 11:05:46.393969 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 11:05:46.393969 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self.session.flush() Jul 11 11:05:46.393969 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 11:05:46.393969 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 11:05:46.393969 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 11:05:46.393969 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 11:05:46.393969 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 11:05:46.393969 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application compat.raise_( Jul 11 11:05:46.393969 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 11:05:46.393969 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception Jul 11 11:05:46.393969 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 11:05:46.393969 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 11:05:46.393969 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 11:05:46.393969 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 11:05:46.393969 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 11:05:46.393969 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 11:05:46.396655 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 11:05:46.396655 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 11:05:46.396655 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 11 11:05:46.396655 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 11 11:05:46.396655 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 11:05:46.396655 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 11:05:46.396655 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 11:05:46.396655 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 11:05:46.396655 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 11:05:46.396655 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 11:05:46.396655 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 11:05:46.396655 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 11:05:46.396655 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 11:05:46.396655 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 11:05:46.396655 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 11:05:46.396655 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception Jul 11 11:05:46.398577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 11:05:46.398577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 11:05:46.398577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 11:05:46.398577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 11:05:46.398577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 11:05:46.398577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 11:05:46.398577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 11:05:46.398577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application conn.query(q) Jul 11 11:05:46.398577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 11:05:46.398577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 11:05:46.398577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 11:05:46.398577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application result.read() Jul 11 11:05:46.398577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 11:05:46.398577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 11:05:46.398577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 11:05:46.398577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 11:05:46.400369 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 11:05:46.400369 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 11:05:46.400369 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 11:05:46.400369 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 11:05:46.400369 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 11:05:46.400369 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 11 11:05:46.400369 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [parameters: {'id': 'a04d2aecfb5c4084a9406d473add4a32', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 11 11:05:46.400369 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 11:05:46.400369 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:46.400369 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:05:46.400369 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:46.400369 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:46.400369 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:46.400369 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:46.400369 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:46.400369 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:46.406494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:46.406494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:46.406494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:46.406494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:46.406494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:46.406494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:46.406494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 11 11:05:46.406494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 11 11:05:46.406494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:46.406494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:46.406494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 11 11:05:46.406494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 11 11:05:46.406494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 11:05:46.406494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 11:05:46.406494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 11 11:05:46.406494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:46.407537 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 238/478] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Jul 11 11:05:46 2022] POST /identity/v3/roles => generated 144 bytes in 239 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:46.407616 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c610dc6-ff20-41cf-a1ce-b36f0f831663 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:46.518633 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:46.525464 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c610dc6-ff20-41cf-a1ce-b36f0f831663 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:46.560261 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9741db6-24b3-4c73-af2e-0596d3933a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:46.561542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9741db6-24b3-4c73-af2e-0596d3933a2a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:46.562948 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9741db6-24b3-4c73-af2e-0596d3933a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:46.563240 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9741db6-24b3-4c73-af2e-0596d3933a2a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:46.574951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9741db6-24b3-4c73-af2e-0596d3933a2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:46.583942 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-f9741db6-24b3-4c73-af2e-0596d3933a2a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:05:46.583942 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:46.583942 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:46.583942 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:46.583942 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:46.583942 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:46.583942 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:46.583942 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:46.583942 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:46.583942 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:46.583942 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:46.583942 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:46.583942 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:46.583942 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:46.583942 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:46.583942 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:46.588617 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:46.588617 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:46.588617 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:46.588617 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:46.588617 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:46.588617 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:46.588617 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:46.588617 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:46.588617 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:46.588617 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:46.588617 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:46.588617 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:46.588617 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:46.588617 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:46.588617 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:46.588617 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:46.589421 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:46.589421 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:46.589421 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:46.589421 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:46.589421 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:46.589421 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:46.589421 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:46.589421 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:46.589421 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:46.589421 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:46.589421 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:05:46.589421 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:46.589421 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 241/479] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jul 11 11:05:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:05:46.596100 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5c433-9c17-4108-8e58-9f921821be57 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:46.703800 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:46.707833 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5c433-9c17-4108-8e58-9f921821be57 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:46.751473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9f085-c2ab-4241-a7b5-602b22f7919d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:46.752152 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9f085-c2ab-4241-a7b5-602b22f7919d None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:46.752437 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9f085-c2ab-4241-a7b5-602b22f7919d None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:46.752714 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9f085-c2ab-4241-a7b5-602b22f7919d None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:46.753475 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9f085-c2ab-4241-a7b5-602b22f7919d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:46.753839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9f085-c2ab-4241-a7b5-602b22f7919d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:46.755484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9f085-c2ab-4241-a7b5-602b22f7919d None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:46.769178 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 239/480] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:05:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:47.421920 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b807e5-2f9a-4404-b03e-36db9f8edabd None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:47.422435 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b807e5-2f9a-4404-b03e-36db9f8edabd None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:47.422540 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b807e5-2f9a-4404-b03e-36db9f8edabd None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:47.424099 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 242/481] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:47.429492 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6a107-b2d5-4fcf-8850-1fc77e8c9a00 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:47.429959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6a107-b2d5-4fcf-8850-1fc77e8c9a00 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:47.430130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6a107-b2d5-4fcf-8850-1fc77e8c9a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:47.458811 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-38d6a107-b2d5-4fcf-8850-1fc77e8c9a00 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:47.459996 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-38d6a107-b2d5-4fcf-8850-1fc77e8c9a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:47.548354 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 240/482] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:05:47.588421 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b807e5-2f9a-4404-b03e-36db9f8edabd None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:47.730138 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b807e5-2f9a-4404-b03e-36db9f8edabd None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:47.782458 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03471512-669a-4a10-ac35-a8a16dc57cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:47.783261 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03471512-669a-4a10-ac35-a8a16dc57cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:47.783545 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03471512-669a-4a10-ac35-a8a16dc57cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:47.783824 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03471512-669a-4a10-ac35-a8a16dc57cc9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:47.802639 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03471512-669a-4a10-ac35-a8a16dc57cc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:47.810788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-03471512-669a-4a10-ac35-a8a16dc57cc9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:05:47.810788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:47.810788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:47.810788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:47.810788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:47.810788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:47.810788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:47.810788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:47.810788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:47.810788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:47.810788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:47.810788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:47.810788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:47.810788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:47.810788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:47.810788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:47.811783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:47.811783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:47.811783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:47.811783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:47.811783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:47.811783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:47.811783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:47.811783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:47.811783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:47.811783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:47.811783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:47.811783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:47.811783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:47.811783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:47.811783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:47.811783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:47.812774 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:47.812774 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:47.812774 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:47.812774 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:47.812774 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:47.812774 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:47.812774 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:47.812774 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:47.812774 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:47.812774 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:47.812774 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:05:47.812774 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:47.812774 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 243/483] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jul 11 11:05:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:47.818438 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6a107-b2d5-4fcf-8850-1fc77e8c9a00 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:47.910692 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:47.923490 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6a107-b2d5-4fcf-8850-1fc77e8c9a00 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:47.973726 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65378b7-41f3-4543-9b65-f15281ae5c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:47.974424 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65378b7-41f3-4543-9b65-f15281ae5c03 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:47.974710 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65378b7-41f3-4543-9b65-f15281ae5c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:47.974979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65378b7-41f3-4543-9b65-f15281ae5c03 None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:47.975733 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65378b7-41f3-4543-9b65-f15281ae5c03 None admin] RBAC: Adding query filter params (name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:47.976039 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65378b7-41f3-4543-9b65-f15281ae5c03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:47.977404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65378b7-41f3-4543-9b65-f15281ae5c03 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:47.985936 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 241/484] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jul 11 11:05:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:47.992105 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03471512-669a-4a10-ac35-a8a16dc57cc9 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:48.015235 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:48.116380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03471512-669a-4a10-ac35-a8a16dc57cc9 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:48.151569 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad39416-fca9-4d33-a728-4cc87f0079f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:48.152714 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad39416-fca9-4d33-a728-4cc87f0079f7 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:48.153223 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad39416-fca9-4d33-a728-4cc87f0079f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:48.153730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad39416-fca9-4d33-a728-4cc87f0079f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:48.166861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dd5f2-70ca-4439-8781-7d42a6dc5617 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:48.167127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dd5f2-70ca-4439-8781-7d42a6dc5617 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:48.167393 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dd5f2-70ca-4439-8781-7d42a6dc5617 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:48.168978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 242/485] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:48.169661 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad39416-fca9-4d33-a728-4cc87f0079f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:48.171404 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad39416-fca9-4d33-a728-4cc87f0079f7 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:48.173855 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810e693-49cf-4e2c-820c-e73cd939a061 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:48.174146 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810e693-49cf-4e2c-820c-e73cd939a061 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:48.174426 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810e693-49cf-4e2c-820c-e73cd939a061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:48.195479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-9ad39416-fca9-4d33-a728-4cc87f0079f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:48.195479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:48.195479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:48.195479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:48.195479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:48.195479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:48.195479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:48.195479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:48.195479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:48.195479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:48.195479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:48.195479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:48.195479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:05:48.195479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:05:48.195479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:05:48.196390 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:05:48.196390 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:48.196390 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:48.196390 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:48.196390 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:48.196390 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:48.196390 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:48.196390 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:48.196390 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:48.196390 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:48.196390 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:48.196390 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:48.196390 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:48.196390 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:48.196390 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:48.196390 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:48.196390 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:48.197229 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:05:48.197229 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:05:48.197229 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:48.197229 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:48.200509 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 244/486] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:05:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:48.209355 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad39416-fca9-4d33-a728-4cc87f0079f7 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:48.221479 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-5810e693-49cf-4e2c-820c-e73cd939a061 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:48.226622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-5810e693-49cf-4e2c-820c-e73cd939a061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:48.307360 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:48.352230 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad39416-fca9-4d33-a728-4cc87f0079f7 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:48.393294 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70b7b6-11e0-4f92-a9e2-aae174779608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:48.394564 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70b7b6-11e0-4f92-a9e2-aae174779608 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:48.394855 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70b7b6-11e0-4f92-a9e2-aae174779608 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:48.395133 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70b7b6-11e0-4f92-a9e2-aae174779608 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:48.395860 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70b7b6-11e0-4f92-a9e2-aae174779608 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:48.396171 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70b7b6-11e0-4f92-a9e2-aae174779608 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:48.397538 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70b7b6-11e0-4f92-a9e2-aae174779608 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:48.400257 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 243/487] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:05:48.419231 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 245/488] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:48.423211 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810e693-49cf-4e2c-820c-e73cd939a061 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:48.424487 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70b7b6-11e0-4f92-a9e2-aae174779608 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:48.554102 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:48.583125 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810e693-49cf-4e2c-820c-e73cd939a061 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:48.604756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70b7b6-11e0-4f92-a9e2-aae174779608 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:48.645630 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40e74b-c226-41f1-8c19-422647486eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:48.646454 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40e74b-c226-41f1-8c19-422647486eef None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:48.646736 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40e74b-c226-41f1-8c19-422647486eef None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:48.647009 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40e74b-c226-41f1-8c19-422647486eef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:48.652472 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:48.664352 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40e74b-c226-41f1-8c19-422647486eef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:48.672091 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-9c40e74b-c226-41f1-8c19-422647486eef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:05:48.672091 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:48.672091 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:48.672091 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:48.672091 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:48.672091 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:48.672091 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:48.672091 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:48.672091 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:48.672091 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:48.672091 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:48.672091 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:48.672091 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:48.672091 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:48.672091 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:48.672091 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:48.674331 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:48.674331 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:48.674331 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:48.674331 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:48.674331 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:48.674331 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:48.674331 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:48.674331 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:48.674331 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:48.674331 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:48.674331 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:48.674331 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:48.674331 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:48.674331 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:48.674331 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:48.674331 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:48.675292 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:48.675292 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:48.675292 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:48.675292 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:48.675292 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:48.675292 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:48.675292 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:48.675292 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:48.675292 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:48.675292 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:48.675292 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:05:48.675292 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:48.679192 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 244/489] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jul 11 11:05:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:48.681949 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3dc1f-e059-4a2d-a121-d9e7be9a07b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:48.682759 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3dc1f-e059-4a2d-a121-d9e7be9a07b6 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:48.683037 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3dc1f-e059-4a2d-a121-d9e7be9a07b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:48.683566 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3dc1f-e059-4a2d-a121-d9e7be9a07b6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:48.690747 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40e74b-c226-41f1-8c19-422647486eef None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:48.692752 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3dc1f-e059-4a2d-a121-d9e7be9a07b6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:48.694314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3dc1f-e059-4a2d-a121-d9e7be9a07b6 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:48.719453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-62f3dc1f-e059-4a2d-a121-d9e7be9a07b6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 11:05:48.719453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:48.719453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:48.719453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:48.719453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:48.719453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:48.719453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:48.719453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:48.719453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:48.719453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:48.719453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:48.719453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:48.719453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:05:48.719453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:05:48.719453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:05:48.719453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:05:48.720415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:48.720415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:48.720415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:05:48.720415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:05:48.720415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:05:48.720415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:05:48.720415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:48.720415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:48.720415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:48.720415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:48.720415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:48.720415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:48.720415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:48.720415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:48.720415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:48.720415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:48.720415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:48.720415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:48.721482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:48.721482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:48.721482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:05:48.721482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:05:48.721482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:05:48.721482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:05:48.721482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:05:48.721482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:05:48.721482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 11:05:48.721482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:48.721482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 246/490] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Jul 11 11:05:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:48.727247 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3dc1f-e059-4a2d-a121-d9e7be9a07b6 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:48.841583 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40e74b-c226-41f1-8c19-422647486eef None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:48.843483 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3dc1f-e059-4a2d-a121-d9e7be9a07b6 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:48.878214 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da73d0-2e77-4a7e-baae-c0b55c78ed4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:48.879578 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da73d0-2e77-4a7e-baae-c0b55c78ed4e None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:48.879863 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da73d0-2e77-4a7e-baae-c0b55c78ed4e None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:48.880138 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da73d0-2e77-4a7e-baae-c0b55c78ed4e None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:48.880363 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c915820-5ed4-4b9e-a42a-14f827f31c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:48.880886 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da73d0-2e77-4a7e-baae-c0b55c78ed4e None admin] RBAC: Adding query filter params (name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:48.881037 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c915820-5ed4-4b9e-a42a-14f827f31c81 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:48.881200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da73d0-2e77-4a7e-baae-c0b55c78ed4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:48.881344 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c915820-5ed4-4b9e-a42a-14f827f31c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:48.881598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c915820-5ed4-4b9e-a42a-14f827f31c81 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:48.882468 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c915820-5ed4-4b9e-a42a-14f827f31c81 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:48.882573 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da73d0-2e77-4a7e-baae-c0b55c78ed4e None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:48.882786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c915820-5ed4-4b9e-a42a-14f827f31c81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:48.884199 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c915820-5ed4-4b9e-a42a-14f827f31c81 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:48.895173 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 245/491] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jul 11 11:05:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:48.895173 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87904492-58f2-4235-9ac9-1d34d4f02405 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:48.895173 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87904492-58f2-4235-9ac9-1d34d4f02405 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:48.895173 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87904492-58f2-4235-9ac9-1d34d4f02405 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:48.895173 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 246/492] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:48.896762 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c292e-bea7-4c2c-8c18-4e00fb1ec888 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:48.896762 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c292e-bea7-4c2c-8c18-4e00fb1ec888 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:48.896762 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c292e-bea7-4c2c-8c18-4e00fb1ec888 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:48.901430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 247/493] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:48.901430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c292e-bea7-4c2c-8c18-4e00fb1ec888 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:48.910018 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:48.930592 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 247/494] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Jul 11 11:05:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:48.930592 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6be4bd-50d3-426a-92b3-956bab25739c None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:48.930592 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6be4bd-50d3-426a-92b3-956bab25739c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:48.930592 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6be4bd-50d3-426a-92b3-956bab25739c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:48.947676 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-df6be4bd-50d3-426a-92b3-956bab25739c None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:48.948889 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-df6be4bd-50d3-426a-92b3-956bab25739c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:48.996854 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:49.021143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c292e-bea7-4c2c-8c18-4e00fb1ec888 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:49.022980 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 248/495] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:49.024505 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f6344-27e7-4711-aeed-aff219230bd6 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:49.024958 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f6344-27e7-4711-aeed-aff219230bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:49.025373 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f6344-27e7-4711-aeed-aff219230bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:49.042442 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-dc4f6344-27e7-4711-aeed-aff219230bd6 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:49.043827 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-dc4f6344-27e7-4711-aeed-aff219230bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:49.072151 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f496494-3f20-41d2-a624-2d87bd212194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:49.072943 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f496494-3f20-41d2-a624-2d87bd212194 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:49.073231 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f496494-3f20-41d2-a624-2d87bd212194 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:49.073513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f496494-3f20-41d2-a624-2d87bd212194 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:49.083806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f496494-3f20-41d2-a624-2d87bd212194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:49.085258 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f496494-3f20-41d2-a624-2d87bd212194 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:49.103160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-9f496494-3f20-41d2-a624-2d87bd212194 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:49.103160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:49.103160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:49.103160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:49.103160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:49.103160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:49.103160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:49.103160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:49.103160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:49.103160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:49.103160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:49.103160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:49.103160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:05:49.103160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:05:49.103160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:05:49.104191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:05:49.104191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:49.104191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:49.104191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:49.104191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:49.104191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:49.104191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:49.104191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:49.104191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:49.104191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:49.104191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:49.104191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:49.104191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:49.104191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:49.104191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:49.104191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:49.104191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:49.105060 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:05:49.105060 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:05:49.105060 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:49.105060 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:49.105060 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 248/496] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:05:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:49.105060 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f496494-3f20-41d2-a624-2d87bd212194 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:49.119889 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 249/497] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:49.120866 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f6344-27e7-4711-aeed-aff219230bd6 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:49.176832 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:49.220775 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f496494-3f20-41d2-a624-2d87bd212194 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:49.230565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f6344-27e7-4711-aeed-aff219230bd6 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:49.237673 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:49.261500 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36152c01-8af9-4463-8c27-68656c783276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:49.262290 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36152c01-8af9-4463-8c27-68656c783276 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:49.262577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36152c01-8af9-4463-8c27-68656c783276 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:49.262853 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36152c01-8af9-4463-8c27-68656c783276 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:49.275058 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3de3a-456b-4ca0-b14e-a39f0dca99cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:49.275886 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3de3a-456b-4ca0-b14e-a39f0dca99cc None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:49.276170 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3de3a-456b-4ca0-b14e-a39f0dca99cc None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:49.276444 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3de3a-456b-4ca0-b14e-a39f0dca99cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:49.288679 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3de3a-456b-4ca0-b14e-a39f0dca99cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:49.296360 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-ccf3de3a-456b-4ca0-b14e-a39f0dca99cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:05:49.296360 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:49.296360 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:49.296360 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:49.296360 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:49.296360 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:49.296360 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:49.296360 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:49.296360 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:49.296360 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:49.296360 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:49.296360 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:49.296360 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:49.296360 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:49.296360 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:49.296360 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:49.297230 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:49.297230 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:49.297230 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:49.297230 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:49.297230 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:49.297230 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:49.297230 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:49.297230 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:49.297230 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:49.297230 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:49.297230 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:49.297230 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:49.297230 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:49.297230 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:49.297230 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:49.297230 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:49.298478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:49.298478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:49.298478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:49.298478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:49.298478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:49.298478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:49.298478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:49.298478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:49.298478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:49.298478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:49.298478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:05:49.298478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:49.298478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 250/498] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jul 11 11:05:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:49.299306 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3de3a-456b-4ca0-b14e-a39f0dca99cc None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:49.343935 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36152c01-8af9-4463-8c27-68656c783276 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:49.345441 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36152c01-8af9-4463-8c27-68656c783276 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:49.400253 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3de3a-456b-4ca0-b14e-a39f0dca99cc None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:49.406324 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:49.435516 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50327979-bb57-4e6d-917d-353712a293ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:49.436224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50327979-bb57-4e6d-917d-353712a293ec None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:49.436557 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50327979-bb57-4e6d-917d-353712a293ec None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:49.436836 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50327979-bb57-4e6d-917d-353712a293ec None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:49.437555 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50327979-bb57-4e6d-917d-353712a293ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:49.437944 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50327979-bb57-4e6d-917d-353712a293ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:49.439387 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50327979-bb57-4e6d-917d-353712a293ec None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:49.459963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 249/499] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:05:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:05:49.460140 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 251/500] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:49.460226 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36152c01-8af9-4463-8c27-68656c783276 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:49.460309 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50327979-bb57-4e6d-917d-353712a293ec None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:49.486755 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:49.564874 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50327979-bb57-4e6d-917d-353712a293ec None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:49.568963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36152c01-8af9-4463-8c27-68656c783276 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:49.602042 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11b337-1b44-4450-87c7-28f2891befbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:49.603014 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11b337-1b44-4450-87c7-28f2891befbf None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:49.603526 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11b337-1b44-4450-87c7-28f2891befbf None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:49.603813 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11b337-1b44-4450-87c7-28f2891befbf None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:49.604649 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11b337-1b44-4450-87c7-28f2891befbf None admin] RBAC: Adding query filter params (name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:49.604970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11b337-1b44-4450-87c7-28f2891befbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:49.606381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11b337-1b44-4450-87c7-28f2891befbf None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:49.608081 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f9c11-5172-4985-8fa6-96e6df383e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:49.608870 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f9c11-5172-4985-8fa6-96e6df383e60 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:49.609156 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f9c11-5172-4985-8fa6-96e6df383e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:49.609424 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f9c11-5172-4985-8fa6-96e6df383e60 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:49.616748 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 252/501] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jul 11 11:05:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:49.617909 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11b337-1b44-4450-87c7-28f2891befbf None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:49.624785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f9c11-5172-4985-8fa6-96e6df383e60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:49.632577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-e45f9c11-5172-4985-8fa6-96e6df383e60 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:05:49.632577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:49.632577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:49.632577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:49.632577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:49.632577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:49.632577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:49.632577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:49.632577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:49.632577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:49.632577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:49.632577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:49.632577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:49.632577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:49.632577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:49.632577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:49.633453 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:49.633453 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:49.633453 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:49.633453 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:49.633453 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:49.633453 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:49.633453 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:49.633453 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:49.633453 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:49.633453 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:49.633453 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:49.633453 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:49.633453 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:49.633453 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:49.633453 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:49.633453 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:49.634272 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:49.634272 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:49.634272 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:49.634272 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:49.634272 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:49.634272 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:49.634272 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:49.634272 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:49.634272 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:49.634272 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:49.634272 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:05:49.634272 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:49.639022 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 250/502] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jul 11 11:05:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:49.639747 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f9c11-5172-4985-8fa6-96e6df383e60 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:49.661130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:49.711432 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:49.723717 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11b337-1b44-4450-87c7-28f2891befbf None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:49.741005 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f9c11-5172-4985-8fa6-96e6df383e60 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:49.757623 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63904a48-c33e-4d25-8abc-8ab881a83162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:49.758462 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63904a48-c33e-4d25-8abc-8ab881a83162 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:49.758748 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63904a48-c33e-4d25-8abc-8ab881a83162 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:49.759034 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63904a48-c33e-4d25-8abc-8ab881a83162 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:49.766862 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63904a48-c33e-4d25-8abc-8ab881a83162 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:49.768316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63904a48-c33e-4d25-8abc-8ab881a83162 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:49.776926 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd8711-b277-4058-b434-18073ce56df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:49.777728 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd8711-b277-4058-b434-18073ce56df7 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:49.778046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd8711-b277-4058-b434-18073ce56df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:49.778327 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd8711-b277-4058-b434-18073ce56df7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:49.783122 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-63904a48-c33e-4d25-8abc-8ab881a83162 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 11:05:49.783122 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:49.783122 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:49.783122 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:49.783122 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:49.783122 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:49.783122 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:49.783122 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:49.783122 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:49.783122 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:49.783122 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:49.783122 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:49.783122 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:05:49.783122 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:05:49.783122 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:05:49.783122 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:05:49.783991 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:49.783991 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:49.783991 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:05:49.783991 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:05:49.783991 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:05:49.783991 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:05:49.783991 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:49.783991 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:49.783991 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:49.783991 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:49.783991 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:49.783991 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:49.783991 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:49.783991 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:49.783991 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:49.783991 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:49.783991 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:49.783991 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:49.784880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:49.784880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:49.784880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:05:49.784880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:05:49.784880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:05:49.784880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:05:49.784880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:05:49.784880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:05:49.784880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 11:05:49.784880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:49.784880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 253/503] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:49.786591 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63904a48-c33e-4d25-8abc-8ab881a83162 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:49.790771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd8711-b277-4058-b434-18073ce56df7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:49.792232 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd8711-b277-4058-b434-18073ce56df7 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:49.809861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-d0fd8711-b277-4058-b434-18073ce56df7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:49.809861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:49.809861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:49.809861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:49.809861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:49.809861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:49.809861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:49.809861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:49.809861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:49.809861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:49.809861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:49.809861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:49.809861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:05:49.809861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:05:49.809861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:05:49.810871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:05:49.810871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:49.810871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:49.810871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:49.810871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:49.810871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:49.810871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:49.810871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:49.810871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:49.810871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:49.810871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:49.810871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:49.810871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:49.810871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:49.810871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:49.810871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:49.810871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:49.811733 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:05:49.811733 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:05:49.811733 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:49.811733 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:49.811733 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 251/504] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:49.812158 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd8711-b277-4058-b434-18073ce56df7 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:49.880056 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:49.890316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63904a48-c33e-4d25-8abc-8ab881a83162 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:49.913178 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd8711-b277-4058-b434-18073ce56df7 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:49.924409 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a1c12-600d-4c21-8148-b5612616b841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:49.925205 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a1c12-600d-4c21-8148-b5612616b841 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:49.925489 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a1c12-600d-4c21-8148-b5612616b841 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:49.925871 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a1c12-600d-4c21-8148-b5612616b841 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:49.936683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a1c12-600d-4c21-8148-b5612616b841 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:49.938175 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a1c12-600d-4c21-8148-b5612616b841 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:49.946591 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:49.947623 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35145bc8-3c40-4da8-b022-19e40fe0e702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:49.948274 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35145bc8-3c40-4da8-b022-19e40fe0e702 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:49.948558 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35145bc8-3c40-4da8-b022-19e40fe0e702 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:49.948831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35145bc8-3c40-4da8-b022-19e40fe0e702 None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:49.949572 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35145bc8-3c40-4da8-b022-19e40fe0e702 None admin] RBAC: Adding query filter params (name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:49.949922 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35145bc8-3c40-4da8-b022-19e40fe0e702 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:49.951283 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35145bc8-3c40-4da8-b022-19e40fe0e702 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:49.955881 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-d71a1c12-600d-4c21-8148-b5612616b841 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:49.955881 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:49.955881 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:49.955881 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:49.955881 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:49.955881 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:49.955881 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:49.955881 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:49.955881 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:49.955881 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:49.955881 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:49.955881 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:49.955881 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:05:49.955881 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:05:49.955881 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:05:49.959163 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:05:49.959163 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:49.959163 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:49.959163 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:49.959163 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:49.959163 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:49.959163 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:49.959163 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:49.959163 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:49.959163 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:49.959163 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:49.959163 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:49.959163 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:49.959163 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:49.959163 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:49.959163 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:49.959163 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:49.959984 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:05:49.959984 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:05:49.959984 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:49.959984 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:49.959984 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 254/505] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:49.959984 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe1d53-1fc3-426e-a0b4-47540d1c8345 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:49.959984 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe1d53-1fc3-426e-a0b4-47540d1c8345 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:49.959984 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe1d53-1fc3-426e-a0b4-47540d1c8345 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:49.964918 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 255/506] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:49.964918 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe1d53-1fc3-426e-a0b4-47540d1c8345 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:49.965087 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 252/507] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jul 11 11:05:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:49.965318 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35145bc8-3c40-4da8-b022-19e40fe0e702 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:50.065439 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35145bc8-3c40-4da8-b022-19e40fe0e702 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:50.067037 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe1d53-1fc3-426e-a0b4-47540d1c8345 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:50.093856 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:50.099354 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d84b2-6077-4425-994f-9188f3c34f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:50.099485 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db5516-402c-4e4b-a27a-fd596acdf0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:50.100043 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d84b2-6077-4425-994f-9188f3c34f65 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:50.100165 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db5516-402c-4e4b-a27a-fd596acdf0fe None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:50.100327 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d84b2-6077-4425-994f-9188f3c34f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:50.100416 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db5516-402c-4e4b-a27a-fd596acdf0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:50.100605 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d84b2-6077-4425-994f-9188f3c34f65 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:50.100692 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db5516-402c-4e4b-a27a-fd596acdf0fe None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:50.101322 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db5516-402c-4e4b-a27a-fd596acdf0fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:50.101436 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d84b2-6077-4425-994f-9188f3c34f65 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:50.101632 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db5516-402c-4e4b-a27a-fd596acdf0fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:50.101750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d84b2-6077-4425-994f-9188f3c34f65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:50.103082 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db5516-402c-4e4b-a27a-fd596acdf0fe None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:50.109108 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d84b2-6077-4425-994f-9188f3c34f65 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:50.115047 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 253/508] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:50.115832 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db5516-402c-4e4b-a27a-fd596acdf0fe None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:50.121023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 256/509] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Jul 11 11:05:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:50.122292 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f35cf-e6bd-4f57-9826-660c08a831ed None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:50.122587 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f35cf-e6bd-4f57-9826-660c08a831ed None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:50.122872 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f35cf-e6bd-4f57-9826-660c08a831ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:50.138704 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-d40f35cf-e6bd-4f57-9826-660c08a831ed None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:50.139894 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d40f35cf-e6bd-4f57-9826-660c08a831ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:50.191761 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:50.204149 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 257/510] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:50.204977 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f35cf-e6bd-4f57-9826-660c08a831ed None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:50.214700 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db5516-402c-4e4b-a27a-fd596acdf0fe None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:50.251839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14200925-6a6e-4668-af3a-1ee679d499f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:50.252508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14200925-6a6e-4668-af3a-1ee679d499f2 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:50.252797 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14200925-6a6e-4668-af3a-1ee679d499f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:50.253083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14200925-6a6e-4668-af3a-1ee679d499f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:50.253859 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14200925-6a6e-4668-af3a-1ee679d499f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:50.254275 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14200925-6a6e-4668-af3a-1ee679d499f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:50.255666 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14200925-6a6e-4668-af3a-1ee679d499f2 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:50.266910 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 254/511] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:50.269078 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14200925-6a6e-4668-af3a-1ee679d499f2 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:50.312374 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f35cf-e6bd-4f57-9826-660c08a831ed None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:50.320988 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:50.345844 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99d7d1-1781-4add-bf8f-52554db9f1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:50.346637 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99d7d1-1781-4add-bf8f-52554db9f1cf None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:50.346924 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99d7d1-1781-4add-bf8f-52554db9f1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:50.347199 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99d7d1-1781-4add-bf8f-52554db9f1cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:50.357300 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99d7d1-1781-4add-bf8f-52554db9f1cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:50.358801 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99d7d1-1781-4add-bf8f-52554db9f1cf None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:50.367596 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14200925-6a6e-4668-af3a-1ee679d499f2 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:50.376766 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-7c99d7d1-1781-4add-bf8f-52554db9f1cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:50.376766 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:50.376766 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:50.376766 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:50.376766 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:50.376766 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:50.376766 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:50.376766 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:50.376766 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:50.376766 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:50.376766 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:50.376766 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:50.376766 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:05:50.376766 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:05:50.376766 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:05:50.377588 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:05:50.377588 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:50.377588 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:50.377588 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:50.377588 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:50.377588 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:50.377588 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:50.377588 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:50.377588 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:50.377588 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:50.377588 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:50.377588 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:50.377588 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:50.377588 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:50.377588 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:50.377588 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:50.377588 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:50.378716 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:05:50.378716 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:05:50.378716 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:50.378716 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:50.378716 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 258/512] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:05:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:50.379720 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99d7d1-1781-4add-bf8f-52554db9f1cf None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:50.402584 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32c17c-f515-4afa-afbf-6ee4989de7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:50.403373 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32c17c-f515-4afa-afbf-6ee4989de7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:50.403660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32c17c-f515-4afa-afbf-6ee4989de7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:50.403934 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32c17c-f515-4afa-afbf-6ee4989de7b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:50.410451 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32c17c-f515-4afa-afbf-6ee4989de7b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:50.411907 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32c17c-f515-4afa-afbf-6ee4989de7b6 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:50.419499 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:50.427511 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-ef32c17c-f515-4afa-afbf-6ee4989de7b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:05:50.427511 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:50.427511 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:50.427511 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:50.427511 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:50.427511 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:50.427511 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:50.427511 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:50.427511 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:50.427511 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:50.427511 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:50.427511 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:50.427511 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:05:50.427511 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:05:50.427511 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:05:50.430181 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:05:50.430181 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:50.430181 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:50.430181 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:50.430181 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:50.430181 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:50.430181 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:50.430181 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:50.430181 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:50.430181 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:50.430181 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:50.430181 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:50.430181 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:50.430181 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:50.430181 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:50.430181 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:50.430181 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:50.431009 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:05:50.431009 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:05:50.431009 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:05:50.431009 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:05:50.431009 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:05:50.431009 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:05:50.431009 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:05:50.431009 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:50.431009 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 255/513] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:05:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:50.431009 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32c17c-f515-4afa-afbf-6ee4989de7b6 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:50.478778 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99d7d1-1781-4add-bf8f-52554db9f1cf None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:50.512169 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7382c-421f-4cd8-80ff-1743a018e120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:50.512818 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7382c-421f-4cd8-80ff-1743a018e120 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:50.513102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7382c-421f-4cd8-80ff-1743a018e120 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:50.513387 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7382c-421f-4cd8-80ff-1743a018e120 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:50.531121 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32c17c-f515-4afa-afbf-6ee4989de7b6 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:50.544602 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:50.566157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ec322-e6a5-4387-a41e-7d845b9a8470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:50.566930 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ec322-e6a5-4387-a41e-7d845b9a8470 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:50.567219 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ec322-e6a5-4387-a41e-7d845b9a8470 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:50.567493 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ec322-e6a5-4387-a41e-7d845b9a8470 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:50.577489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ec322-e6a5-4387-a41e-7d845b9a8470 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:50.578975 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ec322-e6a5-4387-a41e-7d845b9a8470 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:50.579632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7382c-421f-4cd8-80ff-1743a018e120 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:50.581097 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7382c-421f-4cd8-80ff-1743a018e120 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:50.596524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-6e1ec322-e6a5-4387-a41e-7d845b9a8470 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:50.596524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:50.596524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:50.596524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:50.596524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:50.596524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:50.596524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:50.596524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:50.596524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:50.596524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:50.596524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:50.596524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:50.596524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:05:50.596524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:05:50.596524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:05:50.597430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:05:50.597430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:50.597430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:50.597430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:50.597430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:50.597430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:50.597430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:50.597430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:50.597430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:50.597430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:50.597430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:50.597430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:50.597430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:50.597430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:50.597430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:50.597430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:50.597430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:50.599122 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:05:50.599122 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:05:50.599122 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:50.599122 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:50.599122 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 256/514] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:05:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:50.599388 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ec322-e6a5-4387-a41e-7d845b9a8470 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:50.622737 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:50.679279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 259/515] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:05:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:05:50.680098 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7382c-421f-4cd8-80ff-1743a018e120 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:50.703256 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ec322-e6a5-4387-a41e-7d845b9a8470 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:50.742126 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0ac82-4f85-4b6e-abec-d869db92f7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:50.742126 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0ac82-4f85-4b6e-abec-d869db92f7a5 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:50.742126 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0ac82-4f85-4b6e-abec-d869db92f7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:50.742126 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0ac82-4f85-4b6e-abec-d869db92f7a5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:50.745285 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0ac82-4f85-4b6e-abec-d869db92f7a5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:50.746803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0ac82-4f85-4b6e-abec-d869db92f7a5 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:50.763271 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-13b0ac82-4f85-4b6e-abec-d869db92f7a5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 11:05:50.763271 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:50.763271 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:50.763271 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:50.763271 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:50.763271 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:50.763271 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:50.763271 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:50.763271 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:50.763271 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:50.763271 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:50.763271 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:50.763271 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:05:50.763271 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:05:50.763271 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:05:50.763271 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:05:50.764300 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:50.764300 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:50.764300 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:05:50.764300 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:05:50.764300 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:05:50.764300 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:05:50.764300 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:50.764300 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:50.764300 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:50.764300 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:50.764300 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:50.764300 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:50.764300 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:50.764300 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:50.764300 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:50.764300 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:50.764300 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:50.764300 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:50.765388 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:50.765388 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:50.765388 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:05:50.765388 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:05:50.765388 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:05:50.765388 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:05:50.765388 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:05:50.765388 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:05:50.765388 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 11:05:50.765388 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:50.768559 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 257/516] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jul 11 11:05:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:50.769347 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0ac82-4f85-4b6e-abec-d869db92f7a5 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:50.778618 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7382c-421f-4cd8-80ff-1743a018e120 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:50.798466 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:50.812850 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2cfb1-2b49-45db-959b-dc5eaec39921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:50.813517 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2cfb1-2b49-45db-959b-dc5eaec39921 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:50.813825 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2cfb1-2b49-45db-959b-dc5eaec39921 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:50.814105 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2cfb1-2b49-45db-959b-dc5eaec39921 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:50.814822 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2cfb1-2b49-45db-959b-dc5eaec39921 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:50.815131 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2cfb1-2b49-45db-959b-dc5eaec39921 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:50.816605 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2cfb1-2b49-45db-959b-dc5eaec39921 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:50.824815 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:50.828901 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 260/517] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:50.829740 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2cfb1-2b49-45db-959b-dc5eaec39921 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:50.873028 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0ac82-4f85-4b6e-abec-d869db92f7a5 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:50.905785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d0ea5-d8a2-4e6c-8834-6024554a37f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:50.906465 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d0ea5-d8a2-4e6c-8834-6024554a37f1 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:50.906747 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d0ea5-d8a2-4e6c-8834-6024554a37f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:50.907024 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d0ea5-d8a2-4e6c-8834-6024554a37f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:50.907815 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d0ea5-d8a2-4e6c-8834-6024554a37f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:50.908123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d0ea5-d8a2-4e6c-8834-6024554a37f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:50.909561 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d0ea5-d8a2-4e6c-8834-6024554a37f1 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:50.927083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 258/518] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:05:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:50.927875 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d0ea5-d8a2-4e6c-8834-6024554a37f1 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:50.929475 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2cfb1-2b49-45db-959b-dc5eaec39921 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:50.963935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7641b4-73fa-4020-aec2-d6344c09d240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:50.964603 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7641b4-73fa-4020-aec2-d6344c09d240 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:50.964889 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7641b4-73fa-4020-aec2-d6344c09d240 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:50.965176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7641b4-73fa-4020-aec2-d6344c09d240 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:50.965935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7641b4-73fa-4020-aec2-d6344c09d240 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:50.966253 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7641b4-73fa-4020-aec2-d6344c09d240 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:50.967610 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7641b4-73fa-4020-aec2-d6344c09d240 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:50.979587 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 261/519] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:50.980371 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7641b4-73fa-4020-aec2-d6344c09d240 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:51.015673 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:51.031872 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d0ea5-d8a2-4e6c-8834-6024554a37f1 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:51.037216 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:51.065379 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b14a8-b08a-4f0f-b286-410e7e3be00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:51.066221 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b14a8-b08a-4f0f-b286-410e7e3be00f None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:51.066659 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b14a8-b08a-4f0f-b286-410e7e3be00f None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:51.066933 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b14a8-b08a-4f0f-b286-410e7e3be00f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:51.076147 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7641b4-73fa-4020-aec2-d6344c09d240 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:51.076635 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b14a8-b08a-4f0f-b286-410e7e3be00f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:51.078124 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b14a8-b08a-4f0f-b286-410e7e3be00f None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:51.095771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-2e6b14a8-b08a-4f0f-b286-410e7e3be00f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:51.095771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:51.095771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:51.095771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:51.095771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:51.095771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:51.095771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:51.095771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:51.095771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:51.095771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:51.095771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:51.095771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:51.095771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:05:51.095771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:05:51.095771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:05:51.096625 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:05:51.096625 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:51.096625 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:51.096625 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:51.096625 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:51.096625 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:51.096625 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:51.096625 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:51.096625 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:51.096625 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:51.096625 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:51.096625 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:51.096625 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:51.096625 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:51.096625 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:51.096625 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:51.096625 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:51.097473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:05:51.097473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:05:51.097473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:51.097473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:51.097473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 259/520] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:05:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:51.099158 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b14a8-b08a-4f0f-b286-410e7e3be00f None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:51.113000 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4235f7-7801-4e82-988a-75a446f0bd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:51.114431 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4235f7-7801-4e82-988a-75a446f0bd42 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:51.114714 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4235f7-7801-4e82-988a-75a446f0bd42 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:51.114985 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4235f7-7801-4e82-988a-75a446f0bd42 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:51.115814 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4235f7-7801-4e82-988a-75a446f0bd42 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:51.116123 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4235f7-7801-4e82-988a-75a446f0bd42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:51.117610 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4235f7-7801-4e82-988a-75a446f0bd42 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:51.134245 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 262/521] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Jul 11 11:05:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:51.135024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4235f7-7801-4e82-988a-75a446f0bd42 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:51.197066 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b14a8-b08a-4f0f-b286-410e7e3be00f None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:51.230211 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132b97b-1946-4a0d-a061-40057ee6c15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:51.230992 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132b97b-1946-4a0d-a061-40057ee6c15d None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:51.231276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132b97b-1946-4a0d-a061-40057ee6c15d None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:51.231553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132b97b-1946-4a0d-a061-40057ee6c15d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:51.232389 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4235f7-7801-4e82-988a-75a446f0bd42 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:51.234268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:51.241862 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132b97b-1946-4a0d-a061-40057ee6c15d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:51.243316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132b97b-1946-4a0d-a061-40057ee6c15d None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:51.249921 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:51.257433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-9132b97b-1946-4a0d-a061-40057ee6c15d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 11:05:51.257433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:51.257433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:51.257433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:51.257433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:51.257433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:51.257433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:51.257433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:51.257433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:51.257433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:51.257433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:51.257433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:51.257433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:05:51.257433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:05:51.257433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:05:51.257433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:05:51.262594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:51.262594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:51.262594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:05:51.262594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:05:51.262594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:05:51.262594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:05:51.262594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:51.262594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:51.262594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:51.262594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:51.262594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:51.262594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:51.262594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:51.262594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:51.262594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:51.262594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:51.262594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:51.262594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:51.263830 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:51.263830 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:51.263830 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:05:51.263830 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:05:51.263830 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:05:51.263830 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:05:51.263830 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:05:51.263830 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:05:51.263830 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 11:05:51.263830 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:51.263830 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 260/522] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:51.263830 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132b97b-1946-4a0d-a061-40057ee6c15d None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:51.269219 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec486f-754f-4510-a577-c3535bfe6ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:51.272746 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec486f-754f-4510-a577-c3535bfe6ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:51.273032 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec486f-754f-4510-a577-c3535bfe6ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:51.273312 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec486f-754f-4510-a577-c3535bfe6ec1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:51.274209 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec486f-754f-4510-a577-c3535bfe6ec1 None admin] RBAC: Adding query filter params (role.id=9b682db1e9a5486884a74f5c01953fe7, scope.project.id=38ed7416526e473b816330e24acf7a04, user.id=5b9e7594afc346e593ef3e6c579e237b) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:51.274523 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec486f-754f-4510-a577-c3535bfe6ec1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:51.275959 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec486f-754f-4510-a577-c3535bfe6ec1 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:51.281511 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 263/523] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:05:51 2022] GET /identity/v3/role_assignments?user.id=5b9e7594afc346e593ef3e6c579e237b&scope.project.id=38ed7416526e473b816330e24acf7a04&role.id=9b682db1e9a5486884a74f5c01953fe7 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:51.282364 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec486f-754f-4510-a577-c3535bfe6ec1 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:51.377926 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132b97b-1946-4a0d-a061-40057ee6c15d None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:51.400208 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec486f-754f-4510-a577-c3535bfe6ec1 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:51.415774 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04a2bc-a2ab-46ac-9cb5-a7b9d7a0f4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:51.416553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04a2bc-a2ab-46ac-9cb5-a7b9d7a0f4c2 None admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:51.416904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04a2bc-a2ab-46ac-9cb5-a7b9d7a0f4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:51.417186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04a2bc-a2ab-46ac-9cb5-a7b9d7a0f4c2 None admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:51.417940 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a04a2bc-a2ab-46ac-9cb5-a7b9d7a0f4c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:51.419404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a04a2bc-a2ab-46ac-9cb5-a7b9d7a0f4c2 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:51.438615 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63337271-4d19-4e75-9d21-e4fadaafd205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:51.439294 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63337271-4d19-4e75-9d21-e4fadaafd205 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:51.439582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63337271-4d19-4e75-9d21-e4fadaafd205 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:51.439863 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63337271-4d19-4e75-9d21-e4fadaafd205 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:51.440597 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63337271-4d19-4e75-9d21-e4fadaafd205 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:51.440909 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63337271-4d19-4e75-9d21-e4fadaafd205 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:51.442435 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63337271-4d19-4e75-9d21-e4fadaafd205 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:51.455423 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 264/524] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:51.456280 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63337271-4d19-4e75-9d21-e4fadaafd205 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:51.498873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:51.539026 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 261/525] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jul 11 11:05:51 2022] POST /identity/v3/users => generated 247 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:05:51.541885 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04a2bc-a2ab-46ac-9cb5-a7b9d7a0f4c2 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:51.572333 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63337271-4d19-4e75-9d21-e4fadaafd205 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:51.615940 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:51.634318 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e25c9d-8ae7-4dd2-9b4b-e0c5093f0fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:51.636144 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e25c9d-8ae7-4dd2-9b4b-e0c5093f0fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:51.636669 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e25c9d-8ae7-4dd2-9b4b-e0c5093f0fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:51.637101 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e25c9d-8ae7-4dd2-9b4b-e0c5093f0fb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:51.681147 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04a2bc-a2ab-46ac-9cb5-a7b9d7a0f4c2 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:51.725146 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c812dd1-984d-408c-9a00-49c08cb08284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:51.726505 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c812dd1-984d-408c-9a00-49c08cb08284 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:51.726505 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c812dd1-984d-408c-9a00-49c08cb08284 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:51.726689 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c812dd1-984d-408c-9a00-49c08cb08284 None admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:51.727590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c812dd1-984d-408c-9a00-49c08cb08284 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:51.727909 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c812dd1-984d-408c-9a00-49c08cb08284 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:51.729419 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c812dd1-984d-408c-9a00-49c08cb08284 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:51.737797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e25c9d-8ae7-4dd2-9b4b-e0c5093f0fb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:51.740289 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e25c9d-8ae7-4dd2-9b4b-e0c5093f0fb0 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:51.776369 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 262/526] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Jul 11 11:05:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:51.777049 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c812dd1-984d-408c-9a00-49c08cb08284 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:51.789293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:51.865648 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 265/527] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:05:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:05:51.867270 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e25c9d-8ae7-4dd2-9b4b-e0c5093f0fb0 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:51.907540 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c812dd1-984d-408c-9a00-49c08cb08284 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:51.919985 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:51.945510 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ffb307-6f9d-440b-a1e9-5d5f479d5729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:51.946787 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffb307-6f9d-440b-a1e9-5d5f479d5729 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:51.947237 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffb307-6f9d-440b-a1e9-5d5f479d5729 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:51.947666 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffb307-6f9d-440b-a1e9-5d5f479d5729 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:51.955845 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ffb307-6f9d-440b-a1e9-5d5f479d5729 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:51.958427 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ffb307-6f9d-440b-a1e9-5d5f479d5729 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:51.974330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-b5ffb307-6f9d-440b-a1e9-5d5f479d5729 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:05:51.974330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:51.974330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:51.974330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:51.974330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:51.974330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:51.974330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:51.974330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:51.974330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:51.974330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:51.974330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:51.974330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:51.974330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:05:51.974330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:05:51.974330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:05:51.975368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:05:51.975368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:51.975368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:51.975368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:51.975368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:51.975368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:51.975368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:51.975368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:51.975368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:51.975368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:51.975368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:51.975368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:51.975368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:51.975368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:51.975368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:51.975368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:51.975368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:51.976406 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:05:51.976406 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:05:51.976406 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:05:51.976406 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:05:51.976406 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:05:51.976406 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:05:51.976406 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:05:51.976406 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:51.978526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 263/528] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:05:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:51.979689 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ffb307-6f9d-440b-a1e9-5d5f479d5729 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:51.991798 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e25c9d-8ae7-4dd2-9b4b-e0c5093f0fb0 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:52.032470 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a7e32-19a1-4a00-b53c-6fa3eb43a708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:52.033267 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a7e32-19a1-4a00-b53c-6fa3eb43a708 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:52.033550 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a7e32-19a1-4a00-b53c-6fa3eb43a708 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:52.034146 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a7e32-19a1-4a00-b53c-6fa3eb43a708 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:52.047509 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:52.094002 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ffb307-6f9d-440b-a1e9-5d5f479d5729 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:52.106467 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a7e32-19a1-4a00-b53c-6fa3eb43a708 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:52.107877 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a7e32-19a1-4a00-b53c-6fa3eb43a708 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:52.131934 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49476dc-0ca5-4884-afa5-4ab3a259f25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:52.133096 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49476dc-0ca5-4884-afa5-4ab3a259f25d None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:52.133589 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49476dc-0ca5-4884-afa5-4ab3a259f25d None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:52.134047 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49476dc-0ca5-4884-afa5-4ab3a259f25d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:52.147872 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49476dc-0ca5-4884-afa5-4ab3a259f25d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:52.149720 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49476dc-0ca5-4884-afa5-4ab3a259f25d None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:52.169031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-f49476dc-0ca5-4884-afa5-4ab3a259f25d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:52.169031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:52.169031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:52.169031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:52.169031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:52.169031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:52.169031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:52.169031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:52.169031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:52.169031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:52.169031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:52.169031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:52.169031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:05:52.169031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:05:52.169031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:05:52.170130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:05:52.170130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:52.170130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:52.170130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:52.170130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:52.170130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:52.170130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:52.170130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:52.170130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:52.170130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:52.170130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:52.170130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:52.170130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:52.170130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:52.170130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:52.170130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:52.170130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:52.171153 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:05:52.171153 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:05:52.171153 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:52.171153 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:52.178047 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 264/529] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:52.179172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49476dc-0ca5-4884-afa5-4ab3a259f25d None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:52.206250 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:52.213202 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 266/530] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:05:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:05:52.214153 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a7e32-19a1-4a00-b53c-6fa3eb43a708 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:52.259478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:52.291183 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49476dc-0ca5-4884-afa5-4ab3a259f25d None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:52.319552 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a7e32-19a1-4a00-b53c-6fa3eb43a708 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:52.330091 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc499b09-c167-4191-8fa2-6d554f08df37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:52.330988 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc499b09-c167-4191-8fa2-6d554f08df37 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:52.331473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc499b09-c167-4191-8fa2-6d554f08df37 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:52.331941 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc499b09-c167-4191-8fa2-6d554f08df37 None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:52.333037 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc499b09-c167-4191-8fa2-6d554f08df37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:52.333523 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc499b09-c167-4191-8fa2-6d554f08df37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:52.335313 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc499b09-c167-4191-8fa2-6d554f08df37 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:52.349543 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 265/531] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:05:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:52.350605 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc499b09-c167-4191-8fa2-6d554f08df37 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:52.361214 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5d39c-d78d-4066-b27d-42c7fe9e68f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:52.361718 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5d39c-d78d-4066-b27d-42c7fe9e68f5 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:52.362034 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5d39c-d78d-4066-b27d-42c7fe9e68f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:52.362308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5d39c-d78d-4066-b27d-42c7fe9e68f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:52.363039 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5d39c-d78d-4066-b27d-42c7fe9e68f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:52.363542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5d39c-d78d-4066-b27d-42c7fe9e68f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:52.365018 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5d39c-d78d-4066-b27d-42c7fe9e68f5 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:52.382233 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 267/532] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:52.382233 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5d39c-d78d-4066-b27d-42c7fe9e68f5 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:52.454812 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:52.475410 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc499b09-c167-4191-8fa2-6d554f08df37 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:52.489590 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5d39c-d78d-4066-b27d-42c7fe9e68f5 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:52.492169 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:52.514091 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6af91-0f14-4b68-bd5f-40cec70eb437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:52.515102 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6af91-0f14-4b68-bd5f-40cec70eb437 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:52.515525 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6af91-0f14-4b68-bd5f-40cec70eb437 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:52.515973 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6af91-0f14-4b68-bd5f-40cec70eb437 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:52.526658 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374086ee-c8bc-45df-b171-dc2ee76b9537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:52.527382 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374086ee-c8bc-45df-b171-dc2ee76b9537 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:52.528015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374086ee-c8bc-45df-b171-dc2ee76b9537 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:52.528599 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374086ee-c8bc-45df-b171-dc2ee76b9537 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:52.529024 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6af91-0f14-4b68-bd5f-40cec70eb437 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:52.529701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374086ee-c8bc-45df-b171-dc2ee76b9537 None admin] RBAC: Adding query filter params (role.id=9b682db1e9a5486884a74f5c01953fe7, scope.project.id=38ed7416526e473b816330e24acf7a04, user.id=65a2d8d24562459493a3bcd399665a6b) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:52.530452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374086ee-c8bc-45df-b171-dc2ee76b9537 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:52.531322 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6af91-0f14-4b68-bd5f-40cec70eb437 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:52.532035 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374086ee-c8bc-45df-b171-dc2ee76b9537 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:52.545861 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 268/533] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:05:52 2022] GET /identity/v3/role_assignments?user.id=65a2d8d24562459493a3bcd399665a6b&scope.project.id=38ed7416526e473b816330e24acf7a04&role.id=9b682db1e9a5486884a74f5c01953fe7 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:52.547043 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374086ee-c8bc-45df-b171-dc2ee76b9537 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:52.552187 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-f1e6af91-0f14-4b68-bd5f-40cec70eb437 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:52.552187 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:52.552187 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:52.552187 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:52.552187 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:52.552187 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:52.552187 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:52.552187 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:52.552187 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:52.552187 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:52.552187 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:52.552187 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:52.552187 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:05:52.552187 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:05:52.552187 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:05:52.553174 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:05:52.553174 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:52.553174 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:52.553174 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:52.553174 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:52.553174 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:52.553174 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:52.553174 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:52.553174 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:52.553174 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:52.553174 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:52.553174 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:52.553174 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:52.553174 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:52.553174 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:52.553174 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:52.553174 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:52.554251 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:05:52.554251 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:05:52.554251 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:52.554251 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:52.556189 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 266/534] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:05:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:52.561786 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6af91-0f14-4b68-bd5f-40cec70eb437 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:52.745345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6af91-0f14-4b68-bd5f-40cec70eb437 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:52.752355 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374086ee-c8bc-45df-b171-dc2ee76b9537 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:52.787781 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcebd6-9fbd-4526-bd3a-332c03b396b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:52.791272 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcebd6-9fbd-4526-bd3a-332c03b396b0 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:52.791272 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcebd6-9fbd-4526-bd3a-332c03b396b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:52.791272 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcebd6-9fbd-4526-bd3a-332c03b396b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:52.791272 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfcebd6-9fbd-4526-bd3a-332c03b396b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:52.791272 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfcebd6-9fbd-4526-bd3a-332c03b396b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:52.792685 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfcebd6-9fbd-4526-bd3a-332c03b396b0 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:52.793379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86388a-707a-41f6-99bd-7484c11532c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:52.794235 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86388a-707a-41f6-99bd-7484c11532c0 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:52.794562 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:52.795280 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86388a-707a-41f6-99bd-7484c11532c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:52.795541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86388a-707a-41f6-99bd-7484c11532c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:52.806096 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86388a-707a-41f6-99bd-7484c11532c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:52.807548 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86388a-707a-41f6-99bd-7484c11532c0 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:52.809118 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 267/535] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:52.814638 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcebd6-9fbd-4526-bd3a-332c03b396b0 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:52.839794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-8a86388a-707a-41f6-99bd-7484c11532c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:05:52.839794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:52.839794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:52.839794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:52.839794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:52.839794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:52.839794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:52.839794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:52.839794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:52.839794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:52.839794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:52.839794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:52.839794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:05:52.839794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:05:52.839794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:05:52.840797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:05:52.840797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:52.840797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:52.840797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:52.840797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:52.840797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:52.840797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:52.840797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:52.840797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:52.840797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:52.840797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:52.840797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:52.840797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:52.840797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:52.840797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:52.840797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:52.840797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:52.841627 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:05:52.841627 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:05:52.841627 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:05:52.841627 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:05:52.841627 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:05:52.841627 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:05:52.841627 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:05:52.841627 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:52.851126 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 269/536] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:05:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:52.859732 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86388a-707a-41f6-99bd-7484c11532c0 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:52.915041 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:52.931051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcebd6-9fbd-4526-bd3a-332c03b396b0 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:52.968480 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667943da-83b3-4e21-8e6f-4b0d4da126c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:52.969348 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667943da-83b3-4e21-8e6f-4b0d4da126c6 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:52.969643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667943da-83b3-4e21-8e6f-4b0d4da126c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:52.969997 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667943da-83b3-4e21-8e6f-4b0d4da126c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:52.978168 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667943da-83b3-4e21-8e6f-4b0d4da126c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:52.979638 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667943da-83b3-4e21-8e6f-4b0d4da126c6 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:52.995525 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-667943da-83b3-4e21-8e6f-4b0d4da126c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:05:52.995525 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:52.995525 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:52.995525 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:52.995525 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:52.995525 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:52.995525 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:52.995525 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:52.995525 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:52.995525 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:52.995525 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:52.995525 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:52.995525 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:05:52.995525 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:05:52.995525 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:05:52.996391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:05:52.996391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:52.996391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:52.996391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:52.996391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:52.996391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:52.996391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:52.996391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:52.996391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:52.996391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:52.996391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:52.996391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:52.996391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:52.996391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:52.996391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:52.996391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:52.996391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:52.997240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:05:52.997240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:05:52.997240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:05:52.997240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:05:52.997240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:05:52.997240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:05:52.997240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:05:52.997240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:52.997240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 268/537] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:05:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:53.006761 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667943da-83b3-4e21-8e6f-4b0d4da126c6 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:53.049385 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86388a-707a-41f6-99bd-7484c11532c0 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:53.073859 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:53.116007 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918753a-68ae-4665-8768-17d5a85f19e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:53.117141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918753a-68ae-4665-8768-17d5a85f19e5 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:53.117645 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918753a-68ae-4665-8768-17d5a85f19e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:53.118209 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918753a-68ae-4665-8768-17d5a85f19e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:53.119192 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918753a-68ae-4665-8768-17d5a85f19e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:53.119694 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918753a-68ae-4665-8768-17d5a85f19e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:53.120824 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667943da-83b3-4e21-8e6f-4b0d4da126c6 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:53.121573 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918753a-68ae-4665-8768-17d5a85f19e5 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:53.155283 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d173c9a-aeac-4eb8-9fd9-e9e0be4076a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:53.155958 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d173c9a-aeac-4eb8-9fd9-e9e0be4076a5 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:53.156249 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d173c9a-aeac-4eb8-9fd9-e9e0be4076a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:53.156534 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d173c9a-aeac-4eb8-9fd9-e9e0be4076a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:53.157341 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d173c9a-aeac-4eb8-9fd9-e9e0be4076a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:53.157648 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d173c9a-aeac-4eb8-9fd9-e9e0be4076a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:53.159156 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d173c9a-aeac-4eb8-9fd9-e9e0be4076a5 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:53.162276 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 270/538] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:05:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:53.168380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918753a-68ae-4665-8768-17d5a85f19e5 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:53.173376 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 269/539] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:05:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:53.178864 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d173c9a-aeac-4eb8-9fd9-e9e0be4076a5 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:53.298259 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:53.310465 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918753a-68ae-4665-8768-17d5a85f19e5 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:53.348242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e40b1f-a7cb-4d3c-beda-69ea0dff218a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:53.349046 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e40b1f-a7cb-4d3c-beda-69ea0dff218a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:53.349345 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e40b1f-a7cb-4d3c-beda-69ea0dff218a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:53.349630 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e40b1f-a7cb-4d3c-beda-69ea0dff218a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:53.350642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e40b1f-a7cb-4d3c-beda-69ea0dff218a None admin] RBAC: Adding query filter params (role.id=9b682db1e9a5486884a74f5c01953fe7, scope.project.id=38ed7416526e473b816330e24acf7a04, user.id=79b8c08920b0417097bebd23344ffe64) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:53.350960 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e40b1f-a7cb-4d3c-beda-69ea0dff218a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:53.352736 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e40b1f-a7cb-4d3c-beda-69ea0dff218a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:53.359715 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 271/540] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:05:53 2022] GET /identity/v3/role_assignments?user.id=79b8c08920b0417097bebd23344ffe64&scope.project.id=38ed7416526e473b816330e24acf7a04&role.id=9b682db1e9a5486884a74f5c01953fe7 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:53.404284 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d173c9a-aeac-4eb8-9fd9-e9e0be4076a5 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:53.421033 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:53.443603 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416363d-9404-40ec-9edb-38cb8382f5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:53.444269 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416363d-9404-40ec-9edb-38cb8382f5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:53.444556 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416363d-9404-40ec-9edb-38cb8382f5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:53.444837 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416363d-9404-40ec-9edb-38cb8382f5f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:53.445683 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416363d-9404-40ec-9edb-38cb8382f5f0 None admin] RBAC: Adding query filter params (role.id=9b682db1e9a5486884a74f5c01953fe7, scope.project.id=38ed7416526e473b816330e24acf7a04, user.id=3096077887344140805ec8a23fe72f48) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:53.446074 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416363d-9404-40ec-9edb-38cb8382f5f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:53.447850 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416363d-9404-40ec-9edb-38cb8382f5f0 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:53.455319 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 270/541] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:05:53 2022] GET /identity/v3/role_assignments?user.id=3096077887344140805ec8a23fe72f48&scope.project.id=38ed7416526e473b816330e24acf7a04&role.id=9b682db1e9a5486884a74f5c01953fe7 => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:53.543440 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e229c0f-1fa4-4572-9cdd-dd3a2b2f373e None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:53.544306 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e229c0f-1fa4-4572-9cdd-dd3a2b2f373e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:53.544730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e229c0f-1fa4-4572-9cdd-dd3a2b2f373e None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:53.546681 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 272/542] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:53.553846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8719a-60d4-4cb9-ae0e-067487a478c0 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:53.554382 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8719a-60d4-4cb9-ae0e-067487a478c0 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:53.554806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8719a-60d4-4cb9-ae0e-067487a478c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:53.574322 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-67d8719a-60d4-4cb9-ae0e-067487a478c0 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:53.575836 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-67d8719a-60d4-4cb9-ae0e-067487a478c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:53.651758 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 271/543] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:53.675047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e229c0f-1fa4-4572-9cdd-dd3a2b2f373e None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:53.801756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e229c0f-1fa4-4572-9cdd-dd3a2b2f373e None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:53.846801 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29157dfc-a923-4155-9342-7f5fa3d67bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:53.848046 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29157dfc-a923-4155-9342-7f5fa3d67bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:53.848323 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29157dfc-a923-4155-9342-7f5fa3d67bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:53.848603 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29157dfc-a923-4155-9342-7f5fa3d67bb5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:53.864255 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29157dfc-a923-4155-9342-7f5fa3d67bb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:53.872266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-29157dfc-a923-4155-9342-7f5fa3d67bb5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:05:53.872266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:53.872266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:53.872266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:53.872266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:53.872266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:53.872266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:53.872266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:53.872266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:53.872266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:53.872266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:53.872266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:53.872266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:53.872266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:53.872266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:53.872266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:53.873136 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:53.873136 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:53.873136 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:53.873136 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:53.873136 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:53.873136 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:53.873136 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:53.873136 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:53.873136 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:53.873136 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:53.873136 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:53.873136 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:53.873136 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:53.873136 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:53.873136 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:53.873136 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:53.873967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:53.873967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:53.873967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:53.873967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:53.873967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:53.873967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:53.873967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:53.873967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:53.873967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:53.873967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:53.873967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:05:53.873967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:53.873967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 273/544] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jul 11 11:05:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:53.881537 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8719a-60d4-4cb9-ae0e-067487a478c0 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:54.011574 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8719a-60d4-4cb9-ae0e-067487a478c0 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:54.021297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:54.047276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461bc2a0-37ff-4b49-be00-1ceb0884f526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:54.047953 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bc2a0-37ff-4b49-be00-1ceb0884f526 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:54.048241 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bc2a0-37ff-4b49-be00-1ceb0884f526 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:54.048522 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bc2a0-37ff-4b49-be00-1ceb0884f526 None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:54.049282 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461bc2a0-37ff-4b49-be00-1ceb0884f526 None admin] RBAC: Adding query filter params (name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:54.049595 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461bc2a0-37ff-4b49-be00-1ceb0884f526 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:54.051267 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461bc2a0-37ff-4b49-be00-1ceb0884f526 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:54.060181 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 272/545] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jul 11 11:05:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:54.065683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29157dfc-a923-4155-9342-7f5fa3d67bb5 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:54.082675 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:54.086078 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8721a0-20d9-4eb1-ae0f-cb6b05aaa767 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:54.086374 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8721a0-20d9-4eb1-ae0f-cb6b05aaa767 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:54.086656 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8721a0-20d9-4eb1-ae0f-cb6b05aaa767 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:54.088761 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 273/546] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:54.099721 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94885a1c-fd04-4d2e-9b36-bb35b42f4fda None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:54.099958 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94885a1c-fd04-4d2e-9b36-bb35b42f4fda None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:54.100233 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94885a1c-fd04-4d2e-9b36-bb35b42f4fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:54.132941 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-94885a1c-fd04-4d2e-9b36-bb35b42f4fda None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:54.135341 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-94885a1c-fd04-4d2e-9b36-bb35b42f4fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:54.233259 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29157dfc-a923-4155-9342-7f5fa3d67bb5 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:54.260084 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 274/547] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:05:54.285345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94885a1c-fd04-4d2e-9b36-bb35b42f4fda None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:54.301451 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae599ed-f065-4117-a39c-c3ec3d6dd1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:54.302404 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae599ed-f065-4117-a39c-c3ec3d6dd1dd None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:54.302691 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae599ed-f065-4117-a39c-c3ec3d6dd1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:54.303026 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae599ed-f065-4117-a39c-c3ec3d6dd1dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:54.324675 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae599ed-f065-4117-a39c-c3ec3d6dd1dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:54.327137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae599ed-f065-4117-a39c-c3ec3d6dd1dd None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:54.362582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-5ae599ed-f065-4117-a39c-c3ec3d6dd1dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:54.362582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:54.362582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:54.362582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:54.362582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:54.362582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:54.362582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:54.362582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:54.362582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:54.362582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:54.362582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:54.362582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:54.362582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:05:54.362582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:05:54.362582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:05:54.364098 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:05:54.364098 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:54.364098 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:54.364098 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:54.364098 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:54.364098 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:54.364098 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:54.364098 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:54.364098 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:54.364098 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:54.364098 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:54.364098 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:54.364098 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:54.364098 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:54.364098 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:54.364098 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:54.364098 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:54.365417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:05:54.365417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:05:54.365417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:54.365417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:54.370808 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 274/548] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:05:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:05:54.375887 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae599ed-f065-4117-a39c-c3ec3d6dd1dd None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:54.447658 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:54.484506 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae599ed-f065-4117-a39c-c3ec3d6dd1dd None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:54.487770 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94885a1c-fd04-4d2e-9b36-bb35b42f4fda None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:54.494110 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:54.520651 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478b505-8f0d-42c3-b7bd-156ca0e3fa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:54.521652 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478b505-8f0d-42c3-b7bd-156ca0e3fa46 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:54.522179 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478b505-8f0d-42c3-b7bd-156ca0e3fa46 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:54.522737 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478b505-8f0d-42c3-b7bd-156ca0e3fa46 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:54.523667 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478b505-8f0d-42c3-b7bd-156ca0e3fa46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:54.524251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478b505-8f0d-42c3-b7bd-156ca0e3fa46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:54.525876 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478b505-8f0d-42c3-b7bd-156ca0e3fa46 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:54.539922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 275/549] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:54.545507 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478b505-8f0d-42c3-b7bd-156ca0e3fa46 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:54.565407 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecb921-bdbc-4ef7-89b7-4bf9ecbb718a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:54.567084 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecb921-bdbc-4ef7-89b7-4bf9ecbb718a None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:54.567740 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecb921-bdbc-4ef7-89b7-4bf9ecbb718a None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:54.568211 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecb921-bdbc-4ef7-89b7-4bf9ecbb718a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:54.591834 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ecb921-bdbc-4ef7-89b7-4bf9ecbb718a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:54.603722 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-f9ecb921-bdbc-4ef7-89b7-4bf9ecbb718a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:05:54.603722 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:54.603722 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:54.603722 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:54.603722 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:54.603722 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:54.603722 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:54.603722 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:54.603722 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:54.603722 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:54.603722 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:54.603722 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:54.603722 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:54.603722 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:54.603722 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:54.603722 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:54.604612 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:54.604612 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:54.604612 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:54.604612 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:54.604612 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:54.604612 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:54.604612 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:54.604612 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:54.604612 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:54.604612 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:54.604612 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:54.604612 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:54.604612 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:54.604612 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:54.604612 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:54.604612 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:54.605411 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:54.605411 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:54.605411 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:54.605411 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:54.605411 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:54.605411 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:54.605411 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:54.605411 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:54.605411 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:54.605411 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:54.605411 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:05:54.605411 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:54.608406 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 275/550] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jul 11 11:05:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:54.614765 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecb921-bdbc-4ef7-89b7-4bf9ecbb718a None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:54.773912 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478b505-8f0d-42c3-b7bd-156ca0e3fa46 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:54.775809 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecb921-bdbc-4ef7-89b7-4bf9ecbb718a None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:54.816417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:54.836804 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6567b8-772a-48ba-af91-3bed4420ea77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:54.837603 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6567b8-772a-48ba-af91-3bed4420ea77 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:54.838513 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6567b8-772a-48ba-af91-3bed4420ea77 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:54.839014 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6567b8-772a-48ba-af91-3bed4420ea77 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:54.846422 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27842b3-186d-4af9-a034-ed310064056f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:54.847086 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27842b3-186d-4af9-a034-ed310064056f None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:54.847369 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27842b3-186d-4af9-a034-ed310064056f None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:54.847780 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27842b3-186d-4af9-a034-ed310064056f None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:54.848529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27842b3-186d-4af9-a034-ed310064056f None admin] RBAC: Adding query filter params (name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:54.851730 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27842b3-186d-4af9-a034-ed310064056f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:54.853147 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27842b3-186d-4af9-a034-ed310064056f None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:54.855533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6567b8-772a-48ba-af91-3bed4420ea77 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:54.857018 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6567b8-772a-48ba-af91-3bed4420ea77 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:54.874415 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 276/551] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jul 11 11:05:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:54.875546 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27842b3-186d-4af9-a034-ed310064056f None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:54.888392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-ec6567b8-772a-48ba-af91-3bed4420ea77 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 11:05:54.888392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:54.888392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:54.888392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:54.888392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:54.888392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:54.888392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:54.888392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:54.888392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:54.888392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:54.888392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:54.888392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:54.888392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:05:54.888392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:05:54.888392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:05:54.888392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:05:54.889541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:54.889541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:54.889541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:05:54.889541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:05:54.889541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:05:54.889541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:05:54.889541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:54.889541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:54.889541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:54.889541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:54.889541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:54.889541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:54.889541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:54.889541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:54.889541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:54.889541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:54.889541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:54.889541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:54.890774 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:54.890774 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:54.890774 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:05:54.890774 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:05:54.890774 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:05:54.890774 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:05:54.890774 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:05:54.890774 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:05:54.890774 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 11:05:54.890774 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:54.895192 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 276/552] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Jul 11 11:05:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:54.904087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6567b8-772a-48ba-af91-3bed4420ea77 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:54.934118 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:55.048982 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6567b8-772a-48ba-af91-3bed4420ea77 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:55.085932 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454a3c1-2425-421c-b53c-e2662bd43710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:55.086610 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454a3c1-2425-421c-b53c-e2662bd43710 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:55.086894 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454a3c1-2425-421c-b53c-e2662bd43710 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:55.087173 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454a3c1-2425-421c-b53c-e2662bd43710 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:55.087382 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27842b3-186d-4af9-a034-ed310064056f None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:55.088013 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454a3c1-2425-421c-b53c-e2662bd43710 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:55.088323 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454a3c1-2425-421c-b53c-e2662bd43710 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:55.089780 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454a3c1-2425-421c-b53c-e2662bd43710 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:55.109100 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 277/553] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Jul 11 11:05:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:55.110432 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7583381-2d59-461a-b30c-038d8577b0ed None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:55.110726 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7583381-2d59-461a-b30c-038d8577b0ed None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:55.111000 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7583381-2d59-461a-b30c-038d8577b0ed None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:55.121280 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 278/554] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:55.121280 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7583381-2d59-461a-b30c-038d8577b0ed None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:55.133902 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d42c3c-1789-48bb-afae-c7f583290f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:55.134960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d42c3c-1789-48bb-afae-c7f583290f10 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:55.135418 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d42c3c-1789-48bb-afae-c7f583290f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:55.135843 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d42c3c-1789-48bb-afae-c7f583290f10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:55.147074 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d42c3c-1789-48bb-afae-c7f583290f10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:55.148813 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d42c3c-1789-48bb-afae-c7f583290f10 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:55.161892 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:55.168037 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-07d42c3c-1789-48bb-afae-c7f583290f10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:55.168037 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:55.168037 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:55.168037 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:55.168037 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:55.168037 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:55.168037 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:55.168037 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:55.168037 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:55.168037 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:55.168037 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:55.168037 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:55.168037 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:05:55.168037 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:05:55.168037 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:05:55.185046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:05:55.185046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:55.185046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:55.185046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:55.185046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:55.185046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:55.185046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:55.185046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:55.185046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:55.185046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:55.185046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:55.185046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:55.185046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:55.185046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:55.185046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:55.185046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:55.185046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:55.186222 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:05:55.186222 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:05:55.186222 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:55.186222 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:55.186222 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 277/555] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:05:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:55.186222 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9035b-bfeb-49bd-b776-351cb872fb78 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:55.186222 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9035b-bfeb-49bd-b776-351cb872fb78 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:55.186222 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9035b-bfeb-49bd-b776-351cb872fb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:55.191906 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-cdf9035b-bfeb-49bd-b776-351cb872fb78 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:55.193308 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-cdf9035b-bfeb-49bd-b776-351cb872fb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:55.232786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7583381-2d59-461a-b30c-038d8577b0ed None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:55.277964 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a53363-296e-4a46-ac81-b6050576d5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:55.277964 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a53363-296e-4a46-ac81-b6050576d5c1 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:55.277964 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a53363-296e-4a46-ac81-b6050576d5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:55.277964 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a53363-296e-4a46-ac81-b6050576d5c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:55.278458 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 278/556] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:55.279479 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9035b-bfeb-49bd-b776-351cb872fb78 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:55.282908 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:55.289070 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a53363-296e-4a46-ac81-b6050576d5c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:55.290890 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a53363-296e-4a46-ac81-b6050576d5c1 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:55.310050 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-15a53363-296e-4a46-ac81-b6050576d5c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:55.310050 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:55.310050 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:55.310050 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:55.310050 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:55.310050 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:55.310050 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:55.310050 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:55.310050 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:55.310050 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:55.310050 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:55.310050 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:55.310050 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:05:55.310050 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:05:55.310050 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:05:55.311134 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:05:55.311134 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:55.311134 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:55.311134 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:55.311134 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:55.311134 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:55.311134 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:55.311134 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:55.311134 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:55.311134 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:55.311134 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:55.311134 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:55.311134 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:55.311134 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:55.311134 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:55.311134 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:55.311134 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:55.312637 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:05:55.312637 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:05:55.312637 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:55.312637 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:55.315975 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 279/557] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:05:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:55.322156 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a53363-296e-4a46-ac81-b6050576d5c1 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:55.390616 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9035b-bfeb-49bd-b776-351cb872fb78 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:55.424695 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:55.426031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4605ff-6fd7-405f-a676-ca84a9a63153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:55.426444 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4605ff-6fd7-405f-a676-ca84a9a63153 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:55.426730 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4605ff-6fd7-405f-a676-ca84a9a63153 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:55.427009 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4605ff-6fd7-405f-a676-ca84a9a63153 None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:55.427730 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4605ff-6fd7-405f-a676-ca84a9a63153 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:55.428041 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4605ff-6fd7-405f-a676-ca84a9a63153 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:55.429440 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4605ff-6fd7-405f-a676-ca84a9a63153 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:55.436337 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a53363-296e-4a46-ac81-b6050576d5c1 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:55.447243 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 279/558] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:55.447243 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4605ff-6fd7-405f-a676-ca84a9a63153 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:55.481537 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e6e55-093a-4b16-9b89-97779dd5819d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:55.482736 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e6e55-093a-4b16-9b89-97779dd5819d None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:55.483162 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e6e55-093a-4b16-9b89-97779dd5819d None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:55.483673 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e6e55-093a-4b16-9b89-97779dd5819d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:55.495885 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e6e55-093a-4b16-9b89-97779dd5819d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:55.504699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-6a6e6e55-093a-4b16-9b89-97779dd5819d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:05:55.504699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:55.504699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:55.504699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:55.504699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:55.504699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:55.504699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:55.504699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:55.504699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:55.504699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:55.504699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:55.504699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:55.504699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:55.504699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:55.504699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:55.504699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:55.505636 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:55.505636 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:55.505636 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:55.505636 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:55.505636 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:55.505636 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:55.505636 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:55.505636 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:55.505636 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:55.505636 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:55.505636 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:55.505636 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:55.505636 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:55.505636 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:55.505636 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:55.505636 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:55.506597 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:55.506597 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:55.506597 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:55.506597 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:55.506597 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:55.506597 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:55.506597 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:55.506597 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:55.506597 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:55.506597 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:55.506597 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:05:55.506597 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:55.509054 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 280/559] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jul 11 11:05:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:55.510105 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e6e55-093a-4b16-9b89-97779dd5819d None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:55.513174 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:55.553418 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4605ff-6fd7-405f-a676-ca84a9a63153 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:55.589713 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf3144-7cfc-4546-aa24-12a53751693d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:55.591079 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf3144-7cfc-4546-aa24-12a53751693d None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:55.591079 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf3144-7cfc-4546-aa24-12a53751693d None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:55.591079 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf3144-7cfc-4546-aa24-12a53751693d None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:55.592071 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf3144-7cfc-4546-aa24-12a53751693d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:55.592483 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf3144-7cfc-4546-aa24-12a53751693d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:55.593986 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf3144-7cfc-4546-aa24-12a53751693d None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:55.611949 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 280/560] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:55.612977 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf3144-7cfc-4546-aa24-12a53751693d None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:55.625094 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e6e55-093a-4b16-9b89-97779dd5819d None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:55.663585 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a2b44-bf63-4c86-835a-bcc290a866d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:55.664762 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a2b44-bf63-4c86-835a-bcc290a866d9 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:55.665189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a2b44-bf63-4c86-835a-bcc290a866d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:55.665605 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a2b44-bf63-4c86-835a-bcc290a866d9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:55.674493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a2b44-bf63-4c86-835a-bcc290a866d9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:55.676679 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a2b44-bf63-4c86-835a-bcc290a866d9 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:55.692791 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-af4a2b44-bf63-4c86-835a-bcc290a866d9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 11:05:55.692791 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:55.692791 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:55.692791 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:55.692791 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:55.692791 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:55.692791 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:55.692791 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:55.692791 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:55.692791 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:55.692791 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:55.692791 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:55.692791 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:05:55.692791 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:05:55.692791 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:05:55.692791 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:05:55.694042 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:55.694042 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:55.694042 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:05:55.694042 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:05:55.694042 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:05:55.694042 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:05:55.694042 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:55.694042 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:55.694042 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:55.694042 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:55.694042 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:55.694042 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:55.694042 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:55.694042 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:55.694042 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:55.694042 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:55.694042 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:55.694042 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:55.695130 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:55.695130 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:55.695130 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:05:55.695130 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:05:55.695130 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:05:55.695130 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:05:55.695130 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:05:55.695130 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:05:55.695130 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 11:05:55.695130 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:55.697150 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 281/561] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:05:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:55.698107 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a2b44-bf63-4c86-835a-bcc290a866d9 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:55.714577 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:55.719408 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf3144-7cfc-4546-aa24-12a53751693d None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:55.743690 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:55.755445 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd623a-412d-442c-b7e0-96bf61a6d631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:55.756243 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd623a-412d-442c-b7e0-96bf61a6d631 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:55.756630 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd623a-412d-442c-b7e0-96bf61a6d631 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:55.757012 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd623a-412d-442c-b7e0-96bf61a6d631 None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:55.757894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd623a-412d-442c-b7e0-96bf61a6d631 None admin] RBAC: Adding query filter params (name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:55.758307 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd623a-412d-442c-b7e0-96bf61a6d631 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:55.759847 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd623a-412d-442c-b7e0-96bf61a6d631 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:55.773165 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 281/562] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jul 11 11:05:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:55.773165 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6724b0-38ff-4eb3-8779-dadc38f82c03 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:55.773165 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6724b0-38ff-4eb3-8779-dadc38f82c03 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:55.773165 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6724b0-38ff-4eb3-8779-dadc38f82c03 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:55.773165 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 282/563] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:55.776339 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6724b0-38ff-4eb3-8779-dadc38f82c03 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:55.821516 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a2b44-bf63-4c86-835a-bcc290a866d9 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:55.856795 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8821dec-ab7f-4483-923f-d94b36a62cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:55.857592 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8821dec-ab7f-4483-923f-d94b36a62cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:55.857911 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8821dec-ab7f-4483-923f-d94b36a62cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:55.858188 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8821dec-ab7f-4483-923f-d94b36a62cf2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:55.865592 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8821dec-ab7f-4483-923f-d94b36a62cf2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:55.867063 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8821dec-ab7f-4483-923f-d94b36a62cf2 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:55.881784 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-d8821dec-ab7f-4483-923f-d94b36a62cf2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:05:55.881784 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:55.881784 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:55.881784 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:55.881784 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:55.881784 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:55.881784 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:55.881784 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:55.881784 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:55.881784 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:55.881784 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:55.881784 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:55.881784 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:05:55.881784 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:05:55.881784 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:05:55.882853 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:05:55.882853 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:55.882853 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:55.882853 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:55.882853 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:55.882853 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:55.882853 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:55.882853 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:55.882853 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:55.882853 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:55.882853 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:55.882853 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:55.882853 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:55.882853 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:55.882853 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:55.882853 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:55.882853 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:55.883835 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:05:55.883835 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:05:55.883835 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:05:55.883835 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:05:55.883835 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:05:55.883835 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:05:55.883835 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:05:55.883835 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:55.883835 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 282/564] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:05:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:55.884397 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8821dec-ab7f-4483-923f-d94b36a62cf2 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:55.890862 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6724b0-38ff-4eb3-8779-dadc38f82c03 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:55.926277 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd146c-cb65-489b-9ce5-9f0a93b28226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:55.926870 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd146c-cb65-489b-9ce5-9f0a93b28226 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:55.927154 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd146c-cb65-489b-9ce5-9f0a93b28226 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:55.927425 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd146c-cb65-489b-9ce5-9f0a93b28226 None admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:55.928252 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd146c-cb65-489b-9ce5-9f0a93b28226 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:55.928556 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd146c-cb65-489b-9ce5-9f0a93b28226 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:55.930010 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd146c-cb65-489b-9ce5-9f0a93b28226 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:55.948103 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 283/565] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Jul 11 11:05:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:55.949475 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa75c59-e8fd-4f29-afee-28383526cbdb None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:55.949774 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa75c59-e8fd-4f29-afee-28383526cbdb None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:55.950087 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa75c59-e8fd-4f29-afee-28383526cbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:55.960726 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:55.965661 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-afa75c59-e8fd-4f29-afee-28383526cbdb None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:55.966906 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-afa75c59-e8fd-4f29-afee-28383526cbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:55.991301 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8821dec-ab7f-4483-923f-d94b36a62cf2 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:56.008487 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:56.024405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382e4ba-2274-48f0-91d3-a7ce6a8455f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:56.025606 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382e4ba-2274-48f0-91d3-a7ce6a8455f8 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:56.026128 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382e4ba-2274-48f0-91d3-a7ce6a8455f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:56.026624 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382e4ba-2274-48f0-91d3-a7ce6a8455f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:56.034035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 284/566] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:56.035358 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa75c59-e8fd-4f29-afee-28383526cbdb None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:56.042254 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382e4ba-2274-48f0-91d3-a7ce6a8455f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:56.043715 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382e4ba-2274-48f0-91d3-a7ce6a8455f8 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:56.062632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-d382e4ba-2274-48f0-91d3-a7ce6a8455f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:56.062632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:56.062632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:56.062632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:56.062632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:56.062632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:56.062632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:56.062632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:56.062632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:56.062632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:56.062632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:56.062632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:56.062632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:05:56.062632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:05:56.062632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:05:56.063711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:05:56.063711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:56.063711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:56.063711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:56.063711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:56.063711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:56.063711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:56.063711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:56.063711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:56.063711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:56.063711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:56.063711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:56.063711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:56.063711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:56.063711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:56.063711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:56.063711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:56.069638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:05:56.069638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:05:56.069638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:56.069638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:56.069638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 283/567] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:05:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:56.069638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd135cd-d487-4817-98fd-4562ac3f1344 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:56.069638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd135cd-d487-4817-98fd-4562ac3f1344 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:56.069638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd135cd-d487-4817-98fd-4562ac3f1344 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:56.069638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 284/568] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:56.070272 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd135cd-d487-4817-98fd-4562ac3f1344 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:56.138355 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa75c59-e8fd-4f29-afee-28383526cbdb None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:56.169894 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd135cd-d487-4817-98fd-4562ac3f1344 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:56.172482 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aadef-99ef-4121-b52c-3ccc3ccd3187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:56.173140 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aadef-99ef-4121-b52c-3ccc3ccd3187 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:56.173423 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aadef-99ef-4121-b52c-3ccc3ccd3187 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:56.173709 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aadef-99ef-4121-b52c-3ccc3ccd3187 None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:56.174514 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46aadef-99ef-4121-b52c-3ccc3ccd3187 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:56.174827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46aadef-99ef-4121-b52c-3ccc3ccd3187 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:56.180855 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46aadef-99ef-4121-b52c-3ccc3ccd3187 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:56.188502 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 285/569] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:05:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:56.189296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aadef-99ef-4121-b52c-3ccc3ccd3187 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:56.197395 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:56.207818 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63585ec5-aac8-49ea-a58b-6cf61cd8f137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:56.208476 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63585ec5-aac8-49ea-a58b-6cf61cd8f137 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:56.208760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63585ec5-aac8-49ea-a58b-6cf61cd8f137 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:56.209066 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63585ec5-aac8-49ea-a58b-6cf61cd8f137 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:56.224276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:56.275380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63585ec5-aac8-49ea-a58b-6cf61cd8f137 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:56.276862 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63585ec5-aac8-49ea-a58b-6cf61cd8f137 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:56.287999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aadef-99ef-4121-b52c-3ccc3ccd3187 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:56.323403 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5fdb2-d9a4-4dad-9dd8-8d0d95b11ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:56.324185 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5fdb2-d9a4-4dad-9dd8-8d0d95b11ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:56.324468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5fdb2-d9a4-4dad-9dd8-8d0d95b11ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:56.324744 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5fdb2-d9a4-4dad-9dd8-8d0d95b11ca7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:56.336960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc5fdb2-d9a4-4dad-9dd8-8d0d95b11ca7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:56.344988 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-4dc5fdb2-d9a4-4dad-9dd8-8d0d95b11ca7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:05:56.344988 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:56.344988 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:56.344988 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:56.344988 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:56.344988 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:56.344988 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:56.344988 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:56.344988 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:56.344988 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:56.344988 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:56.344988 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:56.344988 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:56.344988 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:56.344988 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:56.344988 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:56.346208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:56.346208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:56.346208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:56.346208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:56.346208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:56.346208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:56.346208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:56.346208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:56.346208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:56.346208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:56.346208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:56.346208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:56.346208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:56.346208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:56.346208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:56.346208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:56.347312 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:56.347312 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:56.347312 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:56.347312 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:56.347312 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:56.347312 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:56.347312 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:56.347312 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:56.347312 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:56.347312 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:56.347312 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:05:56.347312 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:56.347312 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 286/570] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jul 11 11:05:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:56.347312 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5fdb2-d9a4-4dad-9dd8-8d0d95b11ca7 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:56.388274 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 285/571] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:05:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:05:56.389836 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a690b-d8af-4c24-b388-747a9c2a89b7 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:56.390132 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a690b-d8af-4c24-b388-747a9c2a89b7 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:56.390408 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a690b-d8af-4c24-b388-747a9c2a89b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:56.406677 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-ba1a690b-d8af-4c24-b388-747a9c2a89b7 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:56.407855 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ba1a690b-d8af-4c24-b388-747a9c2a89b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:56.424997 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:56.445364 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:56.452026 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5fdb2-d9a4-4dad-9dd8-8d0d95b11ca7 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:56.473441 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 286/572] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:56.484390 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a690b-d8af-4c24-b388-747a9c2a89b7 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:56.487132 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3654f7-334a-47f9-98d5-f8ab1852ede4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:56.487912 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3654f7-334a-47f9-98d5-f8ab1852ede4 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:56.488789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3654f7-334a-47f9-98d5-f8ab1852ede4 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:56.489198 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3654f7-334a-47f9-98d5-f8ab1852ede4 None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:56.489958 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3654f7-334a-47f9-98d5-f8ab1852ede4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:56.490275 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3654f7-334a-47f9-98d5-f8ab1852ede4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:56.491849 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3654f7-334a-47f9-98d5-f8ab1852ede4 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:56.505385 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 287/573] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:56.506305 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3654f7-334a-47f9-98d5-f8ab1852ede4 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:56.577379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a690b-d8af-4c24-b388-747a9c2a89b7 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:56.602538 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3654f7-334a-47f9-98d5-f8ab1852ede4 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:56.609632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4754b-90ff-41a8-b18d-7ca3047e7453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:56.610541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4754b-90ff-41a8-b18d-7ca3047e7453 None admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:56.610821 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4754b-90ff-41a8-b18d-7ca3047e7453 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:56.611108 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4754b-90ff-41a8-b18d-7ca3047e7453 None admin] PATH_INFO: `/v3/projects/38ed7416526e473b816330e24acf7a04/users/5b9e7594afc346e593ef3e6c579e237b/roles/9b682db1e9a5486884a74f5c01953fe7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:56.626237 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4754b-90ff-41a8-b18d-7ca3047e7453 None admin] RBAC: Authorizing `identity:create_grant(project_id=38ed7416526e473b816330e24acf7a04, user_id=5b9e7594afc346e593ef3e6c579e237b, role_id=9b682db1e9a5486884a74f5c01953fe7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:56.627686 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4754b-90ff-41a8-b18d-7ca3047e7453 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:56.636351 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a87b4d-230c-45c8-9a5f-2d333fa9e545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:56.637011 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a87b4d-230c-45c8-9a5f-2d333fa9e545 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:56.637294 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a87b4d-230c-45c8-9a5f-2d333fa9e545 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:56.637571 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a87b4d-230c-45c8-9a5f-2d333fa9e545 None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:56.638353 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a87b4d-230c-45c8-9a5f-2d333fa9e545 None admin] RBAC: Adding query filter params (name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:56.638666 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a87b4d-230c-45c8-9a5f-2d333fa9e545 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:56.640058 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a87b4d-230c-45c8-9a5f-2d333fa9e545 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:56.647896 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 288/574] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jul 11 11:05:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:56.648744 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a87b4d-230c-45c8-9a5f-2d333fa9e545 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:56.666067 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:56.714396 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 287/575] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jul 11 11:05:56 2022] PUT /identity/v3/projects/38ed7416526e473b816330e24acf7a04/users/5b9e7594afc346e593ef3e6c579e237b/roles/9b682db1e9a5486884a74f5c01953fe7 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:05:56.715149 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4754b-90ff-41a8-b18d-7ca3047e7453 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:56.731197 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:56.752586 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a87b4d-230c-45c8-9a5f-2d333fa9e545 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:56.795210 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13689cc1-8de5-4926-8121-8c3884af1b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:56.796107 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13689cc1-8de5-4926-8121-8c3884af1b2d None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:56.796396 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13689cc1-8de5-4926-8121-8c3884af1b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:56.796669 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13689cc1-8de5-4926-8121-8c3884af1b2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:56.808722 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13689cc1-8de5-4926-8121-8c3884af1b2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:56.810233 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13689cc1-8de5-4926-8121-8c3884af1b2d None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:56.830771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-13689cc1-8de5-4926-8121-8c3884af1b2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:56.830771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:56.830771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:56.830771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:56.830771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:56.830771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:56.830771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:56.830771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:56.830771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:56.830771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:56.830771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:56.830771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:56.830771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:05:56.830771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:05:56.830771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:05:56.831788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:05:56.831788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:56.831788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:56.831788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:56.831788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:56.831788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:56.831788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:56.831788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:56.831788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:56.831788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:56.831788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:56.831788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:56.831788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:56.831788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:56.831788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:56.831788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:56.831788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:56.832840 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:05:56.832840 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:05:56.832840 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:56.832840 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:56.832840 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 289/576] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:05:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:56.833120 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13689cc1-8de5-4926-8121-8c3884af1b2d None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:56.861527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4754b-90ff-41a8-b18d-7ca3047e7453 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:56.902636 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f2765-d670-4685-81c5-640fcb81f369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:56.903443 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f2765-d670-4685-81c5-640fcb81f369 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:56.903729 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f2765-d670-4685-81c5-640fcb81f369 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:56.904010 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f2765-d670-4685-81c5-640fcb81f369 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:56.910622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:56.918314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f2765-d670-4685-81c5-640fcb81f369 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:56.926493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-109f2765-d670-4685-81c5-640fcb81f369 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:05:56.926493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:56.926493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:56.926493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:56.926493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:56.926493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:56.926493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:56.926493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:56.926493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:56.926493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:56.926493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:56.926493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:56.926493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:56.926493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:56.926493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:56.926493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:56.927438 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:56.927438 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:56.927438 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:56.927438 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:56.927438 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:56.927438 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:56.927438 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:56.927438 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:56.927438 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:56.927438 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:56.927438 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:56.927438 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:56.927438 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:56.927438 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:56.927438 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:56.927438 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:56.928301 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:56.928301 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:56.928301 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:56.928301 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:56.928301 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:56.928301 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:56.928301 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:56.928301 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:56.928301 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:56.928301 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:56.928301 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:05:56.928301 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:56.928301 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 288/577] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jul 11 11:05:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:56.928980 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f2765-d670-4685-81c5-640fcb81f369 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:56.954307 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13689cc1-8de5-4926-8121-8c3884af1b2d None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:56.990301 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00b135-e7e6-4dfd-aff5-3a2e5a81f0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:56.991023 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00b135-e7e6-4dfd-aff5-3a2e5a81f0d9 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:56.991310 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00b135-e7e6-4dfd-aff5-3a2e5a81f0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:56.991594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00b135-e7e6-4dfd-aff5-3a2e5a81f0d9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:56.999683 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00b135-e7e6-4dfd-aff5-3a2e5a81f0d9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:57.001124 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00b135-e7e6-4dfd-aff5-3a2e5a81f0d9 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:57.001358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:57.016476 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-cb00b135-e7e6-4dfd-aff5-3a2e5a81f0d9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 11:05:57.016476 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:57.016476 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:57.016476 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:57.016476 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:57.016476 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:57.016476 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:57.016476 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:57.016476 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:57.016476 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:57.016476 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:57.016476 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:57.016476 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:05:57.016476 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:05:57.016476 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:05:57.016476 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:05:57.023483 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:57.023483 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:57.023483 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:05:57.023483 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:05:57.023483 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:05:57.023483 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:05:57.023483 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:57.023483 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:57.023483 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:57.023483 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:57.023483 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:57.023483 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:57.023483 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:57.023483 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:57.023483 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:57.023483 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:57.023483 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:57.023483 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:57.024649 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:57.024649 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:57.024649 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:05:57.024649 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:05:57.024649 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:05:57.024649 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:05:57.024649 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:05:57.024649 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:05:57.024649 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 11:05:57.024649 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:57.024649 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 290/578] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:57.024649 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00b135-e7e6-4dfd-aff5-3a2e5a81f0d9 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:57.049991 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f2765-d670-4685-81c5-640fcb81f369 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:57.087456 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644de51-6e0b-4f34-ba21-bed4ca178ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:57.088292 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644de51-6e0b-4f34-ba21-bed4ca178ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:57.088579 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644de51-6e0b-4f34-ba21-bed4ca178ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:57.088853 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644de51-6e0b-4f34-ba21-bed4ca178ec2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:57.099817 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644de51-6e0b-4f34-ba21-bed4ca178ec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:57.102146 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644de51-6e0b-4f34-ba21-bed4ca178ec2 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:57.120075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-e644de51-6e0b-4f34-ba21-bed4ca178ec2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:57.120075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:57.120075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:57.120075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:57.120075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:57.120075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:57.120075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:57.120075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:57.120075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:57.120075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:57.120075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:57.120075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:57.120075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:05:57.120075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:05:57.120075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:05:57.121157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:05:57.121157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:57.121157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:57.121157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:57.121157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:57.121157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:57.121157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:57.121157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:57.121157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:57.121157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:57.121157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:57.121157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:57.121157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:57.121157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:57.121157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:57.121157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:57.121157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:57.127149 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:05:57.127149 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:05:57.127149 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:57.127149 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:57.127149 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 289/579] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:05:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:57.127149 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644de51-6e0b-4f34-ba21-bed4ca178ec2 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:57.142716 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00b135-e7e6-4dfd-aff5-3a2e5a81f0d9 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:57.171618 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:57.178079 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54304f8-d1ca-4b53-b302-937e9598349b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:57.178775 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54304f8-d1ca-4b53-b302-937e9598349b None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:57.179034 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54304f8-d1ca-4b53-b302-937e9598349b None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:57.179318 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54304f8-d1ca-4b53-b302-937e9598349b None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:57.180041 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54304f8-d1ca-4b53-b302-937e9598349b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:57.180351 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54304f8-d1ca-4b53-b302-937e9598349b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:57.181716 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54304f8-d1ca-4b53-b302-937e9598349b None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:57.194821 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 291/580] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:57.195935 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54304f8-d1ca-4b53-b302-937e9598349b None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:57.244504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644de51-6e0b-4f34-ba21-bed4ca178ec2 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:57.261242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:57.279966 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0e25d-a9aa-4c5c-ba8d-2a67e87707c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:57.280638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0e25d-a9aa-4c5c-ba8d-2a67e87707c7 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:57.280923 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0e25d-a9aa-4c5c-ba8d-2a67e87707c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:57.281200 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0e25d-a9aa-4c5c-ba8d-2a67e87707c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:57.281982 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0e25d-a9aa-4c5c-ba8d-2a67e87707c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:57.282290 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0e25d-a9aa-4c5c-ba8d-2a67e87707c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:57.283642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0e25d-a9aa-4c5c-ba8d-2a67e87707c7 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:57.291907 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 290/581] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jul 11 11:05:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:57.292691 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0e25d-a9aa-4c5c-ba8d-2a67e87707c7 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:57.303888 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54304f8-d1ca-4b53-b302-937e9598349b None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:57.341648 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30263d8c-96a4-45a6-a2da-e854cb69028d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:57.342376 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30263d8c-96a4-45a6-a2da-e854cb69028d None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:57.342653 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30263d8c-96a4-45a6-a2da-e854cb69028d None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:57.342992 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30263d8c-96a4-45a6-a2da-e854cb69028d None admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:57.343875 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30263d8c-96a4-45a6-a2da-e854cb69028d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:57.344195 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30263d8c-96a4-45a6-a2da-e854cb69028d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:57.345642 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30263d8c-96a4-45a6-a2da-e854cb69028d None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:57.368121 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 292/582] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Jul 11 11:05:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:57.368121 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30263d8c-96a4-45a6-a2da-e854cb69028d None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:57.405972 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0e25d-a9aa-4c5c-ba8d-2a67e87707c7 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:57.415050 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:57.443034 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a2775-5cf8-468f-9591-10f8882a7bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:57.443711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a2775-5cf8-468f-9591-10f8882a7bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:57.443997 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a2775-5cf8-468f-9591-10f8882a7bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:57.444275 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a2775-5cf8-468f-9591-10f8882a7bf9 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:57.445059 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a2775-5cf8-468f-9591-10f8882a7bf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:57.445379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a2775-5cf8-468f-9591-10f8882a7bf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:57.446930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a2775-5cf8-468f-9591-10f8882a7bf9 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:57.462781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 291/583] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:57.462781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a2775-5cf8-468f-9591-10f8882a7bf9 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:57.478018 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30263d8c-96a4-45a6-a2da-e854cb69028d None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:57.500395 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:57.514383 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af18c3a-5ce1-4c87-a424-d7ea42ca43e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:57.515698 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af18c3a-5ce1-4c87-a424-d7ea42ca43e9 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:57.515698 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af18c3a-5ce1-4c87-a424-d7ea42ca43e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:57.515900 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af18c3a-5ce1-4c87-a424-d7ea42ca43e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:57.523816 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af18c3a-5ce1-4c87-a424-d7ea42ca43e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:57.525364 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af18c3a-5ce1-4c87-a424-d7ea42ca43e9 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:57.541508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-7af18c3a-5ce1-4c87-a424-d7ea42ca43e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:05:57.541508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:57.541508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:57.541508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:57.541508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:57.541508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:57.541508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:57.541508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:57.541508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:57.541508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:57.541508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:57.541508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:57.541508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:05:57.541508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:05:57.541508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:05:57.542633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:05:57.542633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:57.542633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:57.542633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:57.542633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:57.542633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:57.542633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:57.542633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:57.542633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:57.542633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:57.542633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:57.542633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:57.542633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:57.542633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:57.542633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:57.542633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:57.542633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:57.543713 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:05:57.543713 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:05:57.543713 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:05:57.543713 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:05:57.543713 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:05:57.543713 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:05:57.543713 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:05:57.543713 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:57.547822 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 293/584] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:05:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:57.548798 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af18c3a-5ce1-4c87-a424-d7ea42ca43e9 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:57.569807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a2775-5cf8-468f-9591-10f8882a7bf9 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:57.604739 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfa08b-fcbe-4bea-92d1-086e00e2adbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:57.605563 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfa08b-fcbe-4bea-92d1-086e00e2adbe None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:57.605878 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfa08b-fcbe-4bea-92d1-086e00e2adbe None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:57.606254 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfa08b-fcbe-4bea-92d1-086e00e2adbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:57.617055 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfa08b-fcbe-4bea-92d1-086e00e2adbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:57.618540 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfa08b-fcbe-4bea-92d1-086e00e2adbe None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:57.636326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-91cfa08b-fcbe-4bea-92d1-086e00e2adbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:57.636326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:57.636326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:57.636326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:57.636326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:57.636326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:57.636326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:57.636326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:57.636326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:57.636326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:57.636326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:57.636326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:57.636326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:05:57.636326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:05:57.636326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:05:57.637684 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:05:57.637684 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:57.637684 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:57.637684 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:57.637684 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:57.637684 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:57.637684 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:57.637684 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:57.637684 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:57.637684 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:57.637684 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:57.637684 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:57.637684 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:57.637684 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:57.637684 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:57.637684 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:57.637684 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:57.638609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:05:57.638609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:05:57.638609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:57.638609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:57.642162 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 292/585] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:05:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:57.642877 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfa08b-fcbe-4bea-92d1-086e00e2adbe None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:57.662578 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af18c3a-5ce1-4c87-a424-d7ea42ca43e9 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:57.670840 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:57.700005 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e0de1-6c20-4a77-857b-f4999162f8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:57.701373 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e0de1-6c20-4a77-857b-f4999162f8ce None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:57.701756 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e0de1-6c20-4a77-857b-f4999162f8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:57.702282 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e0de1-6c20-4a77-857b-f4999162f8ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:57.713592 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e0de1-6c20-4a77-857b-f4999162f8ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:57.715170 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e0de1-6c20-4a77-857b-f4999162f8ce None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:57.733265 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-df6e0de1-6c20-4a77-857b-f4999162f8ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:57.733265 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:57.733265 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:57.733265 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:57.733265 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:57.733265 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:57.733265 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:57.733265 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:57.733265 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:57.733265 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:57.733265 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:57.733265 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:57.733265 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:05:57.733265 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:05:57.733265 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:05:57.734371 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:05:57.734371 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:57.734371 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:57.734371 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:57.734371 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:57.734371 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:57.734371 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:57.734371 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:57.734371 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:57.734371 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:57.734371 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:57.734371 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:57.734371 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:57.734371 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:57.734371 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:57.734371 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:57.734371 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:57.735443 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:05:57.735443 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:05:57.735443 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:57.735443 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:57.736417 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 294/586] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:05:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:57.737088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e0de1-6c20-4a77-857b-f4999162f8ce None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:57.752377 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:57.769375 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfa08b-fcbe-4bea-92d1-086e00e2adbe None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:57.804952 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191596b-4fb3-4832-8f12-08487bca822d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:57.805754 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191596b-4fb3-4832-8f12-08487bca822d None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:57.806071 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191596b-4fb3-4832-8f12-08487bca822d None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:57.806358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191596b-4fb3-4832-8f12-08487bca822d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:57.815124 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191596b-4fb3-4832-8f12-08487bca822d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:57.816783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191596b-4fb3-4832-8f12-08487bca822d None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:57.832556 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-9191596b-4fb3-4832-8f12-08487bca822d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 11:05:57.832556 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:57.832556 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:57.832556 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:57.832556 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:57.832556 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:57.832556 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:57.832556 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:57.832556 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:57.832556 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:57.832556 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:57.832556 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:57.832556 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:05:57.832556 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:05:57.832556 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:05:57.832556 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:05:57.833571 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:57.833571 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:57.833571 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:05:57.833571 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:05:57.833571 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:05:57.833571 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:05:57.833571 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:57.833571 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:57.833571 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:57.833571 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:57.833571 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:57.833571 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:57.833571 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:57.833571 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:57.833571 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:57.833571 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:57.833571 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:57.833571 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:57.835019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:57.835019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:57.835019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:05:57.835019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:05:57.835019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:05:57.835019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:05:57.835019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:05:57.835019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:05:57.835019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 11:05:57.835019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:57.838446 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 293/587] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jul 11 11:05:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:57.839051 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191596b-4fb3-4832-8f12-08487bca822d None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:57.849790 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e0de1-6c20-4a77-857b-f4999162f8ce None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:57.885839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb3798-e726-45b3-8a9b-fae1f24ba389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:57.886508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb3798-e726-45b3-8a9b-fae1f24ba389 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:57.886799 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb3798-e726-45b3-8a9b-fae1f24ba389 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:57.887137 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb3798-e726-45b3-8a9b-fae1f24ba389 None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:57.887930 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb3798-e726-45b3-8a9b-fae1f24ba389 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:57.888237 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb3798-e726-45b3-8a9b-fae1f24ba389 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:57.889679 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb3798-e726-45b3-8a9b-fae1f24ba389 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:57.907093 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 295/588] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:05:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:57.907093 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb3798-e726-45b3-8a9b-fae1f24ba389 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:57.924676 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:57.945921 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191596b-4fb3-4832-8f12-08487bca822d None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:57.982994 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81fb5b-c144-403c-9a98-3e131eba81c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:57.983828 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81fb5b-c144-403c-9a98-3e131eba81c6 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:57.984246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81fb5b-c144-403c-9a98-3e131eba81c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:57.985144 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81fb5b-c144-403c-9a98-3e131eba81c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:57.986013 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81fb5b-c144-403c-9a98-3e131eba81c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:57.986857 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81fb5b-c144-403c-9a98-3e131eba81c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:57.989214 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81fb5b-c144-403c-9a98-3e131eba81c6 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:58.010397 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 294/589] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:58.010397 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81fb5b-c144-403c-9a98-3e131eba81c6 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:58.011173 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb3798-e726-45b3-8a9b-fae1f24ba389 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:58.026300 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:58.047336 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93683d22-83d6-4c93-bef1-79fa37e08beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:58.047993 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93683d22-83d6-4c93-bef1-79fa37e08beb None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:58.048278 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93683d22-83d6-4c93-bef1-79fa37e08beb None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:58.048556 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93683d22-83d6-4c93-bef1-79fa37e08beb None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:58.049273 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93683d22-83d6-4c93-bef1-79fa37e08beb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:58.049581 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93683d22-83d6-4c93-bef1-79fa37e08beb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:58.051550 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93683d22-83d6-4c93-bef1-79fa37e08beb None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:58.063391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 296/590] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:58.064180 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93683d22-83d6-4c93-bef1-79fa37e08beb None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:58.121325 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81fb5b-c144-403c-9a98-3e131eba81c6 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:58.152330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:58.159397 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f47f88-3e5b-4aef-8289-cd2ed71586e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:58.160131 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f47f88-3e5b-4aef-8289-cd2ed71586e7 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:58.160415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f47f88-3e5b-4aef-8289-cd2ed71586e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:58.166127 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f47f88-3e5b-4aef-8289-cd2ed71586e7 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:58.166127 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f47f88-3e5b-4aef-8289-cd2ed71586e7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:58.166127 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f47f88-3e5b-4aef-8289-cd2ed71586e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:58.166127 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f47f88-3e5b-4aef-8289-cd2ed71586e7 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:58.174455 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93683d22-83d6-4c93-bef1-79fa37e08beb None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:58.181582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 295/591] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Jul 11 11:05:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:58.182436 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f47f88-3e5b-4aef-8289-cd2ed71586e7 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:58.213420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334836b-fd3d-4f5e-947a-851386afe0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:58.214108 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334836b-fd3d-4f5e-947a-851386afe0f0 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:58.214390 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334836b-fd3d-4f5e-947a-851386afe0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:58.214664 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334836b-fd3d-4f5e-947a-851386afe0f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:58.215490 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334836b-fd3d-4f5e-947a-851386afe0f0 None admin] RBAC: Adding query filter params (role.id=9b682db1e9a5486884a74f5c01953fe7, scope.project.id=38ed7416526e473b816330e24acf7a04, user.id=736f6d4d1dbb47ff98bc67e53614d49c) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:58.215799 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334836b-fd3d-4f5e-947a-851386afe0f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:58.217239 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334836b-fd3d-4f5e-947a-851386afe0f0 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:58.223851 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 297/592] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:05:58 2022] GET /identity/v3/role_assignments?user.id=736f6d4d1dbb47ff98bc67e53614d49c&scope.project.id=38ed7416526e473b816330e24acf7a04&role.id=9b682db1e9a5486884a74f5c01953fe7 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:58.224708 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334836b-fd3d-4f5e-947a-851386afe0f0 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:58.285475 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:58.323368 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f47f88-3e5b-4aef-8289-cd2ed71586e7 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:58.371218 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab6bce-2103-431e-84f7-a239aae4f32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:58.372295 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab6bce-2103-431e-84f7-a239aae4f32b None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:58.372591 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab6bce-2103-431e-84f7-a239aae4f32b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:58.372874 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab6bce-2103-431e-84f7-a239aae4f32b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:58.381261 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334836b-fd3d-4f5e-947a-851386afe0f0 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:58.383678 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab6bce-2103-431e-84f7-a239aae4f32b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:58.385987 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab6bce-2103-431e-84f7-a239aae4f32b None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:58.404381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-7bab6bce-2103-431e-84f7-a239aae4f32b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 11:05:58.404381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:58.404381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:58.404381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:58.404381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:58.404381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:58.404381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:58.404381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:58.404381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:58.404381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:58.404381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:58.404381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:58.404381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:05:58.404381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:05:58.404381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:05:58.404381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:05:58.405551 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:58.405551 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:58.405551 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:05:58.405551 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:05:58.405551 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:05:58.405551 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:05:58.405551 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:58.405551 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:58.405551 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:58.405551 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:58.405551 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:58.405551 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:58.405551 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:58.405551 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:58.405551 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:58.405551 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:58.405551 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:58.405551 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:58.406730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:58.406730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:58.406730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:05:58.406730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:05:58.406730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:05:58.406730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:05:58.406730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:05:58.406730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:05:58.406730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 11:05:58.406730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:58.406730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 296/593] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:05:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:58.407401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab6bce-2103-431e-84f7-a239aae4f32b None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:58.423056 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8633348-53c6-447b-b2de-bb3e52340a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:58.424112 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8633348-53c6-447b-b2de-bb3e52340a4d None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:58.424558 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8633348-53c6-447b-b2de-bb3e52340a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:58.424984 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8633348-53c6-447b-b2de-bb3e52340a4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:58.433631 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8633348-53c6-447b-b2de-bb3e52340a4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:58.435303 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8633348-53c6-447b-b2de-bb3e52340a4d None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:58.452733 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-b8633348-53c6-447b-b2de-bb3e52340a4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:05:58.452733 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:58.452733 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:58.452733 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:58.452733 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:58.452733 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:58.452733 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:58.452733 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:58.452733 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:58.452733 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:58.452733 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:58.452733 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:58.452733 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:05:58.452733 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:05:58.452733 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:05:58.453839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:05:58.453839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:58.453839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:58.453839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:58.453839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:58.453839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:58.453839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:58.453839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:58.453839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:58.453839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:58.453839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:58.453839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:58.453839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:58.453839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:58.453839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:58.453839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:58.453839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:58.454831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:05:58.454831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:05:58.454831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:05:58.454831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:05:58.454831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:05:58.454831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:05:58.454831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:05:58.454831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:58.461593 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 298/594] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:05:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:58.462701 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8633348-53c6-447b-b2de-bb3e52340a4d None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:58.474106 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:58.534735 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab6bce-2103-431e-84f7-a239aae4f32b None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:58.565793 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:58.575085 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96c13f-3432-491c-99d3-163810efab53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:58.577910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96c13f-3432-491c-99d3-163810efab53 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:58.577910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96c13f-3432-491c-99d3-163810efab53 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:58.577910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96c13f-3432-491c-99d3-163810efab53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:58.578144 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8633348-53c6-447b-b2de-bb3e52340a4d None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:58.589280 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96c13f-3432-491c-99d3-163810efab53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:58.591214 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96c13f-3432-491c-99d3-163810efab53 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:58.611968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-3b96c13f-3432-491c-99d3-163810efab53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:58.611968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:58.611968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:58.611968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:58.611968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:58.611968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:58.611968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:58.611968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:58.611968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:58.611968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:58.611968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:58.611968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:58.611968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:05:58.611968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:05:58.611968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:05:58.612910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:05:58.612910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:58.612910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:58.612910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:58.612910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:58.612910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:58.612910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:58.612910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:58.612910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:58.612910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:58.612910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:58.612910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:58.612910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:58.612910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:58.612910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:58.612910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:58.612910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:58.614254 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:05:58.614254 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:05:58.614254 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:58.614254 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:58.620820 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff74c74-c619-4487-854b-03b65f2f9545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:58.620820 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff74c74-c619-4487-854b-03b65f2f9545 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:58.620820 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff74c74-c619-4487-854b-03b65f2f9545 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:58.620820 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff74c74-c619-4487-854b-03b65f2f9545 None admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:58.621180 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff74c74-c619-4487-854b-03b65f2f9545 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:58.621180 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff74c74-c619-4487-854b-03b65f2f9545 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:58.621180 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff74c74-c619-4487-854b-03b65f2f9545 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:58.621582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 297/595] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:05:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:58.622685 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96c13f-3432-491c-99d3-163810efab53 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:58.645671 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 299/596] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Jul 11 11:05:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:58.645671 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff74c74-c619-4487-854b-03b65f2f9545 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:58.707326 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:58.739848 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96c13f-3432-491c-99d3-163810efab53 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:58.751191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff74c74-c619-4487-854b-03b65f2f9545 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:58.783217 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466bbbc-6f5d-47c4-987c-85ec758313a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:58.784243 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466bbbc-6f5d-47c4-987c-85ec758313a3 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:58.784668 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466bbbc-6f5d-47c4-987c-85ec758313a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:58.785652 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466bbbc-6f5d-47c4-987c-85ec758313a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:58.786640 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2466bbbc-6f5d-47c4-987c-85ec758313a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:58.787167 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2466bbbc-6f5d-47c4-987c-85ec758313a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:58.788910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2466bbbc-6f5d-47c4-987c-85ec758313a3 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:58.792500 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab623b-9e34-497c-8f20-805231bda1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:58.793170 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab623b-9e34-497c-8f20-805231bda1ac None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:58.793461 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab623b-9e34-497c-8f20-805231bda1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:58.793747 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab623b-9e34-497c-8f20-805231bda1ac None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:58.794571 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab623b-9e34-497c-8f20-805231bda1ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:58.794887 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab623b-9e34-497c-8f20-805231bda1ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:58.796248 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab623b-9e34-497c-8f20-805231bda1ac None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:58.802579 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 298/597] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:05:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:58.803697 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466bbbc-6f5d-47c4-987c-85ec758313a3 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:58.812085 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 300/598] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:58.813266 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879573b5-35a8-4de5-9ccf-6eed9279d6c0 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:58.813561 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879573b5-35a8-4de5-9ccf-6eed9279d6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:58.813881 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879573b5-35a8-4de5-9ccf-6eed9279d6c0 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:58.815235 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 301/599] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:05:58.817674 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879573b5-35a8-4de5-9ccf-6eed9279d6c0 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:58.875843 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:58.938614 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466bbbc-6f5d-47c4-987c-85ec758313a3 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:58.940184 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879573b5-35a8-4de5-9ccf-6eed9279d6c0 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:58.962085 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:58.976567 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2733d1-b086-4a4a-8832-794831245178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:58.977368 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2733d1-b086-4a4a-8832-794831245178 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:58.977545 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb94bb-8825-4936-a4be-119a09d88075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:58.977854 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2733d1-b086-4a4a-8832-794831245178 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:58.978140 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2733d1-b086-4a4a-8832-794831245178 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:58.978413 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb94bb-8825-4936-a4be-119a09d88075 None admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:58.978727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb94bb-8825-4936-a4be-119a09d88075 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:58.979038 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb94bb-8825-4936-a4be-119a09d88075 None admin] PATH_INFO: `/v3/projects/38ed7416526e473b816330e24acf7a04/users/65a2d8d24562459493a3bcd399665a6b/roles/9b682db1e9a5486884a74f5c01953fe7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:58.990835 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2733d1-b086-4a4a-8832-794831245178 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:58.992286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2733d1-b086-4a4a-8832-794831245178 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:58.995672 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb94bb-8825-4936-a4be-119a09d88075 None admin] RBAC: Authorizing `identity:create_grant(project_id=38ed7416526e473b816330e24acf7a04, user_id=65a2d8d24562459493a3bcd399665a6b, role_id=9b682db1e9a5486884a74f5c01953fe7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:58.997133 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb94bb-8825-4936-a4be-119a09d88075 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:59.011197 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-3d2733d1-b086-4a4a-8832-794831245178 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:59.011197 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:59.011197 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:59.011197 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:59.011197 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:59.011197 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:59.011197 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:59.011197 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:59.011197 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:59.011197 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:59.011197 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:59.011197 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:59.011197 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:05:59.011197 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:05:59.011197 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:05:59.014102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:05:59.014102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:59.014102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:59.014102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:59.014102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:59.014102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:59.014102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:59.014102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:59.014102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:59.014102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:59.014102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:59.014102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:59.014102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:59.014102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:59.014102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:59.014102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:59.014102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:59.015008 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:05:59.015008 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:05:59.015008 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:59.015008 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:59.015008 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 299/600] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:05:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:59.015008 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2733d1-b086-4a4a-8832-794831245178 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:59.063814 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 302/601] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jul 11 11:05:58 2022] PUT /identity/v3/projects/38ed7416526e473b816330e24acf7a04/users/65a2d8d24562459493a3bcd399665a6b/roles/9b682db1e9a5486884a74f5c01953fe7 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:05:59.065175 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94891cb-cd89-457d-9239-267f9bd9362a None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:59.065543 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94891cb-cd89-457d-9239-267f9bd9362a None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:59.065934 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94891cb-cd89-457d-9239-267f9bd9362a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:59.086756 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-b94891cb-cd89-457d-9239-267f9bd9362a None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:05:59.088005 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-b94891cb-cd89-457d-9239-267f9bd9362a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:05:59.130988 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:59.142947 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2733d1-b086-4a4a-8832-794831245178 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:59.184255 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b92b468-fa3c-436a-976d-78845cc7ae5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:59.184684 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 303/602] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:05:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:05:59.185560 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94891cb-cd89-457d-9239-267f9bd9362a None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:59.186135 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92b468-fa3c-436a-976d-78845cc7ae5a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:59.186625 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92b468-fa3c-436a-976d-78845cc7ae5a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:59.187108 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92b468-fa3c-436a-976d-78845cc7ae5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:59.199858 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b92b468-fa3c-436a-976d-78845cc7ae5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:59.201386 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b92b468-fa3c-436a-976d-78845cc7ae5a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:59.218807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-1b92b468-fa3c-436a-976d-78845cc7ae5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:05:59.218807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:59.218807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:59.218807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:59.218807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:59.218807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:59.218807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:59.218807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:59.218807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:59.218807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:59.218807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:59.218807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:59.218807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:05:59.218807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:05:59.218807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:05:59.219760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:05:59.219760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:59.219760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:59.219760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:59.219760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:59.219760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:59.219760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:59.219760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:59.219760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:59.219760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:59.219760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:59.219760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:59.219760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:59.219760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:59.219760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:59.219760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:59.219760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:59.220632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:05:59.220632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:05:59.220632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:05:59.220632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:05:59.220632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:05:59.220632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:05:59.220632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:05:59.220632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:59.220632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 300/603] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:05:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:59.221569 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b92b468-fa3c-436a-976d-78845cc7ae5a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:59.327114 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:59.331126 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94891cb-cd89-457d-9239-267f9bd9362a None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:59.332436 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b92b468-fa3c-436a-976d-78845cc7ae5a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:59.374114 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5c178-2083-40ef-8c3d-6ef9c460e327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:59.374807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5c178-2083-40ef-8c3d-6ef9c460e327 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:59.375201 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5c178-2083-40ef-8c3d-6ef9c460e327 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:59.375576 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5c178-2083-40ef-8c3d-6ef9c460e327 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:59.378487 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff564008-08d4-4f2e-aaa0-3fc8251493e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:59.379975 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff564008-08d4-4f2e-aaa0-3fc8251493e2 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:59.380264 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff564008-08d4-4f2e-aaa0-3fc8251493e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:59.380546 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff564008-08d4-4f2e-aaa0-3fc8251493e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:59.381292 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff564008-08d4-4f2e-aaa0-3fc8251493e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:59.385200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff564008-08d4-4f2e-aaa0-3fc8251493e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:59.385200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff564008-08d4-4f2e-aaa0-3fc8251493e2 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:59.387609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee5c178-2083-40ef-8c3d-6ef9c460e327 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:05:59.396262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-dee5c178-2083-40ef-8c3d-6ef9c460e327 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:05:59.396262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:59.396262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:59.396262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:59.396262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:59.396262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:59.396262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:59.396262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:59.396262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:59.396262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:59.396262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:59.396262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:59.396262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:05:59.396262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:05:59.396262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:05:59.396262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:05:59.397220 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:05:59.397220 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:05:59.397220 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:05:59.397220 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:05:59.397220 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:59.397220 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:59.397220 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:59.397220 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:59.397220 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:59.397220 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:59.397220 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:59.397220 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:59.397220 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:59.397220 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:59.397220 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:59.397220 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:59.398087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:59.398087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:59.398087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:59.398087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:59.398087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:05:59.398087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:05:59.398087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:05:59.398087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:05:59.398087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:05:59.398087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:05:59.398087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:05:59.398087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:59.398736 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 304/604] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:59.398736 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff564008-08d4-4f2e-aaa0-3fc8251493e2 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:59.398869 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 301/605] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jul 11 11:05:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:59.407851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5c178-2083-40ef-8c3d-6ef9c460e327 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:59.426536 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:59.518891 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5c178-2083-40ef-8c3d-6ef9c460e327 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:59.521923 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff564008-08d4-4f2e-aaa0-3fc8251493e2 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:59.556460 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585fc14-7f73-4885-85b5-cfaa82aaaf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:59.557319 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585fc14-7f73-4885-85b5-cfaa82aaaf54 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:59.557610 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585fc14-7f73-4885-85b5-cfaa82aaaf54 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:59.558008 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585fc14-7f73-4885-85b5-cfaa82aaaf54 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:59.559033 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585fc14-7f73-4885-85b5-cfaa82aaaf54 None admin] RBAC: Adding query filter params (name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:59.559349 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585fc14-7f73-4885-85b5-cfaa82aaaf54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:59.560125 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721d8ed-b08c-43a2-ada6-16a0eb18730f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:59.560820 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585fc14-7f73-4885-85b5-cfaa82aaaf54 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:59.560992 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721d8ed-b08c-43a2-ada6-16a0eb18730f None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:59.561272 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721d8ed-b08c-43a2-ada6-16a0eb18730f None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:59.561619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721d8ed-b08c-43a2-ada6-16a0eb18730f None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:59.562696 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721d8ed-b08c-43a2-ada6-16a0eb18730f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:59.563186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721d8ed-b08c-43a2-ada6-16a0eb18730f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:59.564748 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721d8ed-b08c-43a2-ada6-16a0eb18730f None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:59.569932 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 302/606] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jul 11 11:05:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:05:59.570591 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585fc14-7f73-4885-85b5-cfaa82aaaf54 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:59.579148 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 305/607] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:05:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:59.580185 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721d8ed-b08c-43a2-ada6-16a0eb18730f None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:59.605693 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:59.678248 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:59.694956 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721d8ed-b08c-43a2-ada6-16a0eb18730f None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:59.698630 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585fc14-7f73-4885-85b5-cfaa82aaaf54 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:59.733500 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de565f-914c-4e0a-898f-5442d7774c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:59.734676 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de565f-914c-4e0a-898f-5442d7774c01 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:59.735214 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de565f-914c-4e0a-898f-5442d7774c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:59.735780 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de565f-914c-4e0a-898f-5442d7774c01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:59.741192 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7613641-bcb6-482d-967f-6fde816e43ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:59.742026 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7613641-bcb6-482d-967f-6fde816e43ff None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:59.742313 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7613641-bcb6-482d-967f-6fde816e43ff None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:59.742589 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7613641-bcb6-482d-967f-6fde816e43ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:59.749548 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de565f-914c-4e0a-898f-5442d7774c01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:59.751007 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7613641-bcb6-482d-967f-6fde816e43ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:59.751527 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de565f-914c-4e0a-898f-5442d7774c01 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:59.752624 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7613641-bcb6-482d-967f-6fde816e43ff None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:59.768314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-e7613641-bcb6-482d-967f-6fde816e43ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:05:59.768314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:59.768314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:59.768314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:59.768314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:59.768314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:59.768314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:59.768314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:59.768314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:59.768314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:59.768314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:59.768314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:59.768314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:05:59.768314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:05:59.768314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:05:59.775460 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:05:59.775460 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:59.775460 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:59.775460 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:59.775460 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:59.775460 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:59.775460 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:59.775460 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:59.775460 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:59.775460 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:59.775460 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:59.775460 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:59.775460 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:59.775460 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:59.775460 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:59.775460 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:59.775460 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:59.776365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:05:59.776365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:05:59.776365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:05:59.776365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:05:59.776365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:05:59.776365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:05:59.776365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:05:59.776365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:05:59.776365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 303/608] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:05:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:59.776365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7613641-bcb6-482d-967f-6fde816e43ff None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:59.791958 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-f5de565f-914c-4e0a-898f-5442d7774c01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:59.791958 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:05:59.791958 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:05:59.791958 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:05:59.791958 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:05:59.791958 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:05:59.791958 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:05:59.791958 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:05:59.791958 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:05:59.791958 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:05:59.791958 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:05:59.791958 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:05:59.791958 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:05:59.791958 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:05:59.791958 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:05:59.792917 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:05:59.792917 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:05:59.792917 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:05:59.792917 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:05:59.792917 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:05:59.792917 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:05:59.792917 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:05:59.792917 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:05:59.792917 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:05:59.792917 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:05:59.792917 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:05:59.792917 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:05:59.792917 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:05:59.792917 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:05:59.792917 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:05:59.792917 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:05:59.792917 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:05:59.793837 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:05:59.793837 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:05:59.793837 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:05:59.793837 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:05:59.797225 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 306/609] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:05:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:05:59.797917 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de565f-914c-4e0a-898f-5442d7774c01 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:05:59.885677 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:59.902527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7613641-bcb6-482d-967f-6fde816e43ff None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:59.927562 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de565f-914c-4e0a-898f-5442d7774c01 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:05:59.945152 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496e088-fd07-4ec3-9cb5-08b3f1ef6d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:59.946355 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496e088-fd07-4ec3-9cb5-08b3f1ef6d78 None admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:59.946646 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496e088-fd07-4ec3-9cb5-08b3f1ef6d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:59.946934 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496e088-fd07-4ec3-9cb5-08b3f1ef6d78 None admin] PATH_INFO: `/v3/projects/38ed7416526e473b816330e24acf7a04/users/79b8c08920b0417097bebd23344ffe64/roles/9b682db1e9a5486884a74f5c01953fe7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:59.950067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:05:59.967159 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496e088-fd07-4ec3-9cb5-08b3f1ef6d78 None admin] RBAC: Authorizing `identity:create_grant(project_id=38ed7416526e473b816330e24acf7a04, user_id=79b8c08920b0417097bebd23344ffe64, role_id=9b682db1e9a5486884a74f5c01953fe7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:59.968709 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496e088-fd07-4ec3-9cb5-08b3f1ef6d78 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:59.969280 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9547d-c015-4173-a3d7-90b53d350c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:05:59.970242 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9547d-c015-4173-a3d7-90b53d350c24 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:05:59.970749 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9547d-c015-4173-a3d7-90b53d350c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:05:59.971244 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9547d-c015-4173-a3d7-90b53d350c24 None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:05:59.972953 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9547d-c015-4173-a3d7-90b53d350c24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:05:59.974185 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9547d-c015-4173-a3d7-90b53d350c24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:05:59.975770 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9547d-c015-4173-a3d7-90b53d350c24 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:05:59.989681 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 307/610] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:05:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:05:59.990987 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9547d-c015-4173-a3d7-90b53d350c24 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:00.078634 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 304/611] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jul 11 11:05:59 2022] PUT /identity/v3/projects/38ed7416526e473b816330e24acf7a04/users/79b8c08920b0417097bebd23344ffe64/roles/9b682db1e9a5486884a74f5c01953fe7 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:06:00.079750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496e088-fd07-4ec3-9cb5-08b3f1ef6d78 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:00.140678 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9547d-c015-4173-a3d7-90b53d350c24 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:00.204373 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:00.216353 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987183ca-313b-407b-9d0b-6cdb98fae85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:00.217140 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987183ca-313b-407b-9d0b-6cdb98fae85d None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:00.217519 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987183ca-313b-407b-9d0b-6cdb98fae85d None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:00.217904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987183ca-313b-407b-9d0b-6cdb98fae85d None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:00.219526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987183ca-313b-407b-9d0b-6cdb98fae85d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:00.219927 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987183ca-313b-407b-9d0b-6cdb98fae85d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:00.221380 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987183ca-313b-407b-9d0b-6cdb98fae85d None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:00.236729 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 308/612] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:00.243845 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987183ca-313b-407b-9d0b-6cdb98fae85d None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:00.299392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496e088-fd07-4ec3-9cb5-08b3f1ef6d78 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:00.342468 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc1d62-a333-4898-b78e-27aa843842b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:00.343431 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc1d62-a333-4898-b78e-27aa843842b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:00.343720 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc1d62-a333-4898-b78e-27aa843842b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:00.344004 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc1d62-a333-4898-b78e-27aa843842b4 None admin] PATH_INFO: `/v3/projects/38ed7416526e473b816330e24acf7a04/users/3096077887344140805ec8a23fe72f48/roles/9b682db1e9a5486884a74f5c01953fe7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:00.366741 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc1d62-a333-4898-b78e-27aa843842b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=38ed7416526e473b816330e24acf7a04, user_id=3096077887344140805ec8a23fe72f48, role_id=9b682db1e9a5486884a74f5c01953fe7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:00.368179 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc1d62-a333-4898-b78e-27aa843842b4 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:00.391979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987183ca-313b-407b-9d0b-6cdb98fae85d None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:00.428085 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e71fa-cc0b-4771-8775-20bde7f73e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:00.428879 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e71fa-cc0b-4771-8775-20bde7f73e46 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:00.429179 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e71fa-cc0b-4771-8775-20bde7f73e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:00.429436 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e71fa-cc0b-4771-8775-20bde7f73e46 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:00.438709 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e71fa-cc0b-4771-8775-20bde7f73e46 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:00.439299 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 305/613] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jul 11 11:06:00 2022] PUT /identity/v3/projects/38ed7416526e473b816330e24acf7a04/users/3096077887344140805ec8a23fe72f48/roles/9b682db1e9a5486884a74f5c01953fe7 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:06:00.445717 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e71fa-cc0b-4771-8775-20bde7f73e46 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:00.449371 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7bebe-daa7-4a4b-9732-9ecf37a49c2d None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:00.449935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7bebe-daa7-4a4b-9732-9ecf37a49c2d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:00.450681 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7bebe-daa7-4a4b-9732-9ecf37a49c2d None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:00.454702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 306/614] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:00 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:00.459991 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a0f1e-2b65-47b1-9da1-b9fc7d9c0ae9 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:00.460514 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a0f1e-2b65-47b1-9da1-b9fc7d9c0ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:00.460965 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a0f1e-2b65-47b1-9da1-b9fc7d9c0ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:00.481990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-193e71fa-cc0b-4771-8775-20bde7f73e46 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 11:06:00.481990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:00.481990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:00.481990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:00.481990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:00.481990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:00.481990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:00.481990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:00.481990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:00.481990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:00.481990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:00.481990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:00.481990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:06:00.481990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:06:00.481990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:06:00.481990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:06:00.488831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:00.488831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:00.488831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:06:00.488831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:00.488831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:06:00.488831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:00.488831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:00.488831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:00.488831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:00.488831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:00.488831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:00.488831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:00.488831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:00.488831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:00.488831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:00.488831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:00.488831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:00.488831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:00.489960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:00.489960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:00.489960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:06:00.489960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:06:00.489960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:06:00.489960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:06:00.489960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:06:00.489960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:06:00.489960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 11:06:00.489960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:00.489960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 309/615] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Jul 11 11:06:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:00.492936 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e71fa-cc0b-4771-8775-20bde7f73e46 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:00.503234 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-c09a0f1e-2b65-47b1-9da1-b9fc7d9c0ae9 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:00.506745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c09a0f1e-2b65-47b1-9da1-b9fc7d9c0ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:00.570930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:00.612290 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:00.647187 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 307/616] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:06:00.671879 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a0f1e-2b65-47b1-9da1-b9fc7d9c0ae9 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:00.679662 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e71fa-cc0b-4771-8775-20bde7f73e46 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:00.716558 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bc15a-5fda-4eba-b682-38af24c82611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:00.717166 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bc15a-5fda-4eba-b682-38af24c82611 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:00.719909 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bc15a-5fda-4eba-b682-38af24c82611 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:00.719909 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bc15a-5fda-4eba-b682-38af24c82611 None admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:00.719909 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573bc15a-5fda-4eba-b682-38af24c82611 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:00.719909 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573bc15a-5fda-4eba-b682-38af24c82611 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:00.720398 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573bc15a-5fda-4eba-b682-38af24c82611 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:00.742266 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 310/617] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Jul 11 11:06:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:00.750955 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bc15a-5fda-4eba-b682-38af24c82611 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:00.807397 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a0f1e-2b65-47b1-9da1-b9fc7d9c0ae9 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:00.847106 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52adeb-23c6-46aa-9cf4-b9d1702e984a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:00.847979 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52adeb-23c6-46aa-9cf4-b9d1702e984a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:00.848303 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52adeb-23c6-46aa-9cf4-b9d1702e984a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:00.849812 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52adeb-23c6-46aa-9cf4-b9d1702e984a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:00.861316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52adeb-23c6-46aa-9cf4-b9d1702e984a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:06:00.870268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-bc52adeb-23c6-46aa-9cf4-b9d1702e984a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:06:00.870268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:00.870268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:00.870268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:00.870268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:00.870268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:00.870268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:00.870268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:00.870268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:00.870268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:00.870268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:00.870268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:00.870268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:06:00.870268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:06:00.870268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:06:00.870268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:06:00.871286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:06:00.871286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:06:00.871286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:06:00.871286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:06:00.871286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:00.871286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:00.871286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:00.871286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:00.871286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:00.871286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:00.871286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:00.871286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:00.871286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:00.871286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:00.871286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:00.871286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:00.872262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:00.872262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:00.872262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:00.872262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:00.872262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:06:00.872262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:06:00.872262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:06:00.872262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:06:00.872262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:06:00.872262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:06:00.872262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:06:00.872262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:00.872262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 308/618] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jul 11 11:06:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:00.882764 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52adeb-23c6-46aa-9cf4-b9d1702e984a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:00.926056 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bc15a-5fda-4eba-b682-38af24c82611 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:00.926881 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:00.939233 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:00.964684 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42218052-960e-4d92-962f-1a44cec74175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:00.965786 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42218052-960e-4d92-962f-1a44cec74175 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:00.966296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42218052-960e-4d92-962f-1a44cec74175 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:00.966828 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42218052-960e-4d92-962f-1a44cec74175 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:01.007747 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52adeb-23c6-46aa-9cf4-b9d1702e984a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:01.043362 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5e81e-309c-46fd-b268-27c09f12cc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:01.043956 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5e81e-309c-46fd-b268-27c09f12cc72 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:01.044238 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5e81e-309c-46fd-b268-27c09f12cc72 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:01.044514 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5e81e-309c-46fd-b268-27c09f12cc72 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:01.045390 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab5e81e-309c-46fd-b268-27c09f12cc72 None admin] RBAC: Adding query filter params (name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:01.045566 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab5e81e-309c-46fd-b268-27c09f12cc72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:01.046949 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab5e81e-309c-46fd-b268-27c09f12cc72 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:01.056070 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 309/619] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jul 11 11:06:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:01.062854 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5e81e-309c-46fd-b268-27c09f12cc72 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:01.084639 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42218052-960e-4d92-962f-1a44cec74175 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:01.086130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42218052-960e-4d92-962f-1a44cec74175 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:01.186880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:01.205752 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5e81e-309c-46fd-b268-27c09f12cc72 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:01.236792 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 311/620] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:06:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 11:06:01.246746 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42218052-960e-4d92-962f-1a44cec74175 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:01.255496 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef614fb7-4779-46cf-9803-66b6bbf35c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:01.256299 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef614fb7-4779-46cf-9803-66b6bbf35c10 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:01.256585 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef614fb7-4779-46cf-9803-66b6bbf35c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:01.256864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef614fb7-4779-46cf-9803-66b6bbf35c10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:01.265357 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:01.269002 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef614fb7-4779-46cf-9803-66b6bbf35c10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:01.270520 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef614fb7-4779-46cf-9803-66b6bbf35c10 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:01.288968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-ef614fb7-4779-46cf-9803-66b6bbf35c10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:01.288968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:01.288968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:01.288968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:01.288968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:01.288968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:01.288968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:01.288968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:01.288968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:01.288968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:01.288968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:01.288968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:01.288968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:01.288968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:01.288968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:01.289971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:01.289971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:01.289971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:01.289971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:01.289971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:01.289971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:01.289971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:01.289971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:01.289971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:01.289971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:01.289971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:01.289971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:01.289971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:01.289971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:01.289971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:01.289971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:01.289971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:01.290852 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:01.290852 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:01.290852 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:01.290852 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:01.290852 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 310/621] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:01.296783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef614fb7-4779-46cf-9803-66b6bbf35c10 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:01.405936 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42218052-960e-4d92-962f-1a44cec74175 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:01.432886 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef614fb7-4779-46cf-9803-66b6bbf35c10 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:01.450655 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0f8cf-a05e-4477-96f6-475f1ce48c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:01.451636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0f8cf-a05e-4477-96f6-475f1ce48c97 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:01.452348 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0f8cf-a05e-4477-96f6-475f1ce48c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:01.452690 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0f8cf-a05e-4477-96f6-475f1ce48c97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:01.466349 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0f8cf-a05e-4477-96f6-475f1ce48c97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:01.468055 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0f8cf-a05e-4477-96f6-475f1ce48c97 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:01.475104 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7658f6-274c-4240-8b26-756ec9b396aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:01.475778 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7658f6-274c-4240-8b26-756ec9b396aa None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:01.476514 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7658f6-274c-4240-8b26-756ec9b396aa None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:01.476801 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7658f6-274c-4240-8b26-756ec9b396aa None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:01.477542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7658f6-274c-4240-8b26-756ec9b396aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:01.478297 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7658f6-274c-4240-8b26-756ec9b396aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:01.480020 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7658f6-274c-4240-8b26-756ec9b396aa None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:01.488474 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-e3e0f8cf-a05e-4477-96f6-475f1ce48c97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:01.488474 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:01.488474 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:01.488474 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:01.488474 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:01.488474 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:01.488474 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:01.488474 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:01.488474 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:01.488474 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:01.488474 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:01.488474 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:01.488474 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:01.488474 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:01.488474 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:01.489410 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:01.489410 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:01.489410 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:01.489410 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:01.489410 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:01.489410 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:01.489410 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:01.489410 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:01.489410 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:01.489410 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:01.489410 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:01.489410 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:01.489410 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:01.489410 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:01.489410 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:01.489410 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:01.489410 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:01.490494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:01.490494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:01.490494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:01.490494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:01.491785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 312/622] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:01.493653 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 311/623] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:01.493796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d0a21-4f9a-4036-a2c0-4812775290a2 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:01.493904 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:01.493980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d0a21-4f9a-4036-a2c0-4812775290a2 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:01.493980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d0a21-4f9a-4036-a2c0-4812775290a2 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:01.495050 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 313/624] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:01.499602 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7658f6-274c-4240-8b26-756ec9b396aa None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:01.505680 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d0a21-4f9a-4036-a2c0-4812775290a2 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:01.581252 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:01.625500 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7658f6-274c-4240-8b26-756ec9b396aa None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:01.630508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d0a21-4f9a-4036-a2c0-4812775290a2 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:01.660503 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a731b2-a184-4fa4-aa14-4ac7b5bb992c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:01.661181 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a731b2-a184-4fa4-aa14-4ac7b5bb992c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:01.661464 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a731b2-a184-4fa4-aa14-4ac7b5bb992c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:01.661744 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a731b2-a184-4fa4-aa14-4ac7b5bb992c None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:01.662504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a731b2-a184-4fa4-aa14-4ac7b5bb992c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:01.662817 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a731b2-a184-4fa4-aa14-4ac7b5bb992c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:01.664174 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a731b2-a184-4fa4-aa14-4ac7b5bb992c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:01.669897 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ab074-28fd-4748-9d94-cd55e16be2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:01.671044 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ab074-28fd-4748-9d94-cd55e16be2ca None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:01.671508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ab074-28fd-4748-9d94-cd55e16be2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:01.671990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ab074-28fd-4748-9d94-cd55e16be2ca None admin] PATH_INFO: `/v3/users/swift` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:01.676245 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 312/625] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:01.677534 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b81c41-32b5-4bea-94a6-a4afc0070726 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:01.677850 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b81c41-32b5-4bea-94a6-a4afc0070726 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:01.678133 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b81c41-32b5-4bea-94a6-a4afc0070726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:01.682240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ab074-28fd-4748-9d94-cd55e16be2ca None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:01.684325 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ab074-28fd-4748-9d94-cd55e16be2ca None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:01.695438 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-b2b81c41-32b5-4bea-94a6-a4afc0070726 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:01.696683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b2b81c41-32b5-4bea-94a6-a4afc0070726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:01.699920 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-f11ab074-28fd-4748-9d94-cd55e16be2ca None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 11:06:01.699920 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:01.699920 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:01.699920 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:01.699920 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:01.699920 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:01.699920 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:01.699920 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:01.699920 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:01.699920 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:01.699920 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:01.699920 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:01.699920 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:06:01.699920 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:06:01.699920 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:06:01.699920 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:06:01.700846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:01.700846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:01.700846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:06:01.700846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:01.700846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:06:01.700846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:01.700846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:01.700846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:01.700846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:01.700846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:01.700846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:01.700846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:01.700846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:01.700846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:01.700846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:01.700846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:01.700846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:01.700846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:01.701838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:01.701838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:01.701838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:06:01.701838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:06:01.701838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:06:01.701838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:06:01.701838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:06:01.701838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:06:01.701838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 11:06:01.701838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:01.704027 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 314/626] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:06:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:01.704955 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ab074-28fd-4748-9d94-cd55e16be2ca None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:01.757333 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:01.789795 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 313/627] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:06:01.789795 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b81c41-32b5-4bea-94a6-a4afc0070726 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:01.842632 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ab074-28fd-4748-9d94-cd55e16be2ca None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:01.868261 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:01.881702 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0994f-e25d-427c-9ef3-5172102aff4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:01.883298 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0994f-e25d-427c-9ef3-5172102aff4c None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:01.883298 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0994f-e25d-427c-9ef3-5172102aff4c None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:01.883594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0994f-e25d-427c-9ef3-5172102aff4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:01.887687 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b81c41-32b5-4bea-94a6-a4afc0070726 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:01.892366 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e0994f-e25d-427c-9ef3-5172102aff4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:01.894665 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e0994f-e25d-427c-9ef3-5172102aff4c None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:01.912923 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-f5e0994f-e25d-427c-9ef3-5172102aff4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:01.912923 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:01.912923 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:01.912923 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:01.912923 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:01.912923 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:01.912923 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:01.912923 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:01.912923 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:01.912923 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:01.912923 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:01.912923 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:01.912923 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:06:01.912923 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:06:01.912923 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:06:01.914098 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:06:01.914098 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:01.914098 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:01.914098 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:01.914098 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:01.914098 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:01.914098 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:01.914098 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:01.914098 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:01.914098 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:01.914098 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:01.914098 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:01.914098 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:01.914098 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:01.914098 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:01.914098 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:01.914098 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:01.915195 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:06:01.915195 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:06:01.915195 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:06:01.915195 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:06:01.915195 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:06:01.915195 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:06:01.915195 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:01.915195 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:01.917382 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 315/628] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:06:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:01.918589 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0994f-e25d-427c-9ef3-5172102aff4c None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:01.927127 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7c68c-cf29-45f0-8153-84e87e052316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:01.927812 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7c68c-cf29-45f0-8153-84e87e052316 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:01.928144 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7c68c-cf29-45f0-8153-84e87e052316 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:01.928428 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7c68c-cf29-45f0-8153-84e87e052316 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:01.929280 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7c68c-cf29-45f0-8153-84e87e052316 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:01.929593 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7c68c-cf29-45f0-8153-84e87e052316 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:01.931105 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7c68c-cf29-45f0-8153-84e87e052316 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:01.950228 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 314/629] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Jul 11 11:06:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:01.951075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7c68c-cf29-45f0-8153-84e87e052316 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:02.004770 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:02.031477 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0994f-e25d-427c-9ef3-5172102aff4c None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:02.059298 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7c68c-cf29-45f0-8153-84e87e052316 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:02.071211 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeca397-16b6-494c-9a0c-2f7b984ecd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:02.072280 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeca397-16b6-494c-9a0c-2f7b984ecd08 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:02.072746 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeca397-16b6-494c-9a0c-2f7b984ecd08 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:02.073324 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeca397-16b6-494c-9a0c-2f7b984ecd08 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:02.085014 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeca397-16b6-494c-9a0c-2f7b984ecd08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:06:02.094110 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-0eeca397-16b6-494c-9a0c-2f7b984ecd08 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:06:02.094110 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:02.094110 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:02.094110 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:02.094110 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:02.094110 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:02.094110 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:02.094110 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:02.094110 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:02.094110 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:02.094110 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:02.094110 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:02.094110 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:06:02.094110 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:06:02.094110 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:06:02.094110 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:06:02.095031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:06:02.095031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:06:02.095031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:06:02.095031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:06:02.095031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:02.095031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:02.095031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:02.095031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:02.095031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:02.095031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:02.095031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:02.095031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:02.095031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:02.095031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:02.095031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:02.095031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:02.095873 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:02.095873 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:02.095873 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:02.095873 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:02.095873 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:06:02.095873 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:06:02.095873 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:06:02.095873 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:06:02.095873 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:06:02.095873 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:06:02.095873 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:06:02.095873 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:02.096492 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b266c-361a-4909-a3ea-007790106176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:02.096492 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b266c-361a-4909-a3ea-007790106176 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:02.096492 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b266c-361a-4909-a3ea-007790106176 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:02.096492 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b266c-361a-4909-a3ea-007790106176 None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:02.096765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b266c-361a-4909-a3ea-007790106176 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:02.096765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b266c-361a-4909-a3ea-007790106176 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:02.098824 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b266c-361a-4909-a3ea-007790106176 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:02.104433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 316/630] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jul 11 11:06:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:02.105425 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeca397-16b6-494c-9a0c-2f7b984ecd08 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:02.111006 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 315/631] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:06:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:02.113880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b266c-361a-4909-a3ea-007790106176 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:02.159019 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:02.219854 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b266c-361a-4909-a3ea-007790106176 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:02.223748 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeca397-16b6-494c-9a0c-2f7b984ecd08 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:02.227488 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:02.255371 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14afd4-d97d-4574-9b95-52f86c91fd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:02.256055 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14afd4-d97d-4574-9b95-52f86c91fd75 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:02.256341 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14afd4-d97d-4574-9b95-52f86c91fd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:02.256620 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14afd4-d97d-4574-9b95-52f86c91fd75 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:02.257372 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14afd4-d97d-4574-9b95-52f86c91fd75 None admin] RBAC: Adding query filter params (name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:02.257684 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14afd4-d97d-4574-9b95-52f86c91fd75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:02.259112 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14afd4-d97d-4574-9b95-52f86c91fd75 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:02.263468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c658a0-cc5f-4b80-9e6d-13f51e32d6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:02.264873 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c658a0-cc5f-4b80-9e6d-13f51e32d6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:02.265376 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c658a0-cc5f-4b80-9e6d-13f51e32d6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:02.265909 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c658a0-cc5f-4b80-9e6d-13f51e32d6e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:02.272621 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 316/632] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jul 11 11:06:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:02.272621 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14afd4-d97d-4574-9b95-52f86c91fd75 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:02.285159 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c658a0-cc5f-4b80-9e6d-13f51e32d6e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:02.287203 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c658a0-cc5f-4b80-9e6d-13f51e32d6e8 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:02.312078 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-85c658a0-cc5f-4b80-9e6d-13f51e32d6e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:02.312078 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:02.312078 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:02.312078 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:02.312078 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:02.312078 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:02.312078 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:02.312078 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:02.312078 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:02.312078 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:02.312078 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:02.312078 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:02.312078 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:02.312078 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:02.312078 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:02.313200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:02.313200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:02.313200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:02.313200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:02.313200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:02.313200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:02.313200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:02.313200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:02.313200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:02.313200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:02.313200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:02.313200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:02.313200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:02.313200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:02.313200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:02.313200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:02.313200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:02.314296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:02.314296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:02.314296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:02.314296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:02.317838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 317/633] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:02.318890 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c658a0-cc5f-4b80-9e6d-13f51e32d6e8 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:02.401293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14afd4-d97d-4574-9b95-52f86c91fd75 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:02.437410 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:02.437599 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58790b71-fc0c-47c4-bb75-bac4c63c96fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:02.438335 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58790b71-fc0c-47c4-bb75-bac4c63c96fb None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:02.438510 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58790b71-fc0c-47c4-bb75-bac4c63c96fb None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:02.438759 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58790b71-fc0c-47c4-bb75-bac4c63c96fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:02.439645 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58790b71-fc0c-47c4-bb75-bac4c63c96fb None admin] RBAC: Adding query filter params (role.id=9b682db1e9a5486884a74f5c01953fe7, scope.project.id=38ed7416526e473b816330e24acf7a04, user.id=5b9e7594afc346e593ef3e6c579e237b) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:02.439951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58790b71-fc0c-47c4-bb75-bac4c63c96fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:02.441438 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58790b71-fc0c-47c4-bb75-bac4c63c96fb None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:02.445684 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c658a0-cc5f-4b80-9e6d-13f51e32d6e8 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:02.457900 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 317/634] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:06:02 2022] GET /identity/v3/role_assignments?user.id=5b9e7594afc346e593ef3e6c579e237b&scope.project.id=38ed7416526e473b816330e24acf7a04&role.id=9b682db1e9a5486884a74f5c01953fe7 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:02.457900 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58790b71-fc0c-47c4-bb75-bac4c63c96fb None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:02.494996 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:02.504063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98fbfe-f938-4741-bb7f-60fe62a99b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:02.504891 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98fbfe-f938-4741-bb7f-60fe62a99b03 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:02.505849 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98fbfe-f938-4741-bb7f-60fe62a99b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:02.506139 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98fbfe-f938-4741-bb7f-60fe62a99b03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:02.522047 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c98fbfe-f938-4741-bb7f-60fe62a99b03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:02.524098 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c98fbfe-f938-4741-bb7f-60fe62a99b03 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:02.549238 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-9c98fbfe-f938-4741-bb7f-60fe62a99b03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:02.549238 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:02.549238 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:02.549238 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:02.549238 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:02.549238 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:02.549238 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:02.549238 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:02.549238 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:02.549238 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:02.549238 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:02.549238 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:02.549238 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:02.549238 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:02.549238 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:02.550208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:02.550208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:02.550208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:02.550208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:02.550208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:02.550208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:02.550208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:02.550208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:02.550208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:02.550208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:02.550208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:02.550208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:02.550208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:02.550208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:02.550208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:02.550208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:02.550208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:02.551816 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:02.551816 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:02.551816 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:02.551816 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:02.551816 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 318/635] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:02.553202 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9ff01-3950-45d2-8087-4f95470b0cc6 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:02.553202 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9ff01-3950-45d2-8087-4f95470b0cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:02.553202 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9ff01-3950-45d2-8087-4f95470b0cc6 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:02.556936 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 319/636] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:02.557940 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9ff01-3950-45d2-8087-4f95470b0cc6 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:02.585597 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58790b71-fc0c-47c4-bb75-bac4c63c96fb None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:02.634440 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e2745-64b5-4588-86b9-bab92cce39a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:02.635169 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e2745-64b5-4588-86b9-bab92cce39a1 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:02.635410 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e2745-64b5-4588-86b9-bab92cce39a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:02.635691 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e2745-64b5-4588-86b9-bab92cce39a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:02.636420 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e2745-64b5-4588-86b9-bab92cce39a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:02.636730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e2745-64b5-4588-86b9-bab92cce39a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:02.638124 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e2745-64b5-4588-86b9-bab92cce39a1 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:02.651012 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 318/637] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:02.652382 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadb2c7-7d21-4d7c-8730-5850f3be666b None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:02.652683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadb2c7-7d21-4d7c-8730-5850f3be666b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:02.652970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadb2c7-7d21-4d7c-8730-5850f3be666b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:02.669982 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-6dadb2c7-7d21-4d7c-8730-5850f3be666b None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:02.671185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6dadb2c7-7d21-4d7c-8730-5850f3be666b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:02.678832 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9ff01-3950-45d2-8087-4f95470b0cc6 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:02.724483 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99bdc5-6dea-4b73-96e8-e7dc9c254f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:02.725303 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99bdc5-6dea-4b73-96e8-e7dc9c254f38 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:02.725595 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99bdc5-6dea-4b73-96e8-e7dc9c254f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:02.726533 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99bdc5-6dea-4b73-96e8-e7dc9c254f38 None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:02.726902 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99bdc5-6dea-4b73-96e8-e7dc9c254f38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:02.727712 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99bdc5-6dea-4b73-96e8-e7dc9c254f38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:02.729087 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99bdc5-6dea-4b73-96e8-e7dc9c254f38 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:02.742953 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 320/638] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:02.743902 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99bdc5-6dea-4b73-96e8-e7dc9c254f38 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:02.753371 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 319/639] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:06:02.754655 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadb2c7-7d21-4d7c-8730-5850f3be666b None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:02.755659 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:02.790615 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:02.854734 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99bdc5-6dea-4b73-96e8-e7dc9c254f38 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:02.875742 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadb2c7-7d21-4d7c-8730-5850f3be666b None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:02.890498 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec67174-1b8a-403e-90e9-d7591c6d30e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:02.891297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec67174-1b8a-403e-90e9-d7591c6d30e5 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:02.891585 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec67174-1b8a-403e-90e9-d7591c6d30e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:02.891867 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec67174-1b8a-403e-90e9-d7591c6d30e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:02.898781 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec67174-1b8a-403e-90e9-d7591c6d30e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:02.900245 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec67174-1b8a-403e-90e9-d7591c6d30e5 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:02.913815 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb61644-115d-46e7-902d-42ac68483d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:02.915146 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-5ec67174-1b8a-403e-90e9-d7591c6d30e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:02.915146 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:02.915146 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:02.915146 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:02.915146 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:02.915146 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:02.915146 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:02.915146 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:02.915146 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:02.915146 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:02.915146 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:02.915146 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:02.915146 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:06:02.915146 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:06:02.915146 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:06:02.916143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:06:02.916143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:02.916143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:02.916143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:02.916143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:02.916143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:02.916143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:02.916143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:02.916143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:02.916143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:02.916143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:02.916143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:02.916143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:02.916143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:02.916143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:02.916143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:02.916143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:02.917165 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:06:02.917165 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:06:02.917165 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:06:02.917165 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:06:02.917165 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:06:02.917165 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:06:02.917165 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:02.917165 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:02.917165 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 321/640] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:06:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:02.917725 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec67174-1b8a-403e-90e9-d7591c6d30e5 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:02.917959 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb61644-115d-46e7-902d-42ac68483d40 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:02.918387 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb61644-115d-46e7-902d-42ac68483d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:02.918792 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb61644-115d-46e7-902d-42ac68483d40 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:02.926969 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb61644-115d-46e7-902d-42ac68483d40 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:02.928411 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb61644-115d-46e7-902d-42ac68483d40 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:02.943973 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-ccb61644-115d-46e7-902d-42ac68483d40 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 11:06:02.943973 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:02.943973 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:02.943973 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:02.943973 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:02.943973 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:02.943973 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:02.943973 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:02.943973 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:02.943973 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:02.943973 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:02.943973 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:02.943973 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:06:02.943973 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:06:02.943973 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:06:02.943973 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:06:02.945015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:02.945015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:02.945015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:06:02.945015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:02.945015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:06:02.945015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:02.945015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:02.945015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:02.945015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:02.945015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:02.945015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:02.945015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:02.945015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:02.945015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:02.945015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:02.945015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:02.945015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:02.945015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:02.946045 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:02.946045 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:02.946045 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:06:02.946045 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:06:02.946045 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:06:02.946045 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:06:02.946045 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:06:02.946045 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:06:02.946045 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 11:06:02.946045 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:02.946045 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 320/641] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:06:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:02.946646 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afe858-3e9d-45fb-a1e7-c501a335207a None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:02.946723 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afe858-3e9d-45fb-a1e7-c501a335207a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:02.947745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afe858-3e9d-45fb-a1e7-c501a335207a None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:02.952333 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 321/642] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:02.952333 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afe858-3e9d-45fb-a1e7-c501a335207a None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:02.997975 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:03.035709 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec67174-1b8a-403e-90e9-d7591c6d30e5 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:03.038906 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:03.058570 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afe858-3e9d-45fb-a1e7-c501a335207a None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:03.074419 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c46504-cad5-4a24-8f2d-02c539e4d3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:03.075220 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c46504-cad5-4a24-8f2d-02c539e4d3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:03.075508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c46504-cad5-4a24-8f2d-02c539e4d3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:03.075789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c46504-cad5-4a24-8f2d-02c539e4d3c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:03.086720 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c46504-cad5-4a24-8f2d-02c539e4d3c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:06:03.094361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-02c46504-cad5-4a24-8f2d-02c539e4d3c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:06:03.094361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:03.094361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:03.094361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:03.094361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:03.094361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:03.094361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:03.094361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:03.094361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:03.094361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:03.094361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:03.094361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:03.094361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:06:03.094361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:06:03.094361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:06:03.094361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:06:03.095468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:06:03.095468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:06:03.095468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:06:03.095468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:06:03.095468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:03.095468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:03.095468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:03.095468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:03.095468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:03.095468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:03.095468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:03.095468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:03.095468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:03.095468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:03.095468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:03.095468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:03.096373 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:03.096373 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:03.096373 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:03.096373 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:03.096373 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:06:03.096373 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:06:03.096373 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:06:03.096373 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:06:03.096373 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:06:03.096373 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:06:03.096373 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:06:03.096373 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:03.096373 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 322/643] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jul 11 11:06:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:03.096373 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c46504-cad5-4a24-8f2d-02c539e4d3c4 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:03.101011 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3cc85-4ef4-459d-9ae5-d327077ff7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:03.101889 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3cc85-4ef4-459d-9ae5-d327077ff7ec None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:03.102316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3cc85-4ef4-459d-9ae5-d327077ff7ec None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:03.102737 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3cc85-4ef4-459d-9ae5-d327077ff7ec None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:03.103676 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3cc85-4ef4-459d-9ae5-d327077ff7ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:03.104142 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3cc85-4ef4-459d-9ae5-d327077ff7ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:03.105634 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3cc85-4ef4-459d-9ae5-d327077ff7ec None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:03.118784 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 322/644] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:06:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:03.119913 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1325cf1-79c2-4909-86b8-f6835b731343 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:03.120206 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1325cf1-79c2-4909-86b8-f6835b731343 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:03.120485 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1325cf1-79c2-4909-86b8-f6835b731343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:03.137081 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-f1325cf1-79c2-4909-86b8-f6835b731343 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:03.138309 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f1325cf1-79c2-4909-86b8-f6835b731343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:03.205536 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 323/645] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:06:03.206403 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1325cf1-79c2-4909-86b8-f6835b731343 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:03.219539 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c46504-cad5-4a24-8f2d-02c539e4d3c4 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:03.247835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:03.257404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4a3e5-0f44-4b77-9bc0-a94e764d673c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:03.258124 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4a3e5-0f44-4b77-9bc0-a94e764d673c None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:03.258412 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4a3e5-0f44-4b77-9bc0-a94e764d673c None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:03.258812 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4a3e5-0f44-4b77-9bc0-a94e764d673c None admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:03.259774 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4a3e5-0f44-4b77-9bc0-a94e764d673c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:03.261339 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4a3e5-0f44-4b77-9bc0-a94e764d673c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:03.261637 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4a3e5-0f44-4b77-9bc0-a94e764d673c None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:03.284911 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 323/646] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Jul 11 11:06:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:03.284911 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4a3e5-0f44-4b77-9bc0-a94e764d673c None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:03.290863 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:03.324622 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1325cf1-79c2-4909-86b8-f6835b731343 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:03.367419 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23baf55c-cb51-4221-8cef-7e836461b1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:03.368001 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23baf55c-cb51-4221-8cef-7e836461b1ad None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:03.368402 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23baf55c-cb51-4221-8cef-7e836461b1ad None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:03.368680 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23baf55c-cb51-4221-8cef-7e836461b1ad None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:03.369553 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23baf55c-cb51-4221-8cef-7e836461b1ad None admin] RBAC: Adding query filter params (name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:03.369895 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23baf55c-cb51-4221-8cef-7e836461b1ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:03.371253 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23baf55c-cb51-4221-8cef-7e836461b1ad None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:03.384933 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 324/647] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jul 11 11:06:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:03.384933 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23baf55c-cb51-4221-8cef-7e836461b1ad None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:03.392537 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4a3e5-0f44-4b77-9bc0-a94e764d673c None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:03.428303 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518dbb84-f567-479b-a4d7-cecddb272436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:03.429217 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dbb84-f567-479b-a4d7-cecddb272436 None admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:03.429504 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dbb84-f567-479b-a4d7-cecddb272436 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:03.429809 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dbb84-f567-479b-a4d7-cecddb272436 None admin] PATH_INFO: `/v3/projects/38ed7416526e473b816330e24acf7a04/users/736f6d4d1dbb47ff98bc67e53614d49c/roles/9b682db1e9a5486884a74f5c01953fe7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:03.445251 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518dbb84-f567-479b-a4d7-cecddb272436 None admin] RBAC: Authorizing `identity:create_grant(project_id=38ed7416526e473b816330e24acf7a04, user_id=736f6d4d1dbb47ff98bc67e53614d49c, role_id=9b682db1e9a5486884a74f5c01953fe7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:03.446757 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518dbb84-f567-479b-a4d7-cecddb272436 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:03.488715 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23baf55c-cb51-4221-8cef-7e836461b1ad None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:03.530166 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 324/648] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jul 11 11:06:03 2022] PUT /identity/v3/projects/38ed7416526e473b816330e24acf7a04/users/736f6d4d1dbb47ff98bc67e53614d49c/roles/9b682db1e9a5486884a74f5c01953fe7 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:06:03.531426 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518dbb84-f567-479b-a4d7-cecddb272436 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:03.531568 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130598f-c099-4edf-ab28-c68a13f1cbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:03.532318 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130598f-c099-4edf-ab28-c68a13f1cbb3 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:03.532603 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130598f-c099-4edf-ab28-c68a13f1cbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:03.532880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130598f-c099-4edf-ab28-c68a13f1cbb3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:03.536379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:03.546878 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130598f-c099-4edf-ab28-c68a13f1cbb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:06:03.556176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-e130598f-c099-4edf-ab28-c68a13f1cbb3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:06:03.556176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:03.556176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:03.556176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:03.556176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:03.556176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:03.556176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:03.556176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:03.556176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:03.556176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:03.556176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:03.556176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:03.556176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:06:03.556176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:06:03.556176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:06:03.556176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:06:03.557198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:06:03.557198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:06:03.557198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:06:03.557198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:06:03.557198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:03.557198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:03.557198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:03.557198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:03.557198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:03.557198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:03.557198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:03.557198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:03.557198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:03.557198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:03.557198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:03.557198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:03.558148 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:03.558148 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:03.558148 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:03.558148 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:03.558148 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:06:03.558148 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:06:03.558148 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:06:03.558148 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:06:03.558148 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:06:03.558148 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:06:03.558148 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:06:03.558148 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:03.562297 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 325/649] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jul 11 11:06:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:03.563584 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130598f-c099-4edf-ab28-c68a13f1cbb3 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:03.588718 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:03.667391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518dbb84-f567-479b-a4d7-cecddb272436 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:03.708871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9119867-050e-4f31-9c1e-d91fd2cd84af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:03.709541 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9119867-050e-4f31-9c1e-d91fd2cd84af None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:03.711160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9119867-050e-4f31-9c1e-d91fd2cd84af None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:03.711160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9119867-050e-4f31-9c1e-d91fd2cd84af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:03.720733 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130598f-c099-4edf-ab28-c68a13f1cbb3 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:03.775589 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea28ac-4eb8-409d-92f1-c11d8394cf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:03.776426 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea28ac-4eb8-409d-92f1-c11d8394cf16 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:03.776720 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea28ac-4eb8-409d-92f1-c11d8394cf16 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:03.777377 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea28ac-4eb8-409d-92f1-c11d8394cf16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:03.792283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea28ac-4eb8-409d-92f1-c11d8394cf16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:03.793815 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea28ac-4eb8-409d-92f1-c11d8394cf16 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:03.804143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9119867-050e-4f31-9c1e-d91fd2cd84af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:03.806152 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9119867-050e-4f31-9c1e-d91fd2cd84af None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:03.812931 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-08ea28ac-4eb8-409d-92f1-c11d8394cf16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:03.812931 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:03.812931 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:03.812931 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:03.812931 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:03.812931 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:03.812931 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:03.812931 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:03.812931 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:03.812931 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:03.812931 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:03.812931 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:03.812931 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:03.812931 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:03.812931 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:03.814019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:03.814019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:03.814019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:03.814019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:03.814019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:03.814019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:03.814019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:03.814019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:03.814019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:03.814019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:03.814019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:03.814019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:03.814019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:03.814019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:03.814019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:03.814019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:03.814019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:03.815063 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:03.815063 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:03.815063 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:03.815063 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:03.815063 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 326/650] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:03.815341 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea28ac-4eb8-409d-92f1-c11d8394cf16 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:03.852354 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:03.874524 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:03.931132 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea28ac-4eb8-409d-92f1-c11d8394cf16 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:03.947636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 325/651] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:06:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:06:03.948849 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9119867-050e-4f31-9c1e-d91fd2cd84af None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:03.972171 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45cb30-6920-4475-b719-1d550b56a102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:03.973453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45cb30-6920-4475-b719-1d550b56a102 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:03.973834 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45cb30-6920-4475-b719-1d550b56a102 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:03.974186 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45cb30-6920-4475-b719-1d550b56a102 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:03.975003 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45cb30-6920-4475-b719-1d550b56a102 None admin] RBAC: Adding query filter params (name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:03.975431 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45cb30-6920-4475-b719-1d550b56a102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:03.976923 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45cb30-6920-4475-b719-1d550b56a102 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:03.989833 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 327/652] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jul 11 11:06:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:03.990821 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45cb30-6920-4475-b719-1d550b56a102 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:04.069844 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9119867-050e-4f31-9c1e-d91fd2cd84af None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:04.109606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4fb640-95a4-4471-88ab-90310341e507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:04.110547 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fb640-95a4-4471-88ab-90310341e507 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:04.111002 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fb640-95a4-4471-88ab-90310341e507 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:04.111253 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45cb30-6920-4475-b719-1d550b56a102 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:04.111591 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fb640-95a4-4471-88ab-90310341e507 None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:04.112474 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4fb640-95a4-4471-88ab-90310341e507 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:04.113533 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4fb640-95a4-4471-88ab-90310341e507 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:04.115085 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4fb640-95a4-4471-88ab-90310341e507 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:04.116782 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:04.121882 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:04.129600 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 326/653] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:04.133080 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4fb640-95a4-4471-88ab-90310341e507 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:04.153201 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa626966-31e9-479f-98f0-9c76f522f90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:04.154139 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa626966-31e9-479f-98f0-9c76f522f90c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:04.154428 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa626966-31e9-479f-98f0-9c76f522f90c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:04.154752 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa626966-31e9-479f-98f0-9c76f522f90c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:04.166346 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa626966-31e9-479f-98f0-9c76f522f90c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:04.168465 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa626966-31e9-479f-98f0-9c76f522f90c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:04.186544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-fa626966-31e9-479f-98f0-9c76f522f90c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:04.186544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:04.186544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:04.186544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:04.186544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:04.186544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:04.186544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:04.186544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:04.186544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:04.186544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:04.186544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:04.186544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:04.186544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:04.186544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:04.186544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:04.187512 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:04.187512 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:04.187512 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:04.187512 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:04.187512 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:04.187512 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:04.187512 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:04.187512 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:04.187512 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:04.187512 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:04.187512 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:04.187512 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:04.187512 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:04.187512 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:04.187512 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:04.187512 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:04.187512 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:04.188391 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:04.188391 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:04.188391 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:04.188391 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:04.193005 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 328/654] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:04.194527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa626966-31e9-479f-98f0-9c76f522f90c None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:04.241395 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4fb640-95a4-4471-88ab-90310341e507 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:04.277489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3091a-d8d5-4e95-9e56-51e3f5675c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:04.278703 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3091a-d8d5-4e95-9e56-51e3f5675c4a None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:04.279200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3091a-d8d5-4e95-9e56-51e3f5675c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:04.279653 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3091a-d8d5-4e95-9e56-51e3f5675c4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:04.292012 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3091a-d8d5-4e95-9e56-51e3f5675c4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:04.294274 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3091a-d8d5-4e95-9e56-51e3f5675c4a None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:04.300928 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa626966-31e9-479f-98f0-9c76f522f90c None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:04.314504 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-41f3091a-d8d5-4e95-9e56-51e3f5675c4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:04.314504 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:04.314504 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:04.314504 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:04.314504 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:04.314504 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:04.314504 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:04.314504 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:04.314504 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:04.314504 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:04.314504 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:04.314504 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:04.314504 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:04.314504 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:04.314504 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:04.315401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:04.315401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:04.315401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:04.315401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:04.315401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:04.315401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:04.315401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:04.315401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:04.315401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:04.315401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:04.315401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:04.315401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:04.315401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:04.315401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:04.315401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:04.315401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:04.315401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:04.316954 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:04.316954 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:04.316954 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:04.316954 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:04.319322 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 327/655] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:04.320297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3091a-d8d5-4e95-9e56-51e3f5675c4a None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:04.342023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685effa-16f1-4b91-b1b3-fe8062d3850e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:04.342854 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685effa-16f1-4b91-b1b3-fe8062d3850e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:04.343142 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685effa-16f1-4b91-b1b3-fe8062d3850e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:04.343421 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685effa-16f1-4b91-b1b3-fe8062d3850e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:04.358114 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685effa-16f1-4b91-b1b3-fe8062d3850e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:04.359551 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685effa-16f1-4b91-b1b3-fe8062d3850e None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:04.374759 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-9685effa-16f1-4b91-b1b3-fe8062d3850e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 11:06:04.374759 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:04.374759 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:04.374759 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:04.374759 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:04.374759 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:04.374759 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:04.374759 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:04.374759 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:04.374759 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:04.374759 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:04.374759 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:04.374759 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:06:04.374759 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:06:04.374759 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:06:04.374759 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:06:04.375788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:04.375788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:04.375788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:06:04.375788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:04.375788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:06:04.375788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:04.375788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:04.375788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:04.375788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:04.375788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:04.375788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:04.375788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:04.375788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:04.375788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:04.375788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:04.375788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:04.375788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:04.375788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:04.376732 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:04.376732 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:04.376732 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:06:04.376732 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:06:04.376732 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:06:04.376732 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:06:04.376732 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:06:04.376732 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:06:04.376732 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 11:06:04.376732 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:04.381178 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 329/656] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jul 11 11:06:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:04.382051 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685effa-16f1-4b91-b1b3-fe8062d3850e None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:04.390848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:04.406336 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:04.454278 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3091a-d8d5-4e95-9e56-51e3f5675c4a None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:04.491111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146aaea9-e660-429c-8abe-50b871474b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:04.491777 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146aaea9-e660-429c-8abe-50b871474b4e None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:04.492063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146aaea9-e660-429c-8abe-50b871474b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:04.492338 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146aaea9-e660-429c-8abe-50b871474b4e None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:04.493059 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146aaea9-e660-429c-8abe-50b871474b4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:04.493367 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146aaea9-e660-429c-8abe-50b871474b4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:04.494986 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146aaea9-e660-429c-8abe-50b871474b4e None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:04.505544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685effa-16f1-4b91-b1b3-fe8062d3850e None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:04.512936 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 328/657] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:04.513840 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146aaea9-e660-429c-8abe-50b871474b4e None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:04.554766 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac66f3-7176-4813-9c06-046837c003a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:04.555818 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac66f3-7176-4813-9c06-046837c003a5 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:04.556576 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac66f3-7176-4813-9c06-046837c003a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:04.557959 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac66f3-7176-4813-9c06-046837c003a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:04.559259 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac66f3-7176-4813-9c06-046837c003a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:04.559777 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac66f3-7176-4813-9c06-046837c003a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:04.561397 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac66f3-7176-4813-9c06-046837c003a5 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:04.579106 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 330/658] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:04.580284 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac66f3-7176-4813-9c06-046837c003a5 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:04.642078 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146aaea9-e660-429c-8abe-50b871474b4e None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:04.651453 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:04.681007 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:04.685850 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8637cd-ffe2-4ef5-990a-ee6d131d675d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:04.686450 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8637cd-ffe2-4ef5-990a-ee6d131d675d None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:04.686738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8637cd-ffe2-4ef5-990a-ee6d131d675d None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:04.687019 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8637cd-ffe2-4ef5-990a-ee6d131d675d None admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:04.687894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8637cd-ffe2-4ef5-990a-ee6d131d675d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:04.688200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8637cd-ffe2-4ef5-990a-ee6d131d675d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:04.689640 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8637cd-ffe2-4ef5-990a-ee6d131d675d None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:04.702518 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac66f3-7176-4813-9c06-046837c003a5 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:04.713379 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 329/659] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Jul 11 11:06:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:04.716143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8637cd-ffe2-4ef5-990a-ee6d131d675d None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:04.743967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb501aae-3ccd-4260-b9e8-0aa86589e9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:04.746726 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb501aae-3ccd-4260-b9e8-0aa86589e9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:04.746726 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb501aae-3ccd-4260-b9e8-0aa86589e9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:04.746726 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb501aae-3ccd-4260-b9e8-0aa86589e9f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:04.752823 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb501aae-3ccd-4260-b9e8-0aa86589e9f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:04.754578 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb501aae-3ccd-4260-b9e8-0aa86589e9f7 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:04.768875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-eb501aae-3ccd-4260-b9e8-0aa86589e9f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:04.768875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:04.768875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:04.768875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:04.768875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:04.768875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:04.768875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:04.768875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:04.768875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:04.768875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:04.768875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:04.768875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:04.768875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:06:04.768875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:06:04.768875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:06:04.770517 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:06:04.770517 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:04.770517 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:04.770517 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:04.770517 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:04.770517 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:04.770517 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:04.770517 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:04.770517 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:04.770517 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:04.770517 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:04.770517 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:04.770517 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:04.770517 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:04.770517 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:04.770517 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:04.770517 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:04.771401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:06:04.771401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:06:04.771401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:06:04.771401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:06:04.771401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:06:04.771401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:06:04.771401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:04.771401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:04.775918 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 331/660] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:06:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:04.777260 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ac7d8-ad02-4fcd-8943-f5e14507fe6f None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:04.783705 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ac7d8-ad02-4fcd-8943-f5e14507fe6f None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:04.783705 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ac7d8-ad02-4fcd-8943-f5e14507fe6f None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:04.783705 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 332/661] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:04.783705 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ac7d8-ad02-4fcd-8943-f5e14507fe6f None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:04.848014 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8637cd-ffe2-4ef5-990a-ee6d131d675d None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:04.883633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600744d-f1a3-4683-9660-86282f73d6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:04.884420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600744d-f1a3-4683-9660-86282f73d6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:04.884709 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600744d-f1a3-4683-9660-86282f73d6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:04.884991 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600744d-f1a3-4683-9660-86282f73d6b6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:04.888881 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ac7d8-ad02-4fcd-8943-f5e14507fe6f None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:04.892046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600744d-f1a3-4683-9660-86282f73d6b6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:04.893487 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600744d-f1a3-4683-9660-86282f73d6b6 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:04.908152 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-b600744d-f1a3-4683-9660-86282f73d6b6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 11:06:04.908152 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:04.908152 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:04.908152 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:04.908152 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:04.908152 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:04.908152 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:04.908152 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:04.908152 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:04.908152 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:04.908152 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:04.908152 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:04.908152 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:06:04.908152 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:06:04.908152 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:06:04.908152 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:06:04.909105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:04.909105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:04.909105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:06:04.909105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:04.909105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:06:04.909105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:04.909105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:04.909105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:04.909105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:04.909105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:04.909105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:04.909105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:04.909105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:04.909105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:04.909105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:04.909105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:04.909105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:04.909105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:04.910234 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:04.910234 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:04.910234 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:06:04.910234 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:06:04.910234 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:06:04.910234 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:06:04.910234 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:06:04.910234 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:06:04.910234 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 11:06:04.910234 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:04.910234 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 330/662] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:06:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:04.910994 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600744d-f1a3-4683-9660-86282f73d6b6 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:04.929587 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb67046-edda-4ed3-ad71-07baf95f5b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:04.930269 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb67046-edda-4ed3-ad71-07baf95f5b09 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:04.930556 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb67046-edda-4ed3-ad71-07baf95f5b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:04.930999 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb67046-edda-4ed3-ad71-07baf95f5b09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:04.937846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:04.942385 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:05.005178 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb67046-edda-4ed3-ad71-07baf95f5b09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:05.007148 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb67046-edda-4ed3-ad71-07baf95f5b09 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:05.024660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600744d-f1a3-4683-9660-86282f73d6b6 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:05.060328 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d50af-6b8d-446f-b149-38d8eb56ab8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:05.060993 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d50af-6b8d-446f-b149-38d8eb56ab8f None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:05.061279 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d50af-6b8d-446f-b149-38d8eb56ab8f None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:05.061555 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d50af-6b8d-446f-b149-38d8eb56ab8f None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:05.062384 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d50af-6b8d-446f-b149-38d8eb56ab8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:05.062697 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d50af-6b8d-446f-b149-38d8eb56ab8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:05.064135 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d50af-6b8d-446f-b149-38d8eb56ab8f None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:05.076275 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 331/663] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:06:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:05.077435 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcfa6f-331e-4390-b61d-501c538c072d None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:05.077730 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcfa6f-331e-4390-b61d-501c538c072d None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:05.078038 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcfa6f-331e-4390-b61d-501c538c072d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:05.094857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-71fcfa6f-331e-4390-b61d-501c538c072d None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:05.096025 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-71fcfa6f-331e-4390-b61d-501c538c072d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:05.130934 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 333/664] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:06:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:06:05.132217 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb67046-edda-4ed3-ad71-07baf95f5b09 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:05.168955 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 332/665] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:06:05.170096 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcfa6f-331e-4390-b61d-501c538c072d None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:05.185736 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:05.192138 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:05.247416 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb67046-edda-4ed3-ad71-07baf95f5b09 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:05.282673 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6e389-b0bf-4099-8141-e407a22294ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:05.283356 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6e389-b0bf-4099-8141-e407a22294ce None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:05.283633 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6e389-b0bf-4099-8141-e407a22294ce None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:05.283908 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6e389-b0bf-4099-8141-e407a22294ce None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:05.285290 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a6e389-b0bf-4099-8141-e407a22294ce None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:05.285596 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a6e389-b0bf-4099-8141-e407a22294ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:05.286268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcfa6f-331e-4390-b61d-501c538c072d None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:05.287064 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a6e389-b0bf-4099-8141-e407a22294ce None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:05.305789 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 334/666] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Jul 11 11:06:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:05.310652 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6e389-b0bf-4099-8141-e407a22294ce None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:05.322280 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f31628-7fd2-4932-a0bb-51c750afca4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:05.322942 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f31628-7fd2-4932-a0bb-51c750afca4b None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:05.323444 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f31628-7fd2-4932-a0bb-51c750afca4b None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:05.323552 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f31628-7fd2-4932-a0bb-51c750afca4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:05.324329 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f31628-7fd2-4932-a0bb-51c750afca4b None admin] RBAC: Adding query filter params (role.id=9b682db1e9a5486884a74f5c01953fe7, scope.project.id=38ed7416526e473b816330e24acf7a04, user.id=65a2d8d24562459493a3bcd399665a6b) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:05.324644 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f31628-7fd2-4932-a0bb-51c750afca4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:05.326098 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f31628-7fd2-4932-a0bb-51c750afca4b None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:05.337799 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 333/667] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:06:05 2022] GET /identity/v3/role_assignments?user.id=65a2d8d24562459493a3bcd399665a6b&scope.project.id=38ed7416526e473b816330e24acf7a04&role.id=9b682db1e9a5486884a74f5c01953fe7 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:05.337799 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f31628-7fd2-4932-a0bb-51c750afca4b None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:05.436583 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:05.441550 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6e389-b0bf-4099-8141-e407a22294ce None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:05.461969 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:05.482686 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35df10b-e3e5-46ff-9496-4d568d5a7e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:05.483599 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35df10b-e3e5-46ff-9496-4d568d5a7e69 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:05.483957 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35df10b-e3e5-46ff-9496-4d568d5a7e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:05.484319 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35df10b-e3e5-46ff-9496-4d568d5a7e69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:05.492242 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f31628-7fd2-4932-a0bb-51c750afca4b None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:05.497641 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35df10b-e3e5-46ff-9496-4d568d5a7e69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:05.499220 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35df10b-e3e5-46ff-9496-4d568d5a7e69 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:05.523417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-f35df10b-e3e5-46ff-9496-4d568d5a7e69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:05.523417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:05.523417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:05.523417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:05.523417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:05.523417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:05.523417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:05.523417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:05.523417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:05.523417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:05.523417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:05.523417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:05.523417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:05.523417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:05.523417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:05.524348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:05.524348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:05.524348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:05.524348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:05.524348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:05.524348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:05.524348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:05.524348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:05.524348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:05.524348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:05.524348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:05.524348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:05.524348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:05.524348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:05.524348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:05.524348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:05.524348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:05.525213 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:05.525213 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:05.525213 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:05.525213 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:05.525213 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 335/668] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:05.525489 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35df10b-e3e5-46ff-9496-4d568d5a7e69 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:05.536988 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f20a2-862b-42ec-980c-ceafe276c141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:05.537727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f20a2-862b-42ec-980c-ceafe276c141 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:05.538086 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f20a2-862b-42ec-980c-ceafe276c141 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:05.538363 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f20a2-862b-42ec-980c-ceafe276c141 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:05.556506 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f20a2-862b-42ec-980c-ceafe276c141 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:06:05.564615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-369f20a2-862b-42ec-980c-ceafe276c141 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:06:05.564615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:05.564615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:05.564615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:05.564615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:05.564615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:05.564615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:05.564615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:05.564615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:05.564615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:05.564615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:05.564615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:05.564615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:06:05.564615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:06:05.564615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:06:05.564615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:06:05.565553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:06:05.565553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:06:05.565553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:06:05.565553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:06:05.565553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:05.565553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:05.565553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:05.565553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:05.565553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:05.565553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:05.565553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:05.565553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:05.565553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:05.565553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:05.565553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:05.565553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:05.566660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:05.566660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:05.566660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:05.566660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:05.566660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:06:05.566660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:06:05.566660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:06:05.566660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:06:05.566660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:06:05.566660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:06:05.566660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:06:05.566660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:05.567318 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 334/669] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:06:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:05.567992 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f20a2-862b-42ec-980c-ceafe276c141 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:05.670465 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35df10b-e3e5-46ff-9496-4d568d5a7e69 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:05.680479 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f20a2-862b-42ec-980c-ceafe276c141 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:05.707362 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09633409-2d2d-4630-be7b-52889c48a1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:05.708012 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09633409-2d2d-4630-be7b-52889c48a1ba None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:05.708292 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09633409-2d2d-4630-be7b-52889c48a1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:05.708564 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09633409-2d2d-4630-be7b-52889c48a1ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:05.717238 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b5798-7ccd-485b-8326-8f9fdd078147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:05.717936 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b5798-7ccd-485b-8326-8f9fdd078147 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:05.718224 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b5798-7ccd-485b-8326-8f9fdd078147 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:05.718500 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b5798-7ccd-485b-8326-8f9fdd078147 None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:05.719225 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b5798-7ccd-485b-8326-8f9fdd078147 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:05.719537 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b5798-7ccd-485b-8326-8f9fdd078147 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:05.720911 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b5798-7ccd-485b-8326-8f9fdd078147 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:05.727753 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:05.728008 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:05.737580 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 335/670] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:05.737580 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b5798-7ccd-485b-8326-8f9fdd078147 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:05.789735 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09633409-2d2d-4630-be7b-52889c48a1ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:05.791139 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09633409-2d2d-4630-be7b-52889c48a1ba None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:05.839252 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b5798-7ccd-485b-8326-8f9fdd078147 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:05.873940 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953a330-6c49-4664-a09f-5705f0597dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:05.874603 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953a330-6c49-4664-a09f-5705f0597dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:05.874894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953a330-6c49-4664-a09f-5705f0597dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:05.875182 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953a330-6c49-4664-a09f-5705f0597dc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:05.875940 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953a330-6c49-4664-a09f-5705f0597dc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:05.876254 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953a330-6c49-4664-a09f-5705f0597dc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:05.877628 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953a330-6c49-4664-a09f-5705f0597dc1 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:05.891172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 336/671] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:06:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:05.891172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a7877-f1be-4528-a56a-7fee65b0797a None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:05.891172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a7877-f1be-4528-a56a-7fee65b0797a None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:05.891172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a7877-f1be-4528-a56a-7fee65b0797a None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:05.891172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 337/672] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:05.891172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a7877-f1be-4528-a56a-7fee65b0797a None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:05.905363 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 336/673] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:06:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:06:05.910921 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09633409-2d2d-4630-be7b-52889c48a1ba None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:05.954029 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:05.966516 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:06.000955 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a7877-f1be-4528-a56a-7fee65b0797a None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:06.023338 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09633409-2d2d-4630-be7b-52889c48a1ba None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:06.043628 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d05f7d-fb44-4346-8ef0-dd9c8f27a2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:06.044350 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d05f7d-fb44-4346-8ef0-dd9c8f27a2ae None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:06.044633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d05f7d-fb44-4346-8ef0-dd9c8f27a2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:06.044911 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d05f7d-fb44-4346-8ef0-dd9c8f27a2ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:06.051854 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d05f7d-fb44-4346-8ef0-dd9c8f27a2ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:06.053293 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d05f7d-fb44-4346-8ef0-dd9c8f27a2ae None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:06.062051 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb37b53-e9ac-4d63-b59a-3b19ee743a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:06.062051 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb37b53-e9ac-4d63-b59a-3b19ee743a68 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:06.062051 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb37b53-e9ac-4d63-b59a-3b19ee743a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:06.062051 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb37b53-e9ac-4d63-b59a-3b19ee743a68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:06.068669 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-04d05f7d-fb44-4346-8ef0-dd9c8f27a2ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:06.068669 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:06.068669 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:06.068669 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:06.068669 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:06.068669 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:06.068669 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:06.068669 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:06.068669 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:06.068669 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:06.068669 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:06.068669 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:06.068669 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:06:06.068669 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:06:06.068669 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:06:06.069529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:06:06.069529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:06.069529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:06.069529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:06.069529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:06.069529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:06.069529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:06.069529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:06.069529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:06.069529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:06.069529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:06.069529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:06.069529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:06.069529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:06.069529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:06.069529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:06.069529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:06.070427 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:06:06.070427 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:06:06.070427 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:06:06.070427 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:06:06.070427 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:06:06.070427 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:06:06.070427 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:06.070427 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:06.070427 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 338/674] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:06:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:06.071401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378a2e8-df6c-4cfb-bab4-32f4ae9d9055 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:06.071689 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378a2e8-df6c-4cfb-bab4-32f4ae9d9055 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:06.071968 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378a2e8-df6c-4cfb-bab4-32f4ae9d9055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:06.083737 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb37b53-e9ac-4d63-b59a-3b19ee743a68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:06.085208 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb37b53-e9ac-4d63-b59a-3b19ee743a68 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:06.094830 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-9378a2e8-df6c-4cfb-bab4-32f4ae9d9055 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:06.096031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-9378a2e8-df6c-4cfb-bab4-32f4ae9d9055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:06.104836 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-ffb37b53-e9ac-4d63-b59a-3b19ee743a68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:06.104836 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:06.104836 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:06.104836 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:06.104836 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:06.104836 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:06.104836 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:06.104836 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:06.104836 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:06.104836 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:06.104836 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:06.104836 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:06.104836 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:06.104836 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:06.104836 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:06.105726 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:06.105726 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:06.105726 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:06.105726 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:06.105726 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:06.105726 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:06.105726 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:06.105726 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:06.105726 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:06.105726 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:06.105726 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:06.105726 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:06.105726 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:06.105726 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:06.105726 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:06.105726 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:06.105726 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:06.106891 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:06.106891 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:06.106891 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:06.106891 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:06.106891 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 337/675] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:06.107404 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb37b53-e9ac-4d63-b59a-3b19ee743a68 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:06.172932 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 339/676] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:06:06.173810 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378a2e8-df6c-4cfb-bab4-32f4ae9d9055 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:06.218818 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb37b53-e9ac-4d63-b59a-3b19ee743a68 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:06.221222 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:06.236632 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:06.257347 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab04bc-ba2d-4e18-a913-70236f303a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:06.258199 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab04bc-ba2d-4e18-a913-70236f303a6a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:06.258488 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab04bc-ba2d-4e18-a913-70236f303a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:06.258769 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab04bc-ba2d-4e18-a913-70236f303a6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:06.269890 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab04bc-ba2d-4e18-a913-70236f303a6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:06.271339 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab04bc-ba2d-4e18-a913-70236f303a6a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:06.287122 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378a2e8-df6c-4cfb-bab4-32f4ae9d9055 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:06.289061 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-88ab04bc-ba2d-4e18-a913-70236f303a6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:06.289061 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:06.289061 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:06.289061 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:06.289061 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:06.289061 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:06.289061 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:06.289061 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:06.289061 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:06.289061 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:06.289061 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:06.289061 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:06.289061 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:06.289061 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:06.289061 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:06.289978 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:06.289978 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:06.289978 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:06.289978 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:06.289978 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:06.289978 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:06.289978 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:06.289978 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:06.289978 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:06.289978 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:06.289978 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:06.289978 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:06.289978 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:06.289978 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:06.289978 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:06.289978 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:06.289978 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:06.290859 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:06.290859 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:06.290859 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:06.290859 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:06.290859 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 338/677] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:06.291136 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab04bc-ba2d-4e18-a913-70236f303a6a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:06.326454 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca2d01-f69a-465b-8063-1a1eb71a19e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:06.327111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca2d01-f69a-465b-8063-1a1eb71a19e9 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:06.327325 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca2d01-f69a-465b-8063-1a1eb71a19e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:06.327603 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca2d01-f69a-465b-8063-1a1eb71a19e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:06.328389 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca2d01-f69a-465b-8063-1a1eb71a19e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:06.328703 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca2d01-f69a-465b-8063-1a1eb71a19e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:06.330170 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca2d01-f69a-465b-8063-1a1eb71a19e9 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:06.348160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 340/678] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:06:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:06.348160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca2d01-f69a-465b-8063-1a1eb71a19e9 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:06.397463 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab04bc-ba2d-4e18-a913-70236f303a6a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:06.431575 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87557c-a2a2-42f4-a62f-60c0694eb0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:06.432193 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87557c-a2a2-42f4-a62f-60c0694eb0ba None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:06.432481 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87557c-a2a2-42f4-a62f-60c0694eb0ba None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:06.432769 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87557c-a2a2-42f4-a62f-60c0694eb0ba None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:06.433745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc87557c-a2a2-42f4-a62f-60c0694eb0ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:06.434086 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc87557c-a2a2-42f4-a62f-60c0694eb0ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:06.435473 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc87557c-a2a2-42f4-a62f-60c0694eb0ba None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:06.451012 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 339/679] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:06.451012 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87557c-a2a2-42f4-a62f-60c0694eb0ba None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:06.451290 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca2d01-f69a-465b-8063-1a1eb71a19e9 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:06.461479 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:06.467454 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:06.485785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c356de-ffe7-4135-abf3-bda9927b163f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:06.486613 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c356de-ffe7-4135-abf3-bda9927b163f None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:06.486897 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c356de-ffe7-4135-abf3-bda9927b163f None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:06.487185 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c356de-ffe7-4135-abf3-bda9927b163f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:06.498173 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c356de-ffe7-4135-abf3-bda9927b163f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:06:06.506529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-c5c356de-ffe7-4135-abf3-bda9927b163f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:06:06.506529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:06.506529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:06.506529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:06.506529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:06.506529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:06.506529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:06.506529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:06.506529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:06.506529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:06.506529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:06.506529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:06.506529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:06:06.506529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:06:06.506529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:06:06.506529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:06:06.507484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:06:06.507484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:06:06.507484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:06:06.507484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:06:06.507484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:06.507484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:06.507484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:06.507484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:06.507484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:06.507484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:06.507484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:06.507484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:06.507484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:06.507484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:06.507484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:06.507484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:06.508329 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:06.508329 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:06.508329 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:06.508329 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:06.508329 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:06:06.508329 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:06:06.508329 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:06:06.508329 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:06:06.508329 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:06:06.508329 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:06:06.508329 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:06:06.508329 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:06.512668 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 341/680] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jul 11 11:06:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:06.513456 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c356de-ffe7-4135-abf3-bda9927b163f None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:06.561650 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87557c-a2a2-42f4-a62f-60c0694eb0ba None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:06.599595 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa68b1-e565-46be-9014-f7f0f8d06f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:06.600183 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa68b1-e565-46be-9014-f7f0f8d06f1b None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:06.600470 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa68b1-e565-46be-9014-f7f0f8d06f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:06.600751 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa68b1-e565-46be-9014-f7f0f8d06f1b None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:06.601472 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa68b1-e565-46be-9014-f7f0f8d06f1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:06.601800 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa68b1-e565-46be-9014-f7f0f8d06f1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:06.603210 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa68b1-e565-46be-9014-f7f0f8d06f1b None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:06.615650 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 340/681] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:06.616559 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa68b1-e565-46be-9014-f7f0f8d06f1b None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:06.628139 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c356de-ffe7-4135-abf3-bda9927b163f None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:06.667288 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85512ee4-576e-49ea-b2ad-db97abd07cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:06.667940 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85512ee4-576e-49ea-b2ad-db97abd07cbf None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:06.668316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85512ee4-576e-49ea-b2ad-db97abd07cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:06.668565 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85512ee4-576e-49ea-b2ad-db97abd07cbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:06.669314 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85512ee4-576e-49ea-b2ad-db97abd07cbf None admin] RBAC: Adding query filter params (role.id=9b682db1e9a5486884a74f5c01953fe7, scope.project.id=38ed7416526e473b816330e24acf7a04, user.id=79b8c08920b0417097bebd23344ffe64) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:06.669624 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85512ee4-576e-49ea-b2ad-db97abd07cbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:06.671085 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85512ee4-576e-49ea-b2ad-db97abd07cbf None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:06.681198 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 342/682] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:06:06 2022] GET /identity/v3/role_assignments?user.id=79b8c08920b0417097bebd23344ffe64&scope.project.id=38ed7416526e473b816330e24acf7a04&role.id=9b682db1e9a5486884a74f5c01953fe7 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:06.681198 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85512ee4-576e-49ea-b2ad-db97abd07cbf None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:06.720870 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:06.726418 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:06.765863 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa68b1-e565-46be-9014-f7f0f8d06f1b None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:06.802341 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85512ee4-576e-49ea-b2ad-db97abd07cbf None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:06.817545 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134bc7b-5aae-4cdc-b818-2fdb85d81bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:06.819481 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134bc7b-5aae-4cdc-b818-2fdb85d81bba None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:06.819929 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134bc7b-5aae-4cdc-b818-2fdb85d81bba None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:06.820744 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134bc7b-5aae-4cdc-b818-2fdb85d81bba None admin] PATH_INFO: `/v3/users/nova` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:06.832645 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134bc7b-5aae-4cdc-b818-2fdb85d81bba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:06.835288 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134bc7b-5aae-4cdc-b818-2fdb85d81bba None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:06.848373 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163671f-cda4-46b9-a525-aef857fa6d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:06.849042 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163671f-cda4-46b9-a525-aef857fa6d11 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:06.849328 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163671f-cda4-46b9-a525-aef857fa6d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:06.849667 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163671f-cda4-46b9-a525-aef857fa6d11 None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:06.850400 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163671f-cda4-46b9-a525-aef857fa6d11 None admin] RBAC: Adding query filter params (name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:06.850708 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163671f-cda4-46b9-a525-aef857fa6d11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:06.852067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-4134bc7b-5aae-4cdc-b818-2fdb85d81bba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 11:06:06.852067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:06.852067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:06.852067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:06.852067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:06.852067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:06.852067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:06.852067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:06.852067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:06.852067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:06.852067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:06.852067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:06.852067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:06:06.852067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:06:06.852067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:06:06.852067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:06:06.852934 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:06.852934 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:06.852934 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:06:06.852934 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:06.852934 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:06:06.852934 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:06.852934 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:06.852934 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:06.852934 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:06.852934 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:06.852934 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:06.852934 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:06.852934 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:06.852934 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:06.852934 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:06.852934 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:06.852934 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:06.852934 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:06.854448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:06.854448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:06.854448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:06:06.854448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:06:06.854448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:06:06.854448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:06:06.854448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:06:06.854448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:06:06.854448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 11:06:06.854448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:06.855006 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163671f-cda4-46b9-a525-aef857fa6d11 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:06.855101 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 341/683] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Jul 11 11:06:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:06.855101 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134bc7b-5aae-4cdc-b818-2fdb85d81bba None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:06.868659 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 343/684] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jul 11 11:06:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:06.869885 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163671f-cda4-46b9-a525-aef857fa6d11 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:06.980942 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134bc7b-5aae-4cdc-b818-2fdb85d81bba None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:07.002473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:07.011004 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163671f-cda4-46b9-a525-aef857fa6d11 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:07.026251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0696b7-c97a-4a48-ba26-66ec6499703e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:07.027427 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0696b7-c97a-4a48-ba26-66ec6499703e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:07.027715 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0696b7-c97a-4a48-ba26-66ec6499703e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:07.027993 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0696b7-c97a-4a48-ba26-66ec6499703e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:07.030417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:07.037299 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0696b7-c97a-4a48-ba26-66ec6499703e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:07.039178 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0696b7-c97a-4a48-ba26-66ec6499703e None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:07.053957 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ff057-31f3-4176-a838-d2eae17bf6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:07.054640 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ff057-31f3-4176-a838-d2eae17bf6ea None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:07.054924 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ff057-31f3-4176-a838-d2eae17bf6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:07.055198 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ff057-31f3-4176-a838-d2eae17bf6ea None admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:07.056370 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ff057-31f3-4176-a838-d2eae17bf6ea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:07.056917 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ff057-31f3-4176-a838-d2eae17bf6ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:07.058993 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ff057-31f3-4176-a838-d2eae17bf6ea None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:07.059316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-cf0696b7-c97a-4a48-ba26-66ec6499703e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:07.059316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:07.059316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:07.059316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:07.059316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:07.059316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:07.059316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:07.059316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:07.059316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:07.059316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:07.059316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:07.059316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:07.059316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:06:07.059316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:06:07.059316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:06:07.060177 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:06:07.060177 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:07.060177 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:07.060177 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:07.060177 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:07.060177 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:07.060177 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:07.060177 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:07.060177 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:07.060177 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:07.060177 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:07.060177 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:07.060177 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:07.060177 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:07.060177 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:07.060177 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:07.060177 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:07.061117 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:06:07.061117 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:06:07.061117 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:06:07.061117 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:06:07.061117 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:06:07.061117 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:06:07.061117 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:07.061117 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:07.063666 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 342/685] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:06:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:07.068715 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0696b7-c97a-4a48-ba26-66ec6499703e None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:07.094594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 344/686] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Jul 11 11:06:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:07.094594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ff057-31f3-4176-a838-d2eae17bf6ea None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:07.178898 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0696b7-c97a-4a48-ba26-66ec6499703e None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:07.216581 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6959cf-12de-4e07-94d5-6b8222bf13cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:07.217745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6959cf-12de-4e07-94d5-6b8222bf13cb None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:07.218266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6959cf-12de-4e07-94d5-6b8222bf13cb None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:07.218756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6959cf-12de-4e07-94d5-6b8222bf13cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:07.229158 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ff057-31f3-4176-a838-d2eae17bf6ea None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:07.230579 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6959cf-12de-4e07-94d5-6b8222bf13cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:07.232262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6959cf-12de-4e07-94d5-6b8222bf13cb None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:07.251559 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-0e6959cf-12de-4e07-94d5-6b8222bf13cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:07.251559 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:07.251559 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:07.251559 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:07.251559 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:07.251559 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:07.251559 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:07.251559 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:07.251559 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:07.251559 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:07.251559 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:07.251559 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:07.251559 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:07.251559 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:07.251559 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:07.252485 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:07.252485 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:07.252485 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:07.252485 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:07.252485 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:07.252485 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:07.252485 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:07.252485 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:07.252485 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:07.252485 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:07.252485 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:07.252485 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:07.252485 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:07.252485 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:07.252485 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:07.252485 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:07.252485 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:07.254025 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:07.254025 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:07.254025 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:07.254025 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:07.260644 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 343/687] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:07.261724 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6959cf-12de-4e07-94d5-6b8222bf13cb None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:07.268472 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6dad6d-c36c-40cc-8717-cbba25023cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:07.269374 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6dad6d-c36c-40cc-8717-cbba25023cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:07.269921 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6dad6d-c36c-40cc-8717-cbba25023cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:07.270423 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6dad6d-c36c-40cc-8717-cbba25023cd8 None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:07.271333 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6dad6d-c36c-40cc-8717-cbba25023cd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:07.271643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6dad6d-c36c-40cc-8717-cbba25023cd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:07.273092 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6dad6d-c36c-40cc-8717-cbba25023cd8 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:07.288867 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 345/688] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:06:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:07.290022 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6dad6d-c36c-40cc-8717-cbba25023cd8 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:07.313561 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:07.326924 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:07.386126 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6959cf-12de-4e07-94d5-6b8222bf13cb None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:07.423922 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6dad6d-c36c-40cc-8717-cbba25023cd8 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:07.425494 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626b1a1-48c6-4e7e-abaf-d2b5f6484565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:07.426494 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626b1a1-48c6-4e7e-abaf-d2b5f6484565 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:07.426976 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626b1a1-48c6-4e7e-abaf-d2b5f6484565 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:07.427445 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626b1a1-48c6-4e7e-abaf-d2b5f6484565 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:07.465819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7977826c-454a-4a9e-a4c3-6fbeca4b7282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:07.467501 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977826c-454a-4a9e-a4c3-6fbeca4b7282 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:07.467990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977826c-454a-4a9e-a4c3-6fbeca4b7282 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:07.468612 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977826c-454a-4a9e-a4c3-6fbeca4b7282 None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:07.469873 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7977826c-454a-4a9e-a4c3-6fbeca4b7282 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:07.470630 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7977826c-454a-4a9e-a4c3-6fbeca4b7282 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:07.472260 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7977826c-454a-4a9e-a4c3-6fbeca4b7282 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:07.487972 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 346/689] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:07.489073 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7977826c-454a-4a9e-a4c3-6fbeca4b7282 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:07.520602 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626b1a1-48c6-4e7e-abaf-d2b5f6484565 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:07.522509 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626b1a1-48c6-4e7e-abaf-d2b5f6484565 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:07.576921 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:07.579301 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:07.602551 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7977826c-454a-4a9e-a4c3-6fbeca4b7282 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:07.638910 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508dd9c6-cf18-4edb-ac51-d3f6abdcc211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:07.639567 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dd9c6-cf18-4edb-ac51-d3f6abdcc211 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:07.639856 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dd9c6-cf18-4edb-ac51-d3f6abdcc211 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:07.644965 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dd9c6-cf18-4edb-ac51-d3f6abdcc211 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:07.645096 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 344/690] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:06:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:06:07.645175 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508dd9c6-cf18-4edb-ac51-d3f6abdcc211 None admin] RBAC: Adding query filter params (role.id=9b682db1e9a5486884a74f5c01953fe7, scope.project.id=38ed7416526e473b816330e24acf7a04, user.id=3096077887344140805ec8a23fe72f48) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:07.645247 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626b1a1-48c6-4e7e-abaf-d2b5f6484565 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:07.645315 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508dd9c6-cf18-4edb-ac51-d3f6abdcc211 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:07.645315 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508dd9c6-cf18-4edb-ac51-d3f6abdcc211 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:07.650755 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 347/691] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:06:07 2022] GET /identity/v3/role_assignments?user.id=3096077887344140805ec8a23fe72f48&scope.project.id=38ed7416526e473b816330e24acf7a04&role.id=9b682db1e9a5486884a74f5c01953fe7 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:07.654760 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44b855-48ec-4e64-8cf1-94b2e19558d6 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:07.654760 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44b855-48ec-4e64-8cf1-94b2e19558d6 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:07.654760 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44b855-48ec-4e64-8cf1-94b2e19558d6 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:07.654760 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 348/692] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:07.654760 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44b855-48ec-4e64-8cf1-94b2e19558d6 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:07.772998 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626b1a1-48c6-4e7e-abaf-d2b5f6484565 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:07.790621 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44b855-48ec-4e64-8cf1-94b2e19558d6 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:07.812530 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f2e76-5c4e-4a98-9113-8a06671a527b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:07.813669 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f2e76-5c4e-4a98-9113-8a06671a527b None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:07.814256 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f2e76-5c4e-4a98-9113-8a06671a527b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:07.814680 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f2e76-5c4e-4a98-9113-8a06671a527b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:07.823201 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f2e76-5c4e-4a98-9113-8a06671a527b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:07.824996 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f2e76-5c4e-4a98-9113-8a06671a527b None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:07.832430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbd4ff-221c-46d3-83d5-f3820328ce82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:07.833439 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbd4ff-221c-46d3-83d5-f3820328ce82 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:07.833944 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbd4ff-221c-46d3-83d5-f3820328ce82 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:07.834223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbd4ff-221c-46d3-83d5-f3820328ce82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:07.841657 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:07.843075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-b44f2e76-5c4e-4a98-9113-8a06671a527b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 11:06:07.843075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:07.843075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:07.843075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:07.843075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:07.843075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:07.843075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:07.843075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:07.843075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:07.843075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:07.843075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:07.843075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:07.843075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:06:07.843075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:06:07.843075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:06:07.843075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:06:07.844022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:07.844022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:07.844022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:06:07.844022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:07.844022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:06:07.844022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:07.844022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:07.844022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:07.844022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:07.844022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:07.844022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:07.844022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:07.844022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:07.844022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:07.844022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:07.844022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:07.844022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:07.844022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:07.844959 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:07.844959 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:07.844959 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:06:07.844959 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:06:07.844959 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:06:07.844959 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:06:07.844959 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:06:07.844959 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:06:07.844959 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 11:06:07.844959 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:07.844959 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 345/693] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:06:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:07.848184 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcbd4ff-221c-46d3-83d5-f3820328ce82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:07.848328 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcbd4ff-221c-46d3-83d5-f3820328ce82 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:07.849856 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20230a75-d417-4625-9c62-6546b3eea3fa None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:07.850602 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20230a75-d417-4625-9c62-6546b3eea3fa None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:07.856332 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20230a75-d417-4625-9c62-6546b3eea3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:07.865570 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:07.870590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-0bcbd4ff-221c-46d3-83d5-f3820328ce82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:07.870590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:07.870590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:07.870590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:07.870590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:07.870590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:07.870590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:07.870590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:07.870590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:07.870590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:07.870590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:07.870590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:07.870590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:07.870590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:07.870590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:07.871535 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:07.871535 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:07.871535 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:07.871535 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:07.871535 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:07.871535 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:07.871535 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:07.871535 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:07.871535 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:07.871535 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:07.871535 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:07.871535 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:07.871535 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:07.871535 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:07.871535 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:07.871535 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:07.871535 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:07.872420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:07.872420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:07.872420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:07.872420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:07.873943 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 349/694] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:07.874174 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-20230a75-d417-4625-9c62-6546b3eea3fa None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:07.875275 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbd4ff-221c-46d3-83d5-f3820328ce82 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:07.875472 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-20230a75-d417-4625-9c62-6546b3eea3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:07.963951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 346/695] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:06:07.964875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20230a75-d417-4625-9c62-6546b3eea3fa None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:08.006063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbd4ff-221c-46d3-83d5-f3820328ce82 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:08.043418 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f270072-003e-4aee-9057-6b25da372eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:08.044147 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f270072-003e-4aee-9057-6b25da372eee None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:08.044344 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f270072-003e-4aee-9057-6b25da372eee None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:08.044617 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f270072-003e-4aee-9057-6b25da372eee None admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:08.045466 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f270072-003e-4aee-9057-6b25da372eee None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:08.045851 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f270072-003e-4aee-9057-6b25da372eee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:08.047823 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f270072-003e-4aee-9057-6b25da372eee None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:08.069881 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 350/696] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Jul 11 11:06:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:08.070828 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f270072-003e-4aee-9057-6b25da372eee None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:08.083642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20230a75-d417-4625-9c62-6546b3eea3fa None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:08.121972 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:08.127730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd4620-6010-413c-8001-3fd7f53592f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:08.139653 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd4620-6010-413c-8001-3fd7f53592f4 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:08.139653 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd4620-6010-413c-8001-3fd7f53592f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:08.139653 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd4620-6010-413c-8001-3fd7f53592f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:08.139653 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd4620-6010-413c-8001-3fd7f53592f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:08.139653 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd4620-6010-413c-8001-3fd7f53592f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:08.139653 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd4620-6010-413c-8001-3fd7f53592f4 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:08.146195 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:08.150049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 347/697] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:08.151029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd4620-6010-413c-8001-3fd7f53592f4 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:08.185093 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f270072-003e-4aee-9057-6b25da372eee None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:08.220659 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f2d93-ef67-431d-8018-8df245129dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:08.221601 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f2d93-ef67-431d-8018-8df245129dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:08.222550 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f2d93-ef67-431d-8018-8df245129dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:08.223042 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f2d93-ef67-431d-8018-8df245129dd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:08.234645 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f2d93-ef67-431d-8018-8df245129dd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:08.236209 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f2d93-ef67-431d-8018-8df245129dd4 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:08.255213 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-8f2f2d93-ef67-431d-8018-8df245129dd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:08.255213 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:08.255213 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:08.255213 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:08.255213 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:08.255213 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:08.255213 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:08.255213 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:08.255213 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:08.255213 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:08.255213 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:08.255213 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:08.255213 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:08.255213 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:08.255213 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:08.256326 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:08.256326 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:08.256326 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:08.256326 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:08.256326 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:08.256326 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:08.256326 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:08.256326 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:08.256326 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:08.256326 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:08.256326 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:08.256326 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:08.256326 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:08.256326 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:08.256326 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:08.256326 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:08.256326 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:08.257345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:08.257345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:08.257345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:08.257345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:08.258677 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 351/698] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:08.259605 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f2d93-ef67-431d-8018-8df245129dd4 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:08.277978 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd4620-6010-413c-8001-3fd7f53592f4 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:08.321512 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b5169-cfa2-4b07-8a92-48ed50591212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:08.322609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b5169-cfa2-4b07-8a92-48ed50591212 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:08.323359 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b5169-cfa2-4b07-8a92-48ed50591212 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:08.324108 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b5169-cfa2-4b07-8a92-48ed50591212 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:08.363778 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:08.368062 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f2d93-ef67-431d-8018-8df245129dd4 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:08.406217 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:08.406409 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630c534-7d9d-4a28-aaba-9d053c384f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:08.407163 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630c534-7d9d-4a28-aaba-9d053c384f4c None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:08.407445 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630c534-7d9d-4a28-aaba-9d053c384f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:08.407716 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630c534-7d9d-4a28-aaba-9d053c384f4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:08.416716 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630c534-7d9d-4a28-aaba-9d053c384f4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:08.417081 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b5169-cfa2-4b07-8a92-48ed50591212 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:08.418298 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630c534-7d9d-4a28-aaba-9d053c384f4c None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:08.419224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b5169-cfa2-4b07-8a92-48ed50591212 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:08.433518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-1630c534-7d9d-4a28-aaba-9d053c384f4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:08.433518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:08.433518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:08.433518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:08.433518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:08.433518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:08.433518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:08.433518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:08.433518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:08.433518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:08.433518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:08.433518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:08.433518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:06:08.433518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:06:08.433518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:06:08.434838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:06:08.434838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:08.434838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:08.434838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:08.434838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:08.434838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:08.434838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:08.434838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:08.434838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:08.434838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:08.434838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:08.434838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:08.434838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:08.434838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:08.434838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:08.434838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:08.434838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:08.435771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:06:08.435771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:06:08.435771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:06:08.435771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:06:08.435771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:06:08.435771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:06:08.435771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:08.435771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:08.439982 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 352/699] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:06:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:08.440583 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630c534-7d9d-4a28-aaba-9d053c384f4c None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:08.548489 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 348/700] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:06:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:06:08.549733 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b5169-cfa2-4b07-8a92-48ed50591212 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:08.551225 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630c534-7d9d-4a28-aaba-9d053c384f4c None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:08.589705 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a817c-612a-47ea-b797-c2235f0e59e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:08.590363 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a817c-612a-47ea-b797-c2235f0e59e9 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:08.590650 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a817c-612a-47ea-b797-c2235f0e59e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:08.590925 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a817c-612a-47ea-b797-c2235f0e59e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:08.591646 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a817c-612a-47ea-b797-c2235f0e59e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:08.591952 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a817c-612a-47ea-b797-c2235f0e59e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:08.593635 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a817c-612a-47ea-b797-c2235f0e59e9 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:08.606298 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 353/701] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:08.607313 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a817c-612a-47ea-b797-c2235f0e59e9 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:08.631668 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:08.650677 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:08.656598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b5169-cfa2-4b07-8a92-48ed50591212 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:08.693190 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d274a61-f56f-4b0a-b076-2a65ac220a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:08.694045 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d274a61-f56f-4b0a-b076-2a65ac220a67 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:08.694424 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d274a61-f56f-4b0a-b076-2a65ac220a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:08.694805 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d274a61-f56f-4b0a-b076-2a65ac220a67 None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:08.696138 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d274a61-f56f-4b0a-b076-2a65ac220a67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:08.696138 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d274a61-f56f-4b0a-b076-2a65ac220a67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:08.697587 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d274a61-f56f-4b0a-b076-2a65ac220a67 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:08.714471 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 349/702] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:06:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:08.715788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d274a61-f56f-4b0a-b076-2a65ac220a67 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:08.729469 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a817c-612a-47ea-b797-c2235f0e59e9 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:08.774600 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101fc3a-aad4-440e-81a0-ff1b2cef9ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:08.775401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101fc3a-aad4-440e-81a0-ff1b2cef9ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:08.775682 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101fc3a-aad4-440e-81a0-ff1b2cef9ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:08.775957 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101fc3a-aad4-440e-81a0-ff1b2cef9ae4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:08.788679 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101fc3a-aad4-440e-81a0-ff1b2cef9ae4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:08.790159 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101fc3a-aad4-440e-81a0-ff1b2cef9ae4 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:08.809663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-8101fc3a-aad4-440e-81a0-ff1b2cef9ae4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:08.809663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:08.809663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:08.809663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:08.809663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:08.809663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:08.809663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:08.809663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:08.809663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:08.809663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:08.809663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:08.809663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:08.809663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:08.809663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:08.809663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:08.810679 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:08.810679 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:08.810679 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:08.810679 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:08.810679 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:08.810679 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:08.810679 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:08.810679 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:08.810679 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:08.810679 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:08.810679 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:08.810679 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:08.810679 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:08.810679 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:08.810679 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:08.810679 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:08.810679 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:08.811570 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:08.811570 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:08.811570 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:08.811570 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:08.813683 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 354/703] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:08.814589 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101fc3a-aad4-440e-81a0-ff1b2cef9ae4 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:08.833359 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d274a61-f56f-4b0a-b076-2a65ac220a67 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:08.869827 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ec2f5-4677-458b-8740-8b35ecb3da38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:08.870453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ec2f5-4677-458b-8740-8b35ecb3da38 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:08.870745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ec2f5-4677-458b-8740-8b35ecb3da38 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:08.871027 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ec2f5-4677-458b-8740-8b35ecb3da38 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:08.871732 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ec2f5-4677-458b-8740-8b35ecb3da38 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:08.873139 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ec2f5-4677-458b-8740-8b35ecb3da38 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:08.892122 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:08.922038 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101fc3a-aad4-440e-81a0-ff1b2cef9ae4 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:08.946344 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 350/704] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jul 11 11:06:08 2022] POST /identity/v3/users => generated 254 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:06:08.947525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17177d77-eaa6-4f95-bf55-539e669cad3e None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:08.947822 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17177d77-eaa6-4f95-bf55-539e669cad3e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:08.948100 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17177d77-eaa6-4f95-bf55-539e669cad3e None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:08.953663 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 351/705] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:08.953663 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17177d77-eaa6-4f95-bf55-539e669cad3e None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:08.973448 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd3fae-a030-4b19-8e02-d266f4a35012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:08.974157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd3fae-a030-4b19-8e02-d266f4a35012 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:08.974444 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd3fae-a030-4b19-8e02-d266f4a35012 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:08.975304 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd3fae-a030-4b19-8e02-d266f4a35012 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:08.975567 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd3fae-a030-4b19-8e02-d266f4a35012 None admin] RBAC: Adding query filter params (role.id=736e70deba004b9289c2fed43eb107f7, scope.project.id=38ed7416526e473b816330e24acf7a04, user.id=5b9e7594afc346e593ef3e6c579e237b) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:08.975885 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd3fae-a030-4b19-8e02-d266f4a35012 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:08.977378 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd3fae-a030-4b19-8e02-d266f4a35012 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:08.983998 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 355/706] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:06:08 2022] GET /identity/v3/role_assignments?user.id=5b9e7594afc346e593ef3e6c579e237b&scope.project.id=38ed7416526e473b816330e24acf7a04&role.id=736e70deba004b9289c2fed43eb107f7 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:08.984535 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:08.991533 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d011223-b6ed-49b6-9720-a3cdb3cf2351 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:08.991847 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d011223-b6ed-49b6-9720-a3cdb3cf2351 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:08.992159 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d011223-b6ed-49b6-9720-a3cdb3cf2351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:09.032745 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-9d011223-b6ed-49b6-9720-a3cdb3cf2351 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:09.037493 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-9d011223-b6ed-49b6-9720-a3cdb3cf2351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:09.161684 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17177d77-eaa6-4f95-bf55-539e669cad3e None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:09.185847 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 356/707] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:06:09.204512 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d011223-b6ed-49b6-9720-a3cdb3cf2351 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:09.214070 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3693dc-7926-4374-af0a-d705ef4a0bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:09.214995 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3693dc-7926-4374-af0a-d705ef4a0bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:09.215286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3693dc-7926-4374-af0a-d705ef4a0bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:09.215567 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3693dc-7926-4374-af0a-d705ef4a0bd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:09.216295 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3693dc-7926-4374-af0a-d705ef4a0bd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:09.216608 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3693dc-7926-4374-af0a-d705ef4a0bd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:09.219585 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3693dc-7926-4374-af0a-d705ef4a0bd0 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:09.231198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 352/708] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:09.236895 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3693dc-7926-4374-af0a-d705ef4a0bd0 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:09.301430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:09.331194 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:09.345519 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d011223-b6ed-49b6-9720-a3cdb3cf2351 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:09.370354 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3693dc-7926-4374-af0a-d705ef4a0bd0 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:09.385057 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9468f-2f54-4d7d-a8b6-f39d1fbd9d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:09.386279 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9468f-2f54-4d7d-a8b6-f39d1fbd9d8d None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:09.386796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9468f-2f54-4d7d-a8b6-f39d1fbd9d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:09.387332 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9468f-2f54-4d7d-a8b6-f39d1fbd9d8d None admin] PATH_INFO: `/v3/services/network` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:09.388193 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9468f-2f54-4d7d-a8b6-f39d1fbd9d8d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:09.390022 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9468f-2f54-4d7d-a8b6-f39d1fbd9d8d None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:09.404959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-60e9468f-2f54-4d7d-a8b6-f39d1fbd9d8d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 11:06:09.404959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:09.404959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:06:09.404959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:06:09.404959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:06:09.404959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:06:09.404959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:06:09.404959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:09.404959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 11:06:09.404959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:09.404959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:06:09.404959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:09.404959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:09.404959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:09.404959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:09.404959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:09.404959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:09.406115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:09.406115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:09.406115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:09.406115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:09.406115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:09.406115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:09.406115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:06:09.406115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:06:09.406115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:06:09.406115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:06:09.406115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:09.406115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:09.406115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:09.406115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:09.406115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:09.406115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:09.406978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:09.406978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:09.406978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:09.406978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:09.406978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:09.406978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:09.406978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:09.406978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:09.406978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:09.406978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:09.406978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:06:09.406978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:09.406978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 11:06:09.406978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:09.409908 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 357/709] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:06:09 2022] GET /identity/v3/services/network => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:09.415918 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9468f-2f54-4d7d-a8b6-f39d1fbd9d8d None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:09.518238 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15bb73f-5a5c-46a3-a84a-8ac24e0a230a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:09.519263 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bb73f-5a5c-46a3-a84a-8ac24e0a230a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:09.519544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bb73f-5a5c-46a3-a84a-8ac24e0a230a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:09.521791 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bb73f-5a5c-46a3-a84a-8ac24e0a230a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:09.552780 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15bb73f-5a5c-46a3-a84a-8ac24e0a230a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:09.554645 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15bb73f-5a5c-46a3-a84a-8ac24e0a230a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:09.570984 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9468f-2f54-4d7d-a8b6-f39d1fbd9d8d None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:09.601787 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-f15bb73f-5a5c-46a3-a84a-8ac24e0a230a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:09.601787 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:09.601787 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:09.601787 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:09.601787 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:09.601787 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:09.601787 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:09.601787 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:09.601787 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:09.601787 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:09.601787 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:09.601787 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:09.601787 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:06:09.601787 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:06:09.601787 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:06:09.602745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:06:09.602745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:09.602745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:09.602745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:09.602745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:09.602745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:09.602745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:09.602745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:09.602745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:09.602745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:09.602745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:09.602745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:09.602745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:09.602745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:09.602745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:09.602745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:09.602745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:09.603905 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:06:09.603905 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:06:09.603905 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:06:09.603905 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:06:09.603905 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:06:09.603905 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:06:09.603905 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:09.603905 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:09.609785 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 353/710] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:06:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:09.617788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15bb73f-5a5c-46a3-a84a-8ac24e0a230a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:09.617937 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:09.637783 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ee880-565c-4678-932c-b21bbd969e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:09.637783 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ee880-565c-4678-932c-b21bbd969e71 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:09.637783 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ee880-565c-4678-932c-b21bbd969e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:09.637783 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ee880-565c-4678-932c-b21bbd969e71 None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:09.642162 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ee880-565c-4678-932c-b21bbd969e71 None admin] RBAC: Adding query filter params (name=network) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:09.642162 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ee880-565c-4678-932c-b21bbd969e71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:09.642162 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ee880-565c-4678-932c-b21bbd969e71 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:09.653212 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 358/711] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Jul 11 11:06:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:09.659002 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ee880-565c-4678-932c-b21bbd969e71 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:09.939482 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ee880-565c-4678-932c-b21bbd969e71 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:09.952107 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15bb73f-5a5c-46a3-a84a-8ac24e0a230a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:10.014455 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:10.020431 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe6a5f-2a1a-44d1-9231-371ea6248e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:10.021138 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe6a5f-2a1a-44d1-9231-371ea6248e71 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:10.021424 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe6a5f-2a1a-44d1-9231-371ea6248e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:10.025435 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe6a5f-2a1a-44d1-9231-371ea6248e71 None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:10.025435 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe6a5f-2a1a-44d1-9231-371ea6248e71 None admin] RBAC: Adding query filter params (type=network) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:10.025435 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe6a5f-2a1a-44d1-9231-371ea6248e71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:10.025435 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe6a5f-2a1a-44d1-9231-371ea6248e71 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:10.025824 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc180b-d91b-4224-94d5-5bd966fbb1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:10.025824 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc180b-d91b-4224-94d5-5bd966fbb1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:10.025824 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc180b-d91b-4224-94d5-5bd966fbb1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:10.025824 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc180b-d91b-4224-94d5-5bd966fbb1a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:10.026605 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc180b-d91b-4224-94d5-5bd966fbb1a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:10.026918 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc180b-d91b-4224-94d5-5bd966fbb1a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:10.028805 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc180b-d91b-4224-94d5-5bd966fbb1a6 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:10.031255 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 359/712] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Jul 11 11:06:09 2022] GET /identity/v3/services?type=network => generated 124 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:10.032635 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeecdeb-9c3f-41ac-9867-2d498a1f1424 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:10.033047 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeecdeb-9c3f-41ac-9867-2d498a1f1424 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:10.033433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeecdeb-9c3f-41ac-9867-2d498a1f1424 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:10.035228 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 360/713] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:10.043400 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b857c-27f6-4ae0-af75-90b31ae19189 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:10.043742 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b857c-27f6-4ae0-af75-90b31ae19189 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:10.043964 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b857c-27f6-4ae0-af75-90b31ae19189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:10.062048 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 354/714] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:06:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:10.065227 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-b85b857c-27f6-4ae0-af75-90b31ae19189 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:10.066661 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-b85b857c-27f6-4ae0-af75-90b31ae19189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:10.068755 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc180b-d91b-4224-94d5-5bd966fbb1a6 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:10.140258 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:10.160905 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 361/715] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:06:10.198363 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b857c-27f6-4ae0-af75-90b31ae19189 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:10.256988 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc180b-d91b-4224-94d5-5bd966fbb1a6 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:10.297001 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707cef68-311c-48d1-9766-7c72c15a4585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:10.297673 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cef68-311c-48d1-9766-7c72c15a4585 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:10.297988 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cef68-311c-48d1-9766-7c72c15a4585 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:10.298271 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cef68-311c-48d1-9766-7c72c15a4585 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:10.299104 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707cef68-311c-48d1-9766-7c72c15a4585 None admin] RBAC: Adding query filter params (role.id=9b682db1e9a5486884a74f5c01953fe7, scope.project.id=38ed7416526e473b816330e24acf7a04, user.id=736f6d4d1dbb47ff98bc67e53614d49c) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:10.299423 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707cef68-311c-48d1-9766-7c72c15a4585 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:10.300910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707cef68-311c-48d1-9766-7c72c15a4585 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:10.307444 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 355/716] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:06:10 2022] GET /identity/v3/role_assignments?user.id=736f6d4d1dbb47ff98bc67e53614d49c&scope.project.id=38ed7416526e473b816330e24acf7a04&role.id=9b682db1e9a5486884a74f5c01953fe7 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:10.331035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b857c-27f6-4ae0-af75-90b31ae19189 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:10.371646 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db14b77-8c6d-45a1-ba13-5ed005ca7f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:10.372477 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db14b77-8c6d-45a1-ba13-5ed005ca7f63 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:10.372760 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db14b77-8c6d-45a1-ba13-5ed005ca7f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:10.373099 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db14b77-8c6d-45a1-ba13-5ed005ca7f63 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:10.373788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db14b77-8c6d-45a1-ba13-5ed005ca7f63 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:10.375188 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db14b77-8c6d-45a1-ba13-5ed005ca7f63 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:10.388725 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-2db14b77-8c6d-45a1-ba13-5ed005ca7f63 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 11:06:10.388725 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:10.388725 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:06:10.388725 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:06:10.388725 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:06:10.388725 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:06:10.388725 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:06:10.388725 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:10.388725 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 11:06:10.388725 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:10.388725 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:06:10.388725 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:10.388725 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:10.388725 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:10.388725 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:10.388725 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:10.389951 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:10.389951 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:10.389951 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:10.389951 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:10.389951 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:10.389951 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:10.389951 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:10.389951 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:06:10.389951 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:06:10.389951 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:06:10.389951 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:06:10.389951 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:10.389951 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:10.389951 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:10.389951 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:10.389951 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:10.391000 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:10.391000 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:10.391000 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:10.391000 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:10.391000 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:10.391000 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:10.391000 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:10.391000 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:10.391000 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:10.391000 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:10.391000 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:10.391000 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:06:10.391000 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:10.391000 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 11:06:10.391000 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:10.391000 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 362/717] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Jul 11 11:06:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:10.397731 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707cef68-311c-48d1-9766-7c72c15a4585 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:10.499728 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:10.546991 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707cef68-311c-48d1-9766-7c72c15a4585 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:10.584717 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d042d6-73f2-4e67-bd82-56c1bcc8e634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:10.585314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d042d6-73f2-4e67-bd82-56c1bcc8e634 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:10.585603 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d042d6-73f2-4e67-bd82-56c1bcc8e634 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:10.585916 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d042d6-73f2-4e67-bd82-56c1bcc8e634 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:10.586635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d042d6-73f2-4e67-bd82-56c1bcc8e634 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:10.586952 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d042d6-73f2-4e67-bd82-56c1bcc8e634 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:10.588321 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d042d6-73f2-4e67-bd82-56c1bcc8e634 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:10.593686 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 356/718] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Jul 11 11:06:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:10.602571 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db14b77-8c6d-45a1-ba13-5ed005ca7f63 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:10.663440 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:10.713548 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db14b77-8c6d-45a1-ba13-5ed005ca7f63 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:10.748824 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298d5d8-fc74-4d13-bc05-b8c6ed9d7cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:10.749493 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298d5d8-fc74-4d13-bc05-b8c6ed9d7cae None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:10.749792 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298d5d8-fc74-4d13-bc05-b8c6ed9d7cae None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:10.750093 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298d5d8-fc74-4d13-bc05-b8c6ed9d7cae None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:10.750808 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298d5d8-fc74-4d13-bc05-b8c6ed9d7cae None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:10.751123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298d5d8-fc74-4d13-bc05-b8c6ed9d7cae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:10.752580 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298d5d8-fc74-4d13-bc05-b8c6ed9d7cae None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:10.765364 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 363/719] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Jul 11 11:06:10 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:11.555584 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29901ab7-5888-495b-9ffe-8f39637f983c None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:11.556307 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29901ab7-5888-495b-9ffe-8f39637f983c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:11.556307 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29901ab7-5888-495b-9ffe-8f39637f983c None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:11.557828 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 357/720] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:11.563186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d668b-f2c2-4ae5-a3aa-ee36cd204e8e None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:11.563489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d668b-f2c2-4ae5-a3aa-ee36cd204e8e None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:11.563781 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d668b-f2c2-4ae5-a3aa-ee36cd204e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:11.590724 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-e37d668b-f2c2-4ae5-a3aa-ee36cd204e8e None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:11.591932 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-e37d668b-f2c2-4ae5-a3aa-ee36cd204e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:11.684661 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 364/721] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:06:11.728253 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29901ab7-5888-495b-9ffe-8f39637f983c None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:11.775586 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1653be2-e008-4130-b7c3-6d201de828a9 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:11.775885 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1653be2-e008-4130-b7c3-6d201de828a9 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:11.776183 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1653be2-e008-4130-b7c3-6d201de828a9 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:11.777842 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 365/722] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:06:11.782621 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ee9fe-9940-410e-8c89-e70198e10f5f None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:11.782888 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ee9fe-9940-410e-8c89-e70198e10f5f None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:11.783174 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ee9fe-9940-410e-8c89-e70198e10f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:11.830888 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-466ee9fe-9940-410e-8c89-e70198e10f5f None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:11.832640 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-466ee9fe-9940-410e-8c89-e70198e10f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:11.935700 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29901ab7-5888-495b-9ffe-8f39637f983c None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:11.990213 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:12.033970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50820ff-18aa-40a0-bc29-3d316a5da5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:12.036037 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50820ff-18aa-40a0-bc29-3d316a5da5ad None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:12.036344 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50820ff-18aa-40a0-bc29-3d316a5da5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:12.036627 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50820ff-18aa-40a0-bc29-3d316a5da5ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:12.052467 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:12.059558 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50820ff-18aa-40a0-bc29-3d316a5da5ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:06:12.067475 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-c50820ff-18aa-40a0-bc29-3d316a5da5ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:06:12.067475 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:12.067475 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:12.067475 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:12.067475 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:12.067475 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:12.067475 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:12.067475 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:12.067475 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:12.067475 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:12.067475 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:12.067475 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:12.067475 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:06:12.067475 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:06:12.067475 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:06:12.067475 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:06:12.069458 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:06:12.069458 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:06:12.069458 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:06:12.069458 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:06:12.069458 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:12.069458 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:12.069458 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:12.069458 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:12.069458 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:12.069458 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:12.069458 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:12.069458 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:12.069458 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:12.069458 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:12.069458 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:12.069458 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:12.070632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:12.070632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:12.070632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:12.070632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:12.070632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:06:12.070632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:06:12.070632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:06:12.070632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:06:12.070632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:06:12.070632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:06:12.070632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:06:12.070632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:12.070632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 358/723] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:06:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:12.075070 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50820ff-18aa-40a0-bc29-3d316a5da5ad None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:12.113160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 366/724] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:06:12.138035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ee9fe-9940-410e-8c89-e70198e10f5f None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:12.282327 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50820ff-18aa-40a0-bc29-3d316a5da5ad None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:12.326778 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ee9fe-9940-410e-8c89-e70198e10f5f None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:12.357888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd543f46-29ab-4d46-bcd2-d698bd0fd251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:12.358578 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd543f46-29ab-4d46-bcd2-d698bd0fd251 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:12.358868 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd543f46-29ab-4d46-bcd2-d698bd0fd251 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:12.359153 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd543f46-29ab-4d46-bcd2-d698bd0fd251 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:12.359912 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd543f46-29ab-4d46-bcd2-d698bd0fd251 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:12.360229 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd543f46-29ab-4d46-bcd2-d698bd0fd251 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:12.361591 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd543f46-29ab-4d46-bcd2-d698bd0fd251 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:12.373351 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac702ea7-ec60-472e-8ced-4fca6d4a7c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:12.374120 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac702ea7-ec60-472e-8ced-4fca6d4a7c20 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:12.374405 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac702ea7-ec60-472e-8ced-4fca6d4a7c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:12.374679 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac702ea7-ec60-472e-8ced-4fca6d4a7c20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:12.377348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 359/725] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:06:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:12.383568 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd543f46-29ab-4d46-bcd2-d698bd0fd251 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:12.398964 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac702ea7-ec60-472e-8ced-4fca6d4a7c20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:06:12.406760 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-ac702ea7-ec60-472e-8ced-4fca6d4a7c20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:06:12.406760 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:12.406760 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:12.406760 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:12.406760 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:12.406760 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:12.406760 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:12.406760 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:12.406760 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:12.406760 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:12.406760 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:12.406760 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:12.406760 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:06:12.406760 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:06:12.406760 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:06:12.406760 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:06:12.407683 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:06:12.407683 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:06:12.407683 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:06:12.407683 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:06:12.407683 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:12.407683 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:12.407683 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:12.407683 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:12.407683 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:12.407683 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:12.407683 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:12.407683 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:12.407683 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:12.407683 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:12.407683 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:12.407683 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:12.408526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:12.408526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:12.408526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:12.408526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:12.408526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:06:12.408526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:06:12.408526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:06:12.408526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:06:12.408526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:06:12.408526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:06:12.408526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:06:12.408526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:12.408526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 367/726] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jul 11 11:06:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:12.418271 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac702ea7-ec60-472e-8ced-4fca6d4a7c20 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:12.474124 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:12.474706 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:12.548943 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac702ea7-ec60-472e-8ced-4fca6d4a7c20 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:12.599759 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd543f46-29ab-4d46-bcd2-d698bd0fd251 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:12.604802 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f238a4-6e5f-4e79-80ba-8fd23060edb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:12.605633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f238a4-6e5f-4e79-80ba-8fd23060edb6 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:12.606063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f238a4-6e5f-4e79-80ba-8fd23060edb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:12.606438 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f238a4-6e5f-4e79-80ba-8fd23060edb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:12.607813 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f238a4-6e5f-4e79-80ba-8fd23060edb6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:12.608226 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f238a4-6e5f-4e79-80ba-8fd23060edb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:12.610196 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f238a4-6e5f-4e79-80ba-8fd23060edb6 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:12.622634 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 368/727] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jul 11 11:06:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:12.624768 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017b16c-4b04-478e-b37f-80c17921ed30 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:12.625006 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017b16c-4b04-478e-b37f-80c17921ed30 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:12.625288 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017b16c-4b04-478e-b37f-80c17921ed30 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:12.627134 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 369/728] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:12.629459 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017b16c-4b04-478e-b37f-80c17921ed30 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:12.644992 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd207b-8e35-493a-8e1a-1223c24df452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:12.646113 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd207b-8e35-493a-8e1a-1223c24df452 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:12.646405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd207b-8e35-493a-8e1a-1223c24df452 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:12.646693 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd207b-8e35-493a-8e1a-1223c24df452 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:12.658024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd207b-8e35-493a-8e1a-1223c24df452 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:12.660095 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd207b-8e35-493a-8e1a-1223c24df452 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:12.679429 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-d2dd207b-8e35-493a-8e1a-1223c24df452 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:12.679429 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:12.679429 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:12.679429 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:12.679429 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:12.679429 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:12.679429 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:12.679429 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:12.679429 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:12.679429 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:12.679429 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:12.679429 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:12.679429 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:12.679429 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:12.679429 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:12.680415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:12.680415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:12.680415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:12.680415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:12.680415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:12.680415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:12.680415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:12.680415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:12.680415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:12.680415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:12.680415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:12.680415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:12.680415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:12.680415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:12.680415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:12.680415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:12.680415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:12.681316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:12.681316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:12.681316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:12.681316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:12.681316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 360/729] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:12.686250 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a7460-11ba-4e76-a262-2bbc961827a9 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:12.686250 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a7460-11ba-4e76-a262-2bbc961827a9 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:12.686250 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a7460-11ba-4e76-a262-2bbc961827a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:12.704277 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-4a0a7460-11ba-4e76-a262-2bbc961827a9 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:12.705477 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4a0a7460-11ba-4e76-a262-2bbc961827a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:12.755393 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:12.770063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017b16c-4b04-478e-b37f-80c17921ed30 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:12.793786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 361/730] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:06:12.793786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a7460-11ba-4e76-a262-2bbc961827a9 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:12.853813 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:12.865195 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5c667-e205-4317-9888-97c7722b76f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:12.865481 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5c667-e205-4317-9888-97c7722b76f9 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:12.865786 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5c667-e205-4317-9888-97c7722b76f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:12.866069 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5c667-e205-4317-9888-97c7722b76f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:12.877384 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5c667-e205-4317-9888-97c7722b76f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:12.879296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5c667-e205-4317-9888-97c7722b76f9 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:12.900420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-6db5c667-e205-4317-9888-97c7722b76f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:12.900420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:12.900420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:12.900420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:12.900420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:12.900420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:12.900420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:12.900420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:12.900420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:12.900420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:12.900420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:12.900420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:12.900420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:12.900420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:12.900420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:12.901377 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:12.901377 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:12.901377 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:12.901377 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:12.901377 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:12.901377 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:12.901377 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:12.901377 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:12.901377 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:12.901377 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:12.901377 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:12.901377 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:12.901377 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:12.901377 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:12.901377 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:12.901377 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:12.901377 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:12.902307 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:12.902307 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:12.902307 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:12.902307 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:12.906174 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 370/731] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:12.907037 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5c667-e205-4317-9888-97c7722b76f9 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:12.940466 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a7460-11ba-4e76-a262-2bbc961827a9 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:12.978719 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7711805-c288-4fdc-88ed-7be230bb92b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:12.979742 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7711805-c288-4fdc-88ed-7be230bb92b9 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:12.980259 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7711805-c288-4fdc-88ed-7be230bb92b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:12.980745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7711805-c288-4fdc-88ed-7be230bb92b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:12.981671 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7711805-c288-4fdc-88ed-7be230bb92b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:12.982215 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7711805-c288-4fdc-88ed-7be230bb92b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:12.983795 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7711805-c288-4fdc-88ed-7be230bb92b9 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:13.001975 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 362/732] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:13.003263 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7711805-c288-4fdc-88ed-7be230bb92b9 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:13.012213 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5c667-e205-4317-9888-97c7722b76f9 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:13.047525 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0fafe-31bc-4d32-87e4-85a6107020a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:13.048187 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0fafe-31bc-4d32-87e4-85a6107020a6 None admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:13.048468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0fafe-31bc-4d32-87e4-85a6107020a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:13.048742 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0fafe-31bc-4d32-87e4-85a6107020a6 None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:13.049682 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa0fafe-31bc-4d32-87e4-85a6107020a6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:13.051385 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa0fafe-31bc-4d32-87e4-85a6107020a6 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:13.094445 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:13.110233 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7711805-c288-4fdc-88ed-7be230bb92b9 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:13.149648 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aedddc8-de75-4d62-b008-6dc0574210af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:13.149863 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 371/733] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Jul 11 11:06:12 2022] POST /identity/v3/services => generated 240 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:06:13.149951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedddc8-de75-4d62-b008-6dc0574210af None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:13.149951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedddc8-de75-4d62-b008-6dc0574210af None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:13.150127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0fafe-31bc-4d32-87e4-85a6107020a6 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:13.150201 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedddc8-de75-4d62-b008-6dc0574210af None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:13.150201 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aedddc8-de75-4d62-b008-6dc0574210af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:13.150201 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aedddc8-de75-4d62-b008-6dc0574210af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:13.150201 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aedddc8-de75-4d62-b008-6dc0574210af None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:13.164612 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 363/734] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:13.166132 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea4269-1dcd-4ca6-b628-ef5341f99ae6 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:13.166426 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea4269-1dcd-4ca6-b628-ef5341f99ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:13.166787 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea4269-1dcd-4ca6-b628-ef5341f99ae6 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:13.169320 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 364/735] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:13.173118 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea4269-1dcd-4ca6-b628-ef5341f99ae6 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:13.183095 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:13.289419 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0fafe-31bc-4d32-87e4-85a6107020a6 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:13.293431 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea4269-1dcd-4ca6-b628-ef5341f99ae6 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:13.329875 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6610fa-2464-4fd8-9c76-8f45511f1bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:13.330713 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6610fa-2464-4fd8-9c76-8f45511f1bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:13.330993 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6610fa-2464-4fd8-9c76-8f45511f1bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:13.331342 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6610fa-2464-4fd8-9c76-8f45511f1bf8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:13.335101 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0dd50-603d-44ea-a007-05616aac5bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:13.336170 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0dd50-603d-44ea-a007-05616aac5bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:13.336464 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0dd50-603d-44ea-a007-05616aac5bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:13.336747 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0dd50-603d-44ea-a007-05616aac5bd7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:13.342394 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6610fa-2464-4fd8-9c76-8f45511f1bf8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:13.343073 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6610fa-2464-4fd8-9c76-8f45511f1bf8 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:13.346085 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0dd50-603d-44ea-a007-05616aac5bd7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:13.348817 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0dd50-603d-44ea-a007-05616aac5bd7 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:13.358013 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-0f6610fa-2464-4fd8-9c76-8f45511f1bf8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 11:06:13.358013 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:13.358013 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:13.358013 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:13.358013 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:13.358013 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:13.358013 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:13.358013 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:13.358013 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:13.358013 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:13.358013 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:13.358013 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:13.358013 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:06:13.358013 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:06:13.358013 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:06:13.358013 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:06:13.358946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:13.358946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:13.358946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:06:13.358946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:13.358946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:06:13.358946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:13.358946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:13.358946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:13.358946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:13.358946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:13.358946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:13.358946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:13.358946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:13.358946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:13.358946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:13.358946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:13.358946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:13.358946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:13.359981 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:13.359981 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:13.359981 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:06:13.359981 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:06:13.359981 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:06:13.359981 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:06:13.359981 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:06:13.359981 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:06:13.359981 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 11:06:13.359981 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:13.359981 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 372/736] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Jul 11 11:06:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:13.361038 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff502239-9875-4c93-a241-5988ac19da2f None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:13.361255 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff502239-9875-4c93-a241-5988ac19da2f None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:13.361537 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff502239-9875-4c93-a241-5988ac19da2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:13.370561 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-faa0dd50-603d-44ea-a007-05616aac5bd7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 11:06:13.370561 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:13.370561 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:13.370561 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:13.370561 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:13.370561 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:13.370561 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:13.370561 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:13.370561 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:13.370561 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:13.370561 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:13.370561 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:13.370561 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:06:13.370561 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:06:13.370561 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:06:13.370561 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:06:13.371557 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:13.371557 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:13.371557 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:06:13.371557 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:13.371557 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:06:13.371557 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:13.371557 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:13.371557 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:13.371557 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:13.371557 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:13.371557 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:13.371557 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:13.371557 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:13.371557 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:13.371557 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:13.371557 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:13.371557 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:13.371557 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:13.372502 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:13.372502 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:13.372502 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:06:13.372502 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:06:13.372502 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:06:13.372502 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:06:13.372502 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:06:13.372502 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:06:13.372502 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 11:06:13.372502 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:13.372502 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 365/737] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Jul 11 11:06:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:13.373664 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e324bd-d70d-4884-817c-11218b560132 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:13.373664 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e324bd-d70d-4884-817c-11218b560132 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:13.378030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e324bd-d70d-4884-817c-11218b560132 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:13.379516 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 366/738] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:13.380406 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e324bd-d70d-4884-817c-11218b560132 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:13.384742 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-ff502239-9875-4c93-a241-5988ac19da2f None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:13.385262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:13.386085 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-ff502239-9875-4c93-a241-5988ac19da2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:13.452849 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:13.469793 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 373/739] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:13 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:06:13.469793 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff502239-9875-4c93-a241-5988ac19da2f None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:13.502008 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e324bd-d70d-4884-817c-11218b560132 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:13.540643 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380be28-1eaf-4952-8814-220e11f048ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:13.541331 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380be28-1eaf-4952-8814-220e11f048ad None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:13.541626 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380be28-1eaf-4952-8814-220e11f048ad None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:13.541940 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380be28-1eaf-4952-8814-220e11f048ad None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:13.542788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380be28-1eaf-4952-8814-220e11f048ad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:13.543107 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380be28-1eaf-4952-8814-220e11f048ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:13.544590 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380be28-1eaf-4952-8814-220e11f048ad None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:13.564175 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 367/740] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Jul 11 11:06:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:13.568393 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff502239-9875-4c93-a241-5988ac19da2f None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:13.570380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799cd8e-7d23-4ba9-b326-991936283699 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:13.570680 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799cd8e-7d23-4ba9-b326-991936283699 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:13.570968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799cd8e-7d23-4ba9-b326-991936283699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:13.589128 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-8799cd8e-7d23-4ba9-b326-991936283699 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:13.590384 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8799cd8e-7d23-4ba9-b326-991936283699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:13.606659 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc919c43-81da-47f8-8d3d-c19a1add1681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:13.607337 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc919c43-81da-47f8-8d3d-c19a1add1681 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:13.607631 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc919c43-81da-47f8-8d3d-c19a1add1681 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:13.607897 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc919c43-81da-47f8-8d3d-c19a1add1681 None admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:13.608739 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc919c43-81da-47f8-8d3d-c19a1add1681 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:13.609048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc919c43-81da-47f8-8d3d-c19a1add1681 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:13.610505 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc919c43-81da-47f8-8d3d-c19a1add1681 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:13.633936 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 374/741] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Jul 11 11:06:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:13.633936 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc919c43-81da-47f8-8d3d-c19a1add1681 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:13.653337 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:13.673839 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 368/742] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:13 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:06:13.673839 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799cd8e-7d23-4ba9-b326-991936283699 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:13.708682 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:13.757721 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc919c43-81da-47f8-8d3d-c19a1add1681 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:13.783760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799cd8e-7d23-4ba9-b326-991936283699 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:13.793593 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709150c-026c-47ef-94a8-25753753e05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:13.794328 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709150c-026c-47ef-94a8-25753753e05c None admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:13.794615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709150c-026c-47ef-94a8-25753753e05c None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:13.794899 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709150c-026c-47ef-94a8-25753753e05c None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:13.795616 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709150c-026c-47ef-94a8-25753753e05c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:13.796982 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709150c-026c-47ef-94a8-25753753e05c None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:13.822921 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587bfb2b-a028-4552-a143-22b040c8497f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:13.823798 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bfb2b-a028-4552-a143-22b040c8497f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:13.824148 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bfb2b-a028-4552-a143-22b040c8497f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:13.824492 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bfb2b-a028-4552-a143-22b040c8497f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:13.835048 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587bfb2b-a028-4552-a143-22b040c8497f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:13.836479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587bfb2b-a028-4552-a143-22b040c8497f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:13.854065 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-587bfb2b-a028-4552-a143-22b040c8497f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:13.854065 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:13.854065 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:13.854065 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:13.854065 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:13.854065 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:13.854065 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:13.854065 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:13.854065 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:13.854065 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:13.854065 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:13.854065 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:13.854065 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:13.854065 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:13.854065 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:13.855533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:13.855533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:13.855533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:13.855533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:13.855533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:13.855533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:13.855533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:13.855533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:13.855533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:13.855533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:13.855533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:13.855533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:13.855533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:13.855533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:13.855533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:13.855533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:13.855533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:13.857266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:13.857266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:13.857266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:13.857266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:13.857266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 369/743] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:13.857266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587bfb2b-a028-4552-a143-22b040c8497f None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:13.877036 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 375/744] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Jul 11 11:06:13 2022] POST /identity/v3/services => generated 251 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:06:13.878559 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709150c-026c-47ef-94a8-25753753e05c None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:13.932118 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:14.015099 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587bfb2b-a028-4552-a143-22b040c8497f None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:14.017324 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709150c-026c-47ef-94a8-25753753e05c None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:14.031330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:14.062097 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835abaf-57e7-4705-ab1a-930c69d2bade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:14.063120 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835abaf-57e7-4705-ab1a-930c69d2bade None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:14.063581 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835abaf-57e7-4705-ab1a-930c69d2bade None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:14.063974 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2c5b2-3a47-47a3-aa02-0e62c46b0a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:14.064138 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835abaf-57e7-4705-ab1a-930c69d2bade None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:14.064770 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2c5b2-3a47-47a3-aa02-0e62c46b0a34 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:14.065056 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2c5b2-3a47-47a3-aa02-0e62c46b0a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:14.065332 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2c5b2-3a47-47a3-aa02-0e62c46b0a34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:14.077224 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2c5b2-3a47-47a3-aa02-0e62c46b0a34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:06:14.085978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-54f2c5b2-3a47-47a3-aa02-0e62c46b0a34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:06:14.085978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:14.085978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:14.085978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:14.085978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:14.085978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:14.085978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:14.085978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:14.085978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:14.085978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:14.085978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:14.085978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:14.085978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:06:14.085978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:06:14.085978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:06:14.085978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:06:14.086963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:06:14.086963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:06:14.086963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:06:14.086963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:06:14.086963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:14.086963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:14.086963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:14.086963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:14.086963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:14.086963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:14.086963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:14.086963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:14.086963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:14.086963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:14.086963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:14.086963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:14.087861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:14.087861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:14.087861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:14.087861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:14.087861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:06:14.087861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:06:14.087861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:06:14.087861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:06:14.087861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:06:14.087861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:06:14.087861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:06:14.087861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:14.087861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 376/745] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:06:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:14.088547 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2c5b2-3a47-47a3-aa02-0e62c46b0a34 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:14.154258 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7835abaf-57e7-4705-ab1a-930c69d2bade None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:14.156163 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7835abaf-57e7-4705-ab1a-930c69d2bade None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:14.207527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:14.234836 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2c5b2-3a47-47a3-aa02-0e62c46b0a34 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:14.274525 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2912b-b107-4571-bbe8-0edfdb02b919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:14.275223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2912b-b107-4571-bbe8-0edfdb02b919 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:14.275585 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2912b-b107-4571-bbe8-0edfdb02b919 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:14.275934 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2912b-b107-4571-bbe8-0edfdb02b919 None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:14.281017 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2912b-b107-4571-bbe8-0edfdb02b919 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:14.281017 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2912b-b107-4571-bbe8-0edfdb02b919 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:14.281017 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2912b-b107-4571-bbe8-0edfdb02b919 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:14.281507 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 370/746] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:06:13 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 11:06:14.282702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835abaf-57e7-4705-ab1a-930c69d2bade None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:14.294615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 377/747] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:14.295495 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2912b-b107-4571-bbe8-0edfdb02b919 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:14.341286 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:14.404311 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835abaf-57e7-4705-ab1a-930c69d2bade None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:14.424470 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2912b-b107-4571-bbe8-0edfdb02b919 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:14.451153 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a689ac3-ad1b-4339-b9bf-097ccf1f48d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:14.452106 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a689ac3-ad1b-4339-b9bf-097ccf1f48d8 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:14.452401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a689ac3-ad1b-4339-b9bf-097ccf1f48d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:14.452684 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a689ac3-ad1b-4339-b9bf-097ccf1f48d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:14.453444 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a689ac3-ad1b-4339-b9bf-097ccf1f48d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:14.453777 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a689ac3-ad1b-4339-b9bf-097ccf1f48d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:14.455982 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a689ac3-ad1b-4339-b9bf-097ccf1f48d8 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:14.464109 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5ef70-1f17-4615-9963-5a9911b94fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:14.465178 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5ef70-1f17-4615-9963-5a9911b94fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:14.465676 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5ef70-1f17-4615-9963-5a9911b94fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:14.466171 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5ef70-1f17-4615-9963-5a9911b94fa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:14.466565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 371/748] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:06:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:14.467464 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a689ac3-ad1b-4339-b9bf-097ccf1f48d8 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:14.477960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5ef70-1f17-4615-9963-5a9911b94fa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:14.478832 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:14.480250 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5ef70-1f17-4615-9963-5a9911b94fa9 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:14.499741 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-3ca5ef70-1f17-4615-9963-5a9911b94fa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:14.499741 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:14.499741 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:14.499741 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:14.499741 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:14.499741 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:14.499741 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:14.499741 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:14.499741 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:14.499741 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:14.499741 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:14.499741 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:14.499741 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:14.499741 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:14.499741 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:14.500648 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:14.500648 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:14.500648 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:14.500648 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:14.500648 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:14.500648 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:14.500648 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:14.500648 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:14.500648 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:14.500648 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:14.500648 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:14.500648 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:14.500648 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:14.500648 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:14.500648 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:14.500648 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:14.500648 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:14.501522 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:14.501522 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:14.501522 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:14.501522 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:14.508710 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 378/749] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:14.510064 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5ef70-1f17-4615-9963-5a9911b94fa9 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:14.596512 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:14.598177 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a689ac3-ad1b-4339-b9bf-097ccf1f48d8 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:14.619676 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5ef70-1f17-4615-9963-5a9911b94fa9 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:14.647244 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413dc3b-b073-4aa5-a9e1-0b1adab78fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:14.648532 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413dc3b-b073-4aa5-a9e1-0b1adab78fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:14.648878 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413dc3b-b073-4aa5-a9e1-0b1adab78fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:14.649173 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413dc3b-b073-4aa5-a9e1-0b1adab78fe9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:14.658722 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413dc3b-b073-4aa5-a9e1-0b1adab78fe9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:14.660251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413dc3b-b073-4aa5-a9e1-0b1adab78fe9 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:14.661033 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54cf8ca-e80e-4ccf-a07e-2631928f2e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:14.662095 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54cf8ca-e80e-4ccf-a07e-2631928f2e4f None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:14.662578 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54cf8ca-e80e-4ccf-a07e-2631928f2e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:14.663046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54cf8ca-e80e-4ccf-a07e-2631928f2e4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:14.674317 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54cf8ca-e80e-4ccf-a07e-2631928f2e4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:14.677112 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54cf8ca-e80e-4ccf-a07e-2631928f2e4f None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:14.678047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-c413dc3b-b073-4aa5-a9e1-0b1adab78fe9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:14.678047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:14.678047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:14.678047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:14.678047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:14.678047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:14.678047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:14.678047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:14.678047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:14.678047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:14.678047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:14.678047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:14.678047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:06:14.678047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:06:14.678047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:06:14.678910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:06:14.678910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:14.678910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:14.678910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:14.678910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:14.678910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:14.678910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:14.678910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:14.678910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:14.678910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:14.678910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:14.678910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:14.678910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:14.678910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:14.678910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:14.678910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:14.678910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:14.679794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:06:14.679794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:06:14.679794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:06:14.679794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:06:14.679794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:06:14.679794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:06:14.679794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:14.679794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:14.679794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 372/750] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:06:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:14.680691 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413dc3b-b073-4aa5-a9e1-0b1adab78fe9 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:14.699796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-d54cf8ca-e80e-4ccf-a07e-2631928f2e4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:14.699796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:14.699796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:14.699796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:14.699796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:14.699796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:14.699796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:14.699796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:14.699796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:14.699796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:14.699796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:14.699796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:14.699796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:14.699796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:14.699796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:14.700737 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:14.700737 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:14.700737 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:14.700737 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:14.700737 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:14.700737 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:14.700737 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:14.700737 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:14.700737 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:14.700737 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:14.700737 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:14.700737 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:14.700737 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:14.700737 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:14.700737 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:14.700737 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:14.700737 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:14.701600 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:14.701600 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:14.701600 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:14.701600 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:14.703922 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 379/751] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:14.704897 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54cf8ca-e80e-4ccf-a07e-2631928f2e4f None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:14.764502 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:14.804829 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413dc3b-b073-4aa5-a9e1-0b1adab78fe9 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:14.839519 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54cf8ca-e80e-4ccf-a07e-2631928f2e4f None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:14.841725 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac85e6-c523-4c09-88da-6b2fb6861752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:14.842643 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac85e6-c523-4c09-88da-6b2fb6861752 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:14.843122 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac85e6-c523-4c09-88da-6b2fb6861752 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:14.843592 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac85e6-c523-4c09-88da-6b2fb6861752 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:14.844525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac85e6-c523-4c09-88da-6b2fb6861752 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:14.845026 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac85e6-c523-4c09-88da-6b2fb6861752 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:14.847364 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac85e6-c523-4c09-88da-6b2fb6861752 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:14.864076 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 373/752] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:14.865454 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac85e6-c523-4c09-88da-6b2fb6861752 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:14.885946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97196e59-f5b3-49bb-a231-563cb1e36f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:14.886999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97196e59-f5b3-49bb-a231-563cb1e36f35 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:14.887292 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97196e59-f5b3-49bb-a231-563cb1e36f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:14.887575 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97196e59-f5b3-49bb-a231-563cb1e36f35 None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:14.888385 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97196e59-f5b3-49bb-a231-563cb1e36f35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:14.888704 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97196e59-f5b3-49bb-a231-563cb1e36f35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:14.890250 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97196e59-f5b3-49bb-a231-563cb1e36f35 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:14.892711 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:14.912268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 380/753] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:06:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:14.913434 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97196e59-f5b3-49bb-a231-563cb1e36f35 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:14.982410 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac85e6-c523-4c09-88da-6b2fb6861752 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:15.011181 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:15.021571 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c90bee-1dcf-40bc-9fd3-d795ebc87aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:15.022624 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c90bee-1dcf-40bc-9fd3-d795ebc87aaf None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:15.023069 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c90bee-1dcf-40bc-9fd3-d795ebc87aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:15.025606 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c90bee-1dcf-40bc-9fd3-d795ebc87aaf None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:15.025606 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c90bee-1dcf-40bc-9fd3-d795ebc87aaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:15.025606 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c90bee-1dcf-40bc-9fd3-d795ebc87aaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:15.026541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c90bee-1dcf-40bc-9fd3-d795ebc87aaf None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:15.037521 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97196e59-f5b3-49bb-a231-563cb1e36f35 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:15.040800 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 374/754] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:15.041892 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c90bee-1dcf-40bc-9fd3-d795ebc87aaf None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:15.073628 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12ffcf-205d-4460-a5fa-6dfea37d65aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:15.074487 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12ffcf-205d-4460-a5fa-6dfea37d65aa None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:15.074745 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12ffcf-205d-4460-a5fa-6dfea37d65aa None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:15.075028 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12ffcf-205d-4460-a5fa-6dfea37d65aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:15.082692 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee12ffcf-205d-4460-a5fa-6dfea37d65aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:15.084076 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee12ffcf-205d-4460-a5fa-6dfea37d65aa None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:15.099513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-ee12ffcf-205d-4460-a5fa-6dfea37d65aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:15.099513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:15.099513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:15.099513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:15.099513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:15.099513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:15.099513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:15.099513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:15.099513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:15.099513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:15.099513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:15.099513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:15.099513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:06:15.099513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:06:15.099513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:06:15.100460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:06:15.100460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:15.100460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:15.100460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:15.100460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:15.100460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:15.100460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:15.100460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:15.100460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:15.100460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:15.100460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:15.100460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:15.100460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:15.100460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:15.100460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:15.100460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:15.100460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:15.101368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:06:15.101368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:06:15.101368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:06:15.101368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:06:15.101368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:06:15.101368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:06:15.101368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:15.101368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:15.105490 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 381/755] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:06:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:15.106509 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12ffcf-205d-4460-a5fa-6dfea37d65aa None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:15.161380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c90bee-1dcf-40bc-9fd3-d795ebc87aaf None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:15.165840 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:15.201155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb36420-655b-4070-9882-16715d5f7db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:15.202535 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb36420-655b-4070-9882-16715d5f7db8 None admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:15.203104 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb36420-655b-4070-9882-16715d5f7db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:15.203585 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb36420-655b-4070-9882-16715d5f7db8 None admin] PATH_INFO: `/v3/projects/38ed7416526e473b816330e24acf7a04/users/5b9e7594afc346e593ef3e6c579e237b/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:15.206008 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb36420-655b-4070-9882-16715d5f7db8 None admin] RBAC: Authorizing `identity:create_grant(project_id=38ed7416526e473b816330e24acf7a04, user_id=5b9e7594afc346e593ef3e6c579e237b, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:15.208486 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb36420-655b-4070-9882-16715d5f7db8 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:15.212337 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12ffcf-205d-4460-a5fa-6dfea37d65aa None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:15.247633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e940652-a5de-4c0b-ac71-407b6ed0d283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:15.248498 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e940652-a5de-4c0b-ac71-407b6ed0d283 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:15.248786 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e940652-a5de-4c0b-ac71-407b6ed0d283 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:15.249117 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e940652-a5de-4c0b-ac71-407b6ed0d283 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:15.257649 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e940652-a5de-4c0b-ac71-407b6ed0d283 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:15.259129 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e940652-a5de-4c0b-ac71-407b6ed0d283 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:15.273223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-2e940652-a5de-4c0b-ac71-407b6ed0d283 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 11:06:15.273223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:15.273223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:15.273223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:15.273223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:15.273223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:15.273223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:15.273223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:15.273223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:15.273223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:15.273223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:15.273223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:15.273223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:06:15.273223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:06:15.273223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:06:15.273223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:06:15.274348 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:15.274348 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:15.274348 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:06:15.274348 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:15.274348 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:06:15.274348 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:15.274348 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:15.274348 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:15.274348 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:15.274348 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:15.274348 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:15.274348 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:15.274348 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:15.274348 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:15.274348 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:15.274348 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:15.274348 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:15.274348 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:15.275488 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:15.275488 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:15.275488 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:06:15.275488 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:06:15.275488 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:06:15.275488 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:06:15.275488 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:06:15.275488 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:06:15.275488 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 11:06:15.275488 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:15.275488 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 382/756] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:06:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:15.275488 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e940652-a5de-4c0b-ac71-407b6ed0d283 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:15.291816 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 375/757] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jul 11 11:06:15 2022] PUT /identity/v3/projects/38ed7416526e473b816330e24acf7a04/users/5b9e7594afc346e593ef3e6c579e237b/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:06:15.293284 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c76efc-282c-429f-ba5a-8932b86d3e04 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:15.293680 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c76efc-282c-429f-ba5a-8932b86d3e04 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:15.294100 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c76efc-282c-429f-ba5a-8932b86d3e04 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:15.295731 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 376/758] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:15.296370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c76efc-282c-429f-ba5a-8932b86d3e04 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:15.366399 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:15.419662 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e940652-a5de-4c0b-ac71-407b6ed0d283 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:15.427153 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c76efc-282c-429f-ba5a-8932b86d3e04 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:15.437579 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:15.464751 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b117e91-0b96-4d8d-9d1e-df8e6fdee9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:15.466176 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b117e91-0b96-4d8d-9d1e-df8e6fdee9a5 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:15.466526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b117e91-0b96-4d8d-9d1e-df8e6fdee9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:15.466866 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b117e91-0b96-4d8d-9d1e-df8e6fdee9a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:15.468285 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b117e91-0b96-4d8d-9d1e-df8e6fdee9a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:15.468953 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b117e91-0b96-4d8d-9d1e-df8e6fdee9a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:15.470596 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b117e91-0b96-4d8d-9d1e-df8e6fdee9a5 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:15.474600 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79829afd-7b74-4cd7-8d89-b3629e0a1925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:15.475377 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79829afd-7b74-4cd7-8d89-b3629e0a1925 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:15.475575 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79829afd-7b74-4cd7-8d89-b3629e0a1925 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:15.475873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79829afd-7b74-4cd7-8d89-b3629e0a1925 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:15.476698 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79829afd-7b74-4cd7-8d89-b3629e0a1925 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:15.477016 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79829afd-7b74-4cd7-8d89-b3629e0a1925 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:15.478474 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79829afd-7b74-4cd7-8d89-b3629e0a1925 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:15.490228 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 383/759] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:06:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:15.491668 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d671b59-d55c-42af-a011-2e7fa856ceb4 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:15.492066 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d671b59-d55c-42af-a011-2e7fa856ceb4 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:15.492446 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d671b59-d55c-42af-a011-2e7fa856ceb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:15.500796 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 377/760] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Jul 11 11:06:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:15.501844 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79829afd-7b74-4cd7-8d89-b3629e0a1925 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:15.510612 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-7d671b59-d55c-42af-a011-2e7fa856ceb4 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:15.511936 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-7d671b59-d55c-42af-a011-2e7fa856ceb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:15.586269 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 384/761] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:06:15.589801 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d671b59-d55c-42af-a011-2e7fa856ceb4 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:15.656460 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79829afd-7b74-4cd7-8d89-b3629e0a1925 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:15.660161 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:15.704531 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8fa84-68dc-4226-b3c3-e76bb3f940d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:15.705236 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8fa84-68dc-4226-b3c3-e76bb3f940d8 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:15.705520 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8fa84-68dc-4226-b3c3-e76bb3f940d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:15.705819 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8fa84-68dc-4226-b3c3-e76bb3f940d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:15.707668 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e8fa84-68dc-4226-b3c3-e76bb3f940d8 None admin] RBAC: Adding query filter params (role.id=9b682db1e9a5486884a74f5c01953fe7, scope.project.id=38ed7416526e473b816330e24acf7a04, user.id=cdfa8f4012c2471b81f8749b013d3117) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:15.708129 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e8fa84-68dc-4226-b3c3-e76bb3f940d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:15.709724 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e8fa84-68dc-4226-b3c3-e76bb3f940d8 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:15.716254 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d671b59-d55c-42af-a011-2e7fa856ceb4 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:15.721827 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 378/762] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:06:15 2022] GET /identity/v3/role_assignments?user.id=cdfa8f4012c2471b81f8749b013d3117&scope.project.id=38ed7416526e473b816330e24acf7a04&role.id=9b682db1e9a5486884a74f5c01953fe7 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:15.721827 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8fa84-68dc-4226-b3c3-e76bb3f940d8 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:15.726953 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:15.847698 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8fa84-68dc-4226-b3c3-e76bb3f940d8 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:15.863910 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a420057-06b9-409d-a168-de76913a56e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:15.865159 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a420057-06b9-409d-a168-de76913a56e1 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:15.865593 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a420057-06b9-409d-a168-de76913a56e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:15.866053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a420057-06b9-409d-a168-de76913a56e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:15.889799 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9acef-51c2-4a4a-a640-ce5d7b11798f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:15.889799 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9acef-51c2-4a4a-a640-ce5d7b11798f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:15.889799 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9acef-51c2-4a4a-a640-ce5d7b11798f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:15.889799 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9acef-51c2-4a4a-a640-ce5d7b11798f None admin] PATH_INFO: `/v3/services/network` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:15.890186 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9acef-51c2-4a4a-a640-ce5d7b11798f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:15.890694 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9acef-51c2-4a4a-a640-ce5d7b11798f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:15.916523 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-41b9acef-51c2-4a4a-a640-ce5d7b11798f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 11:06:15.916523 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:15.916523 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:06:15.916523 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:06:15.916523 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:06:15.916523 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:06:15.916523 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:06:15.916523 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:15.916523 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 11:06:15.916523 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:15.916523 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:06:15.916523 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:15.916523 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:15.916523 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:15.916523 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:15.916523 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:15.916523 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:15.917541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:15.917541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:15.917541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:15.917541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:15.917541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:15.917541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:15.917541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:06:15.917541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:06:15.917541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:06:15.917541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:06:15.917541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:15.917541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:15.917541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:15.917541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:15.917541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:15.917541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:15.918414 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:15.918414 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:15.918414 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:15.918414 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:15.918414 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:15.918414 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:15.918414 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:15.918414 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:15.918414 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:15.918414 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:15.918414 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:06:15.918414 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:15.918414 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 11:06:15.918414 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:15.922278 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 379/763] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:06:15 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:15.923983 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9acef-51c2-4a4a-a640-ce5d7b11798f None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:15.969032 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:16.035497 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9acef-51c2-4a4a-a640-ce5d7b11798f None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:16.074387 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e309e0-b530-458c-91f7-1e69fcc77138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:16.077197 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e309e0-b530-458c-91f7-1e69fcc77138 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:16.077197 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e309e0-b530-458c-91f7-1e69fcc77138 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:16.077626 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e309e0-b530-458c-91f7-1e69fcc77138 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:16.080151 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e309e0-b530-458c-91f7-1e69fcc77138 None admin] RBAC: Adding query filter params (name=network) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:16.080513 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e309e0-b530-458c-91f7-1e69fcc77138 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:16.082956 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e309e0-b530-458c-91f7-1e69fcc77138 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:16.089092 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 380/764] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Jul 11 11:06:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:16.094967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e309e0-b530-458c-91f7-1e69fcc77138 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:16.106893 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a420057-06b9-409d-a168-de76913a56e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:16.108333 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a420057-06b9-409d-a168-de76913a56e1 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:16.215878 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 385/765] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:06:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 11:06:16.217377 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b39cf-493b-49fb-a4ca-aa8cf27b21b3 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:16.217673 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b39cf-493b-49fb-a4ca-aa8cf27b21b3 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:16.218000 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b39cf-493b-49fb-a4ca-aa8cf27b21b3 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:16.223738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 386/766] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:16.224488 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b39cf-493b-49fb-a4ca-aa8cf27b21b3 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:16.226869 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e309e0-b530-458c-91f7-1e69fcc77138 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:16.229138 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:16.242146 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:16.280451 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0383a4-5e2d-4ccc-8def-7191f601bbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:16.281185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0383a4-5e2d-4ccc-8def-7191f601bbd2 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:16.281466 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0383a4-5e2d-4ccc-8def-7191f601bbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:16.281817 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0383a4-5e2d-4ccc-8def-7191f601bbd2 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:16.282528 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0383a4-5e2d-4ccc-8def-7191f601bbd2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:16.282835 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0383a4-5e2d-4ccc-8def-7191f601bbd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:16.284200 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0383a4-5e2d-4ccc-8def-7191f601bbd2 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:16.291536 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 381/767] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Jul 11 11:06:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:16.292759 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5d719-c741-4249-a2e3-e11e4833979a None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:16.293047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5d719-c741-4249-a2e3-e11e4833979a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:16.293326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5d719-c741-4249-a2e3-e11e4833979a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:16.311816 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-5ed5d719-c741-4249-a2e3-e11e4833979a None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:16.313004 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-5ed5d719-c741-4249-a2e3-e11e4833979a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:16.354231 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b39cf-493b-49fb-a4ca-aa8cf27b21b3 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:16.390079 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 382/768] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:06:16.390958 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5d719-c741-4249-a2e3-e11e4833979a None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:16.395664 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c82301-ee32-4c9f-908d-38ce2f717104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:16.397280 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c82301-ee32-4c9f-908d-38ce2f717104 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:16.397577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c82301-ee32-4c9f-908d-38ce2f717104 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:16.397881 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c82301-ee32-4c9f-908d-38ce2f717104 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:16.410345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c82301-ee32-4c9f-908d-38ce2f717104 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:16.412236 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c82301-ee32-4c9f-908d-38ce2f717104 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:16.435748 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-d6c82301-ee32-4c9f-908d-38ce2f717104 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:16.435748 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:16.435748 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:16.435748 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:16.435748 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:16.435748 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:16.435748 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:16.435748 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:16.435748 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:16.435748 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:16.435748 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:16.435748 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:16.435748 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:16.435748 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:16.435748 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:16.436689 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:16.436689 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:16.436689 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:16.436689 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:16.436689 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:16.436689 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:16.436689 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:16.436689 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:16.436689 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:16.436689 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:16.436689 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:16.436689 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:16.436689 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:16.436689 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:16.436689 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:16.436689 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:16.436689 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:16.437570 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:16.437570 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:16.437570 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:16.437570 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:16.438252 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 387/769] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:16.439087 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c82301-ee32-4c9f-908d-38ce2f717104 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:16.513474 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:16.522974 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:16.526387 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5d719-c741-4249-a2e3-e11e4833979a None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:16.567564 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25a03a-6e64-439b-9d8c-37ee47355456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:16.568397 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25a03a-6e64-439b-9d8c-37ee47355456 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:16.568790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25a03a-6e64-439b-9d8c-37ee47355456 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:16.569173 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25a03a-6e64-439b-9d8c-37ee47355456 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:16.570109 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25a03a-6e64-439b-9d8c-37ee47355456 None admin] RBAC: Adding query filter params (interface=public, service_id=06a9898c2c424c4baf27fe3eb0d13ae5, region_id=RegionOne) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:16.570540 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25a03a-6e64-439b-9d8c-37ee47355456 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:16.572018 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25a03a-6e64-439b-9d8c-37ee47355456 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:16.573325 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c82301-ee32-4c9f-908d-38ce2f717104 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:16.581959 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 383/770] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Jul 11 11:06:16 2022] GET /identity/v3/endpoints?service_id=06a9898c2c424c4baf27fe3eb0d13ae5&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:16.582835 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25a03a-6e64-439b-9d8c-37ee47355456 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:16.615656 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c8e6a-4f90-4d63-895c-bc332b884a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:16.616780 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c8e6a-4f90-4d63-895c-bc332b884a04 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:16.617318 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c8e6a-4f90-4d63-895c-bc332b884a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:16.617600 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c8e6a-4f90-4d63-895c-bc332b884a04 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:16.618285 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c8e6a-4f90-4d63-895c-bc332b884a04 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:16.619807 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c8e6a-4f90-4d63-895c-bc332b884a04 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:16.636573 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-f70c8e6a-4f90-4d63-895c-bc332b884a04 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 11:06:16.636573 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:16.636573 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:06:16.636573 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:06:16.636573 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:06:16.636573 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:06:16.636573 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:06:16.636573 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:16.636573 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 11:06:16.636573 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:16.636573 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:06:16.636573 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:16.636573 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:16.636573 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:16.636573 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:16.636573 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:16.637512 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:16.637512 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:16.637512 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:16.637512 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:16.637512 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:16.637512 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:16.637512 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:16.637512 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:06:16.637512 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:06:16.637512 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:06:16.637512 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:06:16.637512 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:16.637512 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:16.637512 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:16.637512 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:16.637512 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:16.638358 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:16.638358 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:16.638358 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:16.638358 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:16.638358 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:16.638358 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:16.638358 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:16.638358 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:16.638358 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:16.638358 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:16.638358 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:16.638358 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:06:16.638358 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:16.638358 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 11:06:16.638358 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:16.641860 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 388/771] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Jul 11 11:06:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:16.642696 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c8e6a-4f90-4d63-895c-bc332b884a04 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:16.712147 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25a03a-6e64-439b-9d8c-37ee47355456 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:16.752697 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1d99a-56fc-4e57-8ea2-751723dbd358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:16.753738 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1d99a-56fc-4e57-8ea2-751723dbd358 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:16.754061 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1d99a-56fc-4e57-8ea2-751723dbd358 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:16.754490 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1d99a-56fc-4e57-8ea2-751723dbd358 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:16.755363 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1d99a-56fc-4e57-8ea2-751723dbd358 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:16.755680 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1d99a-56fc-4e57-8ea2-751723dbd358 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:16.756550 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c8e6a-4f90-4d63-895c-bc332b884a04 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:16.757066 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1d99a-56fc-4e57-8ea2-751723dbd358 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:16.784963 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 384/772] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:16.785993 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:16.787646 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1d99a-56fc-4e57-8ea2-751723dbd358 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:16.804281 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a6eef-7a42-46d9-964b-e078e795d529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:16.804956 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a6eef-7a42-46d9-964b-e078e795d529 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:16.805243 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a6eef-7a42-46d9-964b-e078e795d529 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:16.805568 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a6eef-7a42-46d9-964b-e078e795d529 None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:16.806317 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a6eef-7a42-46d9-964b-e078e795d529 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:16.807577 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:16.807687 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a6eef-7a42-46d9-964b-e078e795d529 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:16.820205 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 389/773] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Jul 11 11:06:16 2022] GET /identity/v3/services => generated 772 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:16.820205 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a6eef-7a42-46d9-964b-e078e795d529 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:16.945584 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1d99a-56fc-4e57-8ea2-751723dbd358 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:16.994949 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417e069-1fe4-4d95-82b7-a3ea5aad27f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:16.995639 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417e069-1fe4-4d95-82b7-a3ea5aad27f3 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:16.995921 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417e069-1fe4-4d95-82b7-a3ea5aad27f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:16.996196 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417e069-1fe4-4d95-82b7-a3ea5aad27f3 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:16.996913 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417e069-1fe4-4d95-82b7-a3ea5aad27f3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:16.997433 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417e069-1fe4-4d95-82b7-a3ea5aad27f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:16.998886 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417e069-1fe4-4d95-82b7-a3ea5aad27f3 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:17.008759 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 385/774] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Jul 11 11:06:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:17.015602 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417e069-1fe4-4d95-82b7-a3ea5aad27f3 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:17.043930 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a6eef-7a42-46d9-964b-e078e795d529 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:17.082851 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71264d80-2b79-4641-8ec7-591a739a40e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:17.083857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71264d80-2b79-4641-8ec7-591a739a40e9 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:17.084213 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71264d80-2b79-4641-8ec7-591a739a40e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:17.084560 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71264d80-2b79-4641-8ec7-591a739a40e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:17.092013 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71264d80-2b79-4641-8ec7-591a739a40e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:17.093644 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71264d80-2b79-4641-8ec7-591a739a40e9 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:17.110210 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-71264d80-2b79-4641-8ec7-591a739a40e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:17.110210 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:17.110210 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:17.110210 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:17.110210 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:17.110210 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:17.110210 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:17.110210 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:17.110210 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:17.110210 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:17.110210 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:17.110210 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:17.110210 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:06:17.110210 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:06:17.110210 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:06:17.111143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:06:17.111143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:17.111143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:17.111143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:17.111143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:17.111143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:17.111143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:17.111143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:17.111143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:17.111143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:17.111143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:17.111143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:17.111143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:17.111143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:17.111143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:17.111143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:17.111143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:17.112056 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:06:17.112056 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:06:17.112056 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:06:17.112056 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:06:17.112056 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:06:17.112056 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:06:17.112056 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:17.112056 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:17.112056 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 390/775] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:06:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:17.118216 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71264d80-2b79-4641-8ec7-591a739a40e9 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:17.124077 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:17.152439 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417e069-1fe4-4d95-82b7-a3ea5aad27f3 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:17.172426 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:17.200021 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7e7fc-e187-495d-992e-c81414c5e26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:17.201087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7e7fc-e187-495d-992e-c81414c5e26e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:17.201570 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7e7fc-e187-495d-992e-c81414c5e26e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:17.202066 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7e7fc-e187-495d-992e-c81414c5e26e None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:17.202971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf7e7fc-e187-495d-992e-c81414c5e26e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:17.203473 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf7e7fc-e187-495d-992e-c81414c5e26e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:17.205050 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf7e7fc-e187-495d-992e-c81414c5e26e None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:17.211311 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 386/776] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Jul 11 11:06:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:17.230834 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7e7fc-e187-495d-992e-c81414c5e26e None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:17.242319 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71264d80-2b79-4641-8ec7-591a739a40e9 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:17.282639 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fe8b7-1fe6-4ae8-ba26-241a3973d62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:17.283448 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fe8b7-1fe6-4ae8-ba26-241a3973d62f None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:17.283830 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fe8b7-1fe6-4ae8-ba26-241a3973d62f None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:17.284205 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fe8b7-1fe6-4ae8-ba26-241a3973d62f None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:17.288596 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6fe8b7-1fe6-4ae8-ba26-241a3973d62f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:17.288596 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6fe8b7-1fe6-4ae8-ba26-241a3973d62f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:17.288596 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6fe8b7-1fe6-4ae8-ba26-241a3973d62f None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:17.302865 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 391/777] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:06:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:17.308571 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fe8b7-1fe6-4ae8-ba26-241a3973d62f None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:17.443773 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fe8b7-1fe6-4ae8-ba26-241a3973d62f None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:17.446806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:17.455557 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7e7fc-e187-495d-992e-c81414c5e26e None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:17.483738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e5483-4ed0-41c5-a76e-878771f1808b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:17.484587 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e5483-4ed0-41c5-a76e-878771f1808b None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:17.484941 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e5483-4ed0-41c5-a76e-878771f1808b None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:17.485315 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e5483-4ed0-41c5-a76e-878771f1808b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:17.486189 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e5483-4ed0-41c5-a76e-878771f1808b None admin] RBAC: Adding query filter params (role.id=736e70deba004b9289c2fed43eb107f7, scope.project.id=38ed7416526e473b816330e24acf7a04, user.id=736f6d4d1dbb47ff98bc67e53614d49c) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:17.486555 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e5483-4ed0-41c5-a76e-878771f1808b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:17.488815 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e5483-4ed0-41c5-a76e-878771f1808b None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:17.501792 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 392/778] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:06:17 2022] GET /identity/v3/role_assignments?user.id=736f6d4d1dbb47ff98bc67e53614d49c&scope.project.id=38ed7416526e473b816330e24acf7a04&role.id=736e70deba004b9289c2fed43eb107f7 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:17.501792 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba665d2-a70a-469b-ad99-54c44f135c2a None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:17.501792 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba665d2-a70a-469b-ad99-54c44f135c2a None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:17.501792 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba665d2-a70a-469b-ad99-54c44f135c2a None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:17.501792 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 393/779] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:17.505165 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08086af2-2bbe-46df-a871-1442ac2e2469 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:17.505458 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08086af2-2bbe-46df-a871-1442ac2e2469 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:17.505742 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08086af2-2bbe-46df-a871-1442ac2e2469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:17.524936 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-08086af2-2bbe-46df-a871-1442ac2e2469 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:17.526184 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-08086af2-2bbe-46df-a871-1442ac2e2469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:17.538638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c346d10-3df9-4ee2-9190-bbece48d1600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:17.539680 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c346d10-3df9-4ee2-9190-bbece48d1600 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:17.540184 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c346d10-3df9-4ee2-9190-bbece48d1600 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:17.540667 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c346d10-3df9-4ee2-9190-bbece48d1600 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:17.541663 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c346d10-3df9-4ee2-9190-bbece48d1600 None admin] RBAC: Adding query filter params (interface=public, service_id=e11306dad0ae4dbd877546268fc78939, region_id=RegionOne) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:17.542230 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c346d10-3df9-4ee2-9190-bbece48d1600 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:17.543795 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c346d10-3df9-4ee2-9190-bbece48d1600 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:17.556048 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 387/780] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Jul 11 11:06:17 2022] GET /identity/v3/endpoints?service_id=e11306dad0ae4dbd877546268fc78939&interface=public®ion_id=RegionOne => generated 194 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:17.561990 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c346d10-3df9-4ee2-9190-bbece48d1600 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:17.584629 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:17.641916 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 394/781] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 11:06:17.681124 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08086af2-2bbe-46df-a871-1442ac2e2469 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:17.730804 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c346d10-3df9-4ee2-9190-bbece48d1600 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:17.799697 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:17.806437 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08086af2-2bbe-46df-a871-1442ac2e2469 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:17.818507 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb74e47-1a02-4172-870a-1ec3549bc1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:17.819596 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb74e47-1a02-4172-870a-1ec3549bc1fd None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:17.820151 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb74e47-1a02-4172-870a-1ec3549bc1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:17.820626 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb74e47-1a02-4172-870a-1ec3549bc1fd None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:17.821560 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb74e47-1a02-4172-870a-1ec3549bc1fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:17.823145 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb74e47-1a02-4172-870a-1ec3549bc1fd None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:17.836660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 388/782] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Jul 11 11:06:17 2022] GET /identity/v3/services => generated 772 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:17.855675 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d18a7-cbbb-4c78-9b44-fcc696c09247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:17.856495 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d18a7-cbbb-4c78-9b44-fcc696c09247 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:17.856775 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d18a7-cbbb-4c78-9b44-fcc696c09247 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:17.857102 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d18a7-cbbb-4c78-9b44-fcc696c09247 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:17.876853 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d18a7-cbbb-4c78-9b44-fcc696c09247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:06:17.885596 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-454d18a7-cbbb-4c78-9b44-fcc696c09247 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:06:17.885596 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:17.885596 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:17.885596 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:17.885596 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:17.885596 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:17.885596 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:17.885596 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:17.885596 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:17.885596 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:17.885596 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:17.885596 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:17.885596 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:06:17.885596 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:06:17.885596 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:06:17.885596 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:06:17.886617 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:06:17.886617 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:06:17.886617 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:06:17.886617 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:06:17.886617 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:17.886617 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:17.886617 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:17.886617 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:17.886617 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:17.886617 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:17.886617 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:17.886617 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:17.886617 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:17.886617 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:17.886617 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:17.886617 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:17.887473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:17.887473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:17.887473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:17.887473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:17.887473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:06:17.887473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:06:17.887473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:06:17.887473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:06:17.887473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:06:17.887473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:06:17.887473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:06:17.887473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:17.887473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 395/783] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:06:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:17.893185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb74e47-1a02-4172-870a-1ec3549bc1fd None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:17.963477 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df25a06-2510-45de-ad5c-bb74122c05b5 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:17.963821 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df25a06-2510-45de-ad5c-bb74122c05b5 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:17.964121 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df25a06-2510-45de-ad5c-bb74122c05b5 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:17.965812 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 396/784] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:17.971714 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed10cd-ad5b-43e5-a919-1f11b62661ab None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:17.972958 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed10cd-ad5b-43e5-a919-1f11b62661ab None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:17.973242 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed10cd-ad5b-43e5-a919-1f11b62661ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:17.991610 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-4aed10cd-ad5b-43e5-a919-1f11b62661ab None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:17.992826 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-4aed10cd-ad5b-43e5-a919-1f11b62661ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:18.031315 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:18.064833 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb74e47-1a02-4172-870a-1ec3549bc1fd None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:18.085136 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 397/785] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 11:06:18.108225 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed10cd-ad5b-43e5-a919-1f11b62661ab None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:18.111771 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e292d04-8a82-46fa-9265-1885e73edb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:18.113039 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e292d04-8a82-46fa-9265-1885e73edb1a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:18.113444 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e292d04-8a82-46fa-9265-1885e73edb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:18.113725 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e292d04-8a82-46fa-9265-1885e73edb1a None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:18.114615 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e292d04-8a82-46fa-9265-1885e73edb1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:18.114930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e292d04-8a82-46fa-9265-1885e73edb1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:18.116361 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e292d04-8a82-46fa-9265-1885e73edb1a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:18.132842 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 389/786] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:06:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:18.134262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e292d04-8a82-46fa-9265-1885e73edb1a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:18.221138 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:18.235005 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed10cd-ad5b-43e5-a919-1f11b62661ab None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:18.250577 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e292d04-8a82-46fa-9265-1885e73edb1a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:18.272327 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c309667-69b2-4fcb-8029-802df0ff1ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:18.273285 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c309667-69b2-4fcb-8029-802df0ff1ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:18.273617 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c309667-69b2-4fcb-8029-802df0ff1ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:18.273995 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c309667-69b2-4fcb-8029-802df0ff1ac2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:18.285033 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c309667-69b2-4fcb-8029-802df0ff1ac2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:06:18.289044 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:18.297796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-8c309667-69b2-4fcb-8029-802df0ff1ac2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:06:18.297796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:18.297796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:18.297796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:18.297796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:18.297796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:18.297796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:18.297796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:18.297796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:18.297796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:18.297796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:18.297796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:18.297796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:06:18.297796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:06:18.297796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:06:18.297796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:06:18.311443 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:06:18.311443 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:06:18.311443 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:06:18.311443 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:06:18.311443 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:18.311443 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:18.311443 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:18.311443 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:18.311443 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:18.311443 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:18.311443 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:18.311443 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:18.311443 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:18.311443 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:18.311443 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:18.311443 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:18.312285 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:18.312285 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:18.312285 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:18.312285 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:18.312285 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:06:18.312285 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:06:18.312285 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:06:18.312285 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:06:18.312285 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:06:18.312285 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:06:18.312285 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:06:18.312285 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:18.312285 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 398/787] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jul 11 11:06:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:18.312285 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c309667-69b2-4fcb-8029-802df0ff1ac2 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:18.313029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b87e3-657a-4195-8d3f-878ce80dc5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:18.313029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b87e3-657a-4195-8d3f-878ce80dc5bb None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:18.313029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b87e3-657a-4195-8d3f-878ce80dc5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:18.313029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b87e3-657a-4195-8d3f-878ce80dc5bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:18.320667 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b87e3-657a-4195-8d3f-878ce80dc5bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:18.322029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b87e3-657a-4195-8d3f-878ce80dc5bb None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:18.342484 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-5f5b87e3-657a-4195-8d3f-878ce80dc5bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:18.342484 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:18.342484 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:18.342484 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:18.342484 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:18.342484 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:18.342484 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:18.342484 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:18.342484 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:18.342484 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:18.342484 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:18.342484 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:18.342484 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:18.342484 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:18.342484 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:18.344501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:18.344501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:18.344501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:18.344501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:18.344501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:18.344501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:18.344501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:18.344501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:18.344501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:18.344501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:18.344501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:18.344501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:18.344501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:18.344501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:18.344501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:18.344501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:18.344501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:18.346595 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:18.346595 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:18.346595 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:18.346595 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:18.346595 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 390/788] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:18.352256 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b87e3-657a-4195-8d3f-878ce80dc5bb None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:18.453137 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c309667-69b2-4fcb-8029-802df0ff1ac2 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:18.500330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45aafd4-8bce-4f83-b019-705d89be85a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:18.501063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aafd4-8bce-4f83-b019-705d89be85a0 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:18.501353 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aafd4-8bce-4f83-b019-705d89be85a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:18.501628 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aafd4-8bce-4f83-b019-705d89be85a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:18.502450 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45aafd4-8bce-4f83-b019-705d89be85a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:18.502763 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45aafd4-8bce-4f83-b019-705d89be85a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:18.504701 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45aafd4-8bce-4f83-b019-705d89be85a0 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:18.514174 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 399/789] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jul 11 11:06:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:18.519933 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45aafd4-8bce-4f83-b019-705d89be85a0 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:18.554139 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:18.583692 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b87e3-657a-4195-8d3f-878ce80dc5bb None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:18.630535 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911217e-b750-45b9-81b3-7715304d21f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:18.631222 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911217e-b750-45b9-81b3-7715304d21f8 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:18.631559 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911217e-b750-45b9-81b3-7715304d21f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:18.631841 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911217e-b750-45b9-81b3-7715304d21f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:18.632648 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911217e-b750-45b9-81b3-7715304d21f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:18.632871 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911217e-b750-45b9-81b3-7715304d21f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:18.634352 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911217e-b750-45b9-81b3-7715304d21f8 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:18.655650 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 391/790] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:18.661455 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911217e-b750-45b9-81b3-7715304d21f8 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:18.673059 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45aafd4-8bce-4f83-b019-705d89be85a0 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:18.712503 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f45232-ef5e-4a2a-aecb-9636841b84ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:18.714444 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f45232-ef5e-4a2a-aecb-9636841b84ec None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:18.715576 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f45232-ef5e-4a2a-aecb-9636841b84ec None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:18.716210 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f45232-ef5e-4a2a-aecb-9636841b84ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:18.738558 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f45232-ef5e-4a2a-aecb-9636841b84ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:18.740607 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f45232-ef5e-4a2a-aecb-9636841b84ec None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:18.755932 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:18.767157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-f4f45232-ef5e-4a2a-aecb-9636841b84ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:18.767157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:18.767157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:18.767157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:18.767157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:18.767157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:18.767157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:18.767157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:18.767157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:18.767157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:18.767157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:18.767157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:18.767157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:18.767157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:18.767157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:18.768105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:18.768105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:18.768105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:18.768105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:18.768105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:18.768105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:18.768105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:18.768105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:18.768105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:18.768105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:18.768105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:18.768105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:18.768105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:18.768105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:18.768105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:18.768105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:18.768105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:18.769458 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:18.769458 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:18.769458 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:18.769458 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:18.772562 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 400/791] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:18.783311 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f45232-ef5e-4a2a-aecb-9636841b84ec None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:18.881274 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911217e-b750-45b9-81b3-7715304d21f8 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:18.923758 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e9903-b056-48f5-9c67-18736fa566d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:18.925679 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e9903-b056-48f5-9c67-18736fa566d8 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:18.926235 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e9903-b056-48f5-9c67-18736fa566d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:18.926736 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e9903-b056-48f5-9c67-18736fa566d8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:18.943022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e9903-b056-48f5-9c67-18736fa566d8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:18.944753 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e9903-b056-48f5-9c67-18736fa566d8 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:18.947130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:18.971527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-a29e9903-b056-48f5-9c67-18736fa566d8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 11:06:18.971527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:18.971527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:18.971527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:18.971527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:18.971527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:18.971527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:18.971527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:18.971527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:18.971527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:18.971527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:18.971527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:18.971527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:06:18.971527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:06:18.971527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:06:18.971527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:06:18.972851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:18.972851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:18.972851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:06:18.972851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:18.972851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:06:18.972851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:18.972851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:18.972851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:18.972851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:18.972851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:18.972851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:18.972851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:18.972851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:18.972851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:18.972851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:18.972851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:18.972851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:18.972851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:18.974030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:18.974030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:18.974030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:06:18.974030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:06:18.974030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:06:18.974030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:06:18.974030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:06:18.974030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:06:18.974030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 11:06:18.974030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:18.976005 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 392/792] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Jul 11 11:06:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:18.986844 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e9903-b056-48f5-9c67-18736fa566d8 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:19.024244 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f45232-ef5e-4a2a-aecb-9636841b84ec None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:19.091044 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1543d56-64d8-4cba-a3d7-aedad16ee799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:19.092391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1543d56-64d8-4cba-a3d7-aedad16ee799 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:19.093797 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1543d56-64d8-4cba-a3d7-aedad16ee799 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:19.094227 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1543d56-64d8-4cba-a3d7-aedad16ee799 None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:19.095284 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1543d56-64d8-4cba-a3d7-aedad16ee799 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:19.096879 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1543d56-64d8-4cba-a3d7-aedad16ee799 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:19.099101 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1543d56-64d8-4cba-a3d7-aedad16ee799 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:19.120719 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 401/793] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:19.122200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1543d56-64d8-4cba-a3d7-aedad16ee799 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:19.220001 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e9903-b056-48f5-9c67-18736fa566d8 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:19.234110 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:19.236245 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1543d56-64d8-4cba-a3d7-aedad16ee799 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:19.264055 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:19.277578 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f8b76-ab17-4f32-98a7-ffed18fefce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:19.278992 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f8b76-ab17-4f32-98a7-ffed18fefce7 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:19.279471 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f8b76-ab17-4f32-98a7-ffed18fefce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:19.279912 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f8b76-ab17-4f32-98a7-ffed18fefce7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:19.289334 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f8b76-ab17-4f32-98a7-ffed18fefce7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:19.291068 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f8b76-ab17-4f32-98a7-ffed18fefce7 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:19.304123 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5047f-d2bf-4ae5-982c-7cfd3b2a1037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:19.304865 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5047f-d2bf-4ae5-982c-7cfd3b2a1037 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:19.305154 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5047f-d2bf-4ae5-982c-7cfd3b2a1037 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:19.305435 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5047f-d2bf-4ae5-982c-7cfd3b2a1037 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:19.306319 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5047f-d2bf-4ae5-982c-7cfd3b2a1037 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:19.306634 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5047f-d2bf-4ae5-982c-7cfd3b2a1037 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:19.308150 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5047f-d2bf-4ae5-982c-7cfd3b2a1037 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:19.309999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-201f8b76-ab17-4f32-98a7-ffed18fefce7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 11:06:19.309999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:19.309999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:19.309999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:19.309999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:19.309999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:19.309999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:19.309999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:19.309999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:19.309999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:19.309999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:19.309999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:19.309999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:06:19.309999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:06:19.309999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:06:19.309999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:06:19.310891 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:19.310891 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:19.310891 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:06:19.310891 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:19.310891 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:06:19.310891 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:19.310891 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:19.310891 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:19.310891 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:19.310891 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:19.310891 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:19.310891 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:19.310891 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:19.310891 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:19.310891 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:19.310891 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:19.310891 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:19.310891 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:19.311819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:19.311819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:19.311819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:06:19.311819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:06:19.311819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:06:19.311819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:06:19.311819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:06:19.311819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:06:19.311819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 11:06:19.311819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:19.319714 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 402/794] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Jul 11 11:06:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:19.325637 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f8b76-ab17-4f32-98a7-ffed18fefce7 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:19.355703 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 393/795] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Jul 11 11:06:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:19.357651 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5047f-d2bf-4ae5-982c-7cfd3b2a1037 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:19.466076 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f8b76-ab17-4f32-98a7-ffed18fefce7 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:19.535839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7bf98-0e68-4481-aa91-59dfdf73e426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:19.536536 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7bf98-0e68-4481-aa91-59dfdf73e426 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:19.536868 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7bf98-0e68-4481-aa91-59dfdf73e426 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:19.537107 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7bf98-0e68-4481-aa91-59dfdf73e426 None admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:19.537984 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7bf98-0e68-4481-aa91-59dfdf73e426 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:19.538303 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7bf98-0e68-4481-aa91-59dfdf73e426 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:19.539754 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7bf98-0e68-4481-aa91-59dfdf73e426 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:19.575105 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5047f-d2bf-4ae5-982c-7cfd3b2a1037 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:19.583863 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 403/796] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Jul 11 11:06:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:19.585338 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ae8e8-aad0-4217-96b9-ab23ac0b09ec None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:19.585691 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ae8e8-aad0-4217-96b9-ab23ac0b09ec None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:19.586008 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ae8e8-aad0-4217-96b9-ab23ac0b09ec None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:19.587688 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 404/797] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:19.588516 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ae8e8-aad0-4217-96b9-ab23ac0b09ec None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:19.617017 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c78eec-ef70-49fb-a693-a2b6a4215449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:19.617969 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c78eec-ef70-49fb-a693-a2b6a4215449 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:19.618270 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c78eec-ef70-49fb-a693-a2b6a4215449 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:19.618531 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c78eec-ef70-49fb-a693-a2b6a4215449 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:19.639958 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:19.658583 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:19.708379 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ae8e8-aad0-4217-96b9-ab23ac0b09ec None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:19.708577 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c78eec-ef70-49fb-a693-a2b6a4215449 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:19.710194 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c78eec-ef70-49fb-a693-a2b6a4215449 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:19.761088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72176d05-6c6d-4efb-b89b-c675a28adc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:19.762709 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72176d05-6c6d-4efb-b89b-c675a28adc29 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:19.763194 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72176d05-6c6d-4efb-b89b-c675a28adc29 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:19.763653 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72176d05-6c6d-4efb-b89b-c675a28adc29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:19.779537 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72176d05-6c6d-4efb-b89b-c675a28adc29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:19.781587 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72176d05-6c6d-4efb-b89b-c675a28adc29 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:19.807663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-72176d05-6c6d-4efb-b89b-c675a28adc29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:19.807663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:19.807663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:19.807663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:19.807663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:19.807663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:19.807663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:19.807663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:19.807663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:19.807663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:19.807663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:19.807663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:19.807663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:19.807663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:19.807663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:19.808857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:19.808857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:19.808857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:19.808857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:19.808857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:19.808857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:19.808857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:19.808857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:19.808857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:19.808857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:19.808857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:19.808857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:19.808857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:19.808857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:19.808857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:19.808857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:19.808857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:19.809743 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:19.809743 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:19.809743 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:19.809743 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:19.810518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 405/798] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:19.811355 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5e81c-b56f-4ee8-bc11-74aa235f5e7f None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:19.811651 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5e81c-b56f-4ee8-bc11-74aa235f5e7f None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:19.811933 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5e81c-b56f-4ee8-bc11-74aa235f5e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:19.830217 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-f9e5e81c-b56f-4ee8-bc11-74aa235f5e7f None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:19.831810 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-f9e5e81c-b56f-4ee8-bc11-74aa235f5e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:19.838898 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 394/799] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:06:19 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 11:06:19.840334 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a329b6f-09cc-400f-aecb-800a5b752216 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:19.840608 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a329b6f-09cc-400f-aecb-800a5b752216 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:19.840888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a329b6f-09cc-400f-aecb-800a5b752216 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:19.846270 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 395/800] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:19.846270 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a329b6f-09cc-400f-aecb-800a5b752216 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:19.907838 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:19.917381 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 406/801] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:06:19.919735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5e81c-b56f-4ee8-bc11-74aa235f5e7f None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:19.945200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:19.962798 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a329b6f-09cc-400f-aecb-800a5b752216 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:19.998275 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b422bd-01b2-4d2b-89a5-9dd4a536df8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:19.998946 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b422bd-01b2-4d2b-89a5-9dd4a536df8c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:19.999233 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b422bd-01b2-4d2b-89a5-9dd4a536df8c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:19.999513 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b422bd-01b2-4d2b-89a5-9dd4a536df8c None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:20.000246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b422bd-01b2-4d2b-89a5-9dd4a536df8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:20.000554 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b422bd-01b2-4d2b-89a5-9dd4a536df8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:20.001948 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b422bd-01b2-4d2b-89a5-9dd4a536df8c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:20.013814 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 396/802] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:20.015035 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cde9c3-46bf-445f-ad9d-5e1b26236b88 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:20.015327 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cde9c3-46bf-445f-ad9d-5e1b26236b88 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:20.015611 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cde9c3-46bf-445f-ad9d-5e1b26236b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:20.031872 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-52cde9c3-46bf-445f-ad9d-5e1b26236b88 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:20.032088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5e81c-b56f-4ee8-bc11-74aa235f5e7f None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:20.033081 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-52cde9c3-46bf-445f-ad9d-5e1b26236b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:20.069076 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50596692-c49d-4a20-9217-8170b4671333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:20.070130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50596692-c49d-4a20-9217-8170b4671333 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:20.070563 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50596692-c49d-4a20-9217-8170b4671333 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:20.070987 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50596692-c49d-4a20-9217-8170b4671333 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:20.083194 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50596692-c49d-4a20-9217-8170b4671333 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:20.084981 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50596692-c49d-4a20-9217-8170b4671333 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:20.101589 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 397/803] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:06:20.102470 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cde9c3-46bf-445f-ad9d-5e1b26236b88 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:20.104164 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-50596692-c49d-4a20-9217-8170b4671333 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:20.104164 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:20.104164 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:20.104164 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:20.104164 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:20.104164 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:20.104164 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:20.104164 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:20.104164 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:20.104164 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:20.104164 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:20.104164 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:20.104164 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:20.104164 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:20.104164 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:20.105391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:20.105391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:20.105391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:20.105391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:20.105391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:20.105391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:20.105391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:20.105391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:20.105391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:20.105391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:20.105391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:20.105391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:20.105391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:20.105391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:20.105391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:20.105391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:20.105391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:20.106312 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:20.106312 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:20.106312 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:20.106312 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:20.110044 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 407/804] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:20.110873 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50596692-c49d-4a20-9217-8170b4671333 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:20.169299 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:20.199411 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:20.218891 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cde9c3-46bf-445f-ad9d-5e1b26236b88 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:20.222175 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50596692-c49d-4a20-9217-8170b4671333 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:20.255245 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e615336-6faf-4719-9a6c-353ee8a9d0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:20.256310 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e615336-6faf-4719-9a6c-353ee8a9d0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:20.256588 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e615336-6faf-4719-9a6c-353ee8a9d0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:20.256867 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e615336-6faf-4719-9a6c-353ee8a9d0b8 None admin] PATH_INFO: `/v3/services/network` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:20.257575 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e615336-6faf-4719-9a6c-353ee8a9d0b8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:20.258744 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d78e7-d8a8-47b9-96b3-bb32862c78e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:20.258960 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e615336-6faf-4719-9a6c-353ee8a9d0b8 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:20.259547 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d78e7-d8a8-47b9-96b3-bb32862c78e0 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:20.259837 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d78e7-d8a8-47b9-96b3-bb32862c78e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:20.260118 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d78e7-d8a8-47b9-96b3-bb32862c78e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:20.267200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d78e7-d8a8-47b9-96b3-bb32862c78e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:20.268673 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d78e7-d8a8-47b9-96b3-bb32862c78e0 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:20.270922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-4e615336-6faf-4719-9a6c-353ee8a9d0b8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 11:06:20.270922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:20.270922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:06:20.270922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:06:20.270922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:06:20.270922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:06:20.270922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:06:20.270922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:20.270922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 11:06:20.270922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:20.270922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:06:20.270922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:20.270922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:20.270922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:20.270922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:20.270922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:20.270922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:20.271913 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:20.271913 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:20.271913 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:20.271913 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:20.271913 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:20.271913 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:20.271913 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:06:20.271913 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:06:20.271913 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:06:20.271913 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:06:20.271913 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:20.271913 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:20.271913 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:20.271913 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:20.271913 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:20.271913 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:20.272771 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:20.272771 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:20.272771 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:20.272771 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:20.272771 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:20.272771 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:20.272771 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:20.272771 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:20.272771 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:20.272771 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:20.272771 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:06:20.272771 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:20.272771 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 11:06:20.272771 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:20.277223 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 398/805] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:06:20 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:20.278039 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e615336-6faf-4719-9a6c-353ee8a9d0b8 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:20.286661 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-a43d78e7-d8a8-47b9-96b3-bb32862c78e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:20.286661 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:20.286661 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:20.286661 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:20.286661 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:20.286661 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:20.286661 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:20.286661 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:20.286661 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:20.286661 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:20.286661 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:20.286661 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:20.286661 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:06:20.286661 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:06:20.286661 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:06:20.287554 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:06:20.287554 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:20.287554 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:20.287554 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:20.287554 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:20.287554 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:20.287554 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:20.287554 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:20.287554 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:20.287554 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:20.287554 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:20.287554 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:20.287554 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:20.287554 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:20.287554 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:20.287554 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:20.287554 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:20.288449 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:06:20.288449 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:06:20.288449 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:06:20.288449 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:06:20.288449 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:06:20.288449 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:06:20.288449 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:20.288449 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:20.288449 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 408/806] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:06:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:20.289624 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d78e7-d8a8-47b9-96b3-bb32862c78e0 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:20.381052 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e615336-6faf-4719-9a6c-353ee8a9d0b8 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:20.387833 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d78e7-d8a8-47b9-96b3-bb32862c78e0 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:20.398046 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:20.415369 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342e048-ea01-489f-a80b-fae1af43ced6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:20.416030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342e048-ea01-489f-a80b-fae1af43ced6 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:20.416323 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342e048-ea01-489f-a80b-fae1af43ced6 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:20.416598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342e048-ea01-489f-a80b-fae1af43ced6 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:20.417310 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342e048-ea01-489f-a80b-fae1af43ced6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:20.417617 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342e048-ea01-489f-a80b-fae1af43ced6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:20.419150 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342e048-ea01-489f-a80b-fae1af43ced6 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:20.421682 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab2223-f985-48a6-987a-ce5c8df82533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:20.422491 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab2223-f985-48a6-987a-ce5c8df82533 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:20.422802 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab2223-f985-48a6-987a-ce5c8df82533 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:20.423078 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab2223-f985-48a6-987a-ce5c8df82533 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:20.425455 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:20.431438 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 399/807] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:20.432418 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342e048-ea01-489f-a80b-fae1af43ced6 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:20.439631 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab2223-f985-48a6-987a-ce5c8df82533 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:06:20.448340 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-56ab2223-f985-48a6-987a-ce5c8df82533 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:06:20.448340 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:20.448340 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:20.448340 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:20.448340 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:20.448340 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:20.448340 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:20.448340 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:20.448340 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:20.448340 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:20.448340 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:20.448340 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:20.448340 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:06:20.448340 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:06:20.448340 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:06:20.448340 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:06:20.449274 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:06:20.449274 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:06:20.449274 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:06:20.449274 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:06:20.449274 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:20.449274 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:20.449274 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:20.449274 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:20.449274 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:20.449274 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:20.449274 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:20.449274 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:20.449274 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:20.449274 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:20.449274 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:20.449274 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:20.450149 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:20.450149 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:20.450149 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:20.450149 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:20.450149 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:06:20.450149 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:06:20.450149 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:06:20.450149 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:06:20.450149 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:06:20.450149 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:06:20.450149 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:06:20.450149 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:20.450149 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 409/808] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:06:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:20.451498 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab2223-f985-48a6-987a-ce5c8df82533 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:20.537498 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342e048-ea01-489f-a80b-fae1af43ced6 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:20.549726 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab2223-f985-48a6-987a-ce5c8df82533 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:20.572112 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc30e34-207b-43e6-a530-1cffc54c73a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:20.572780 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc30e34-207b-43e6-a530-1cffc54c73a8 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:20.573064 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc30e34-207b-43e6-a530-1cffc54c73a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:20.573349 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc30e34-207b-43e6-a530-1cffc54c73a8 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:20.574087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc30e34-207b-43e6-a530-1cffc54c73a8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:20.574398 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc30e34-207b-43e6-a530-1cffc54c73a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:20.575753 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc30e34-207b-43e6-a530-1cffc54c73a8 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:20.580142 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 400/809] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Jul 11 11:06:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:20.581499 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f11e3-fc17-46b5-bc87-48687b984757 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:20.581942 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f11e3-fc17-46b5-bc87-48687b984757 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:20.582107 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f11e3-fc17-46b5-bc87-48687b984757 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:20.585900 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 401/810] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:20.585900 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f11e3-fc17-46b5-bc87-48687b984757 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:20.586489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720ee46-939f-4d78-95ab-364a91ef5055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:20.587170 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720ee46-939f-4d78-95ab-364a91ef5055 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:20.587457 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720ee46-939f-4d78-95ab-364a91ef5055 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:20.587733 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720ee46-939f-4d78-95ab-364a91ef5055 None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:20.588525 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720ee46-939f-4d78-95ab-364a91ef5055 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:20.588835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720ee46-939f-4d78-95ab-364a91ef5055 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:20.590283 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720ee46-939f-4d78-95ab-364a91ef5055 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:20.602165 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 410/811] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:06:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:20.602953 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720ee46-939f-4d78-95ab-364a91ef5055 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:20.628042 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:20.658223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:20.687589 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f11e3-fc17-46b5-bc87-48687b984757 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:20.702976 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720ee46-939f-4d78-95ab-364a91ef5055 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:20.720550 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a5b3a-df40-4ea3-a77e-5d8e36274c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:20.721335 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a5b3a-df40-4ea3-a77e-5d8e36274c98 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:20.722232 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a5b3a-df40-4ea3-a77e-5d8e36274c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:20.722731 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a5b3a-df40-4ea3-a77e-5d8e36274c98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:20.729256 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a5b3a-df40-4ea3-a77e-5d8e36274c98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:20.730743 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a5b3a-df40-4ea3-a77e-5d8e36274c98 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:20.736469 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1828e6a-0df2-4ae9-94d9-4dd31b5aac63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:20.737130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1828e6a-0df2-4ae9-94d9-4dd31b5aac63 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:20.737988 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1828e6a-0df2-4ae9-94d9-4dd31b5aac63 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:20.738266 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1828e6a-0df2-4ae9-94d9-4dd31b5aac63 None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:20.739012 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1828e6a-0df2-4ae9-94d9-4dd31b5aac63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:20.745072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1828e6a-0df2-4ae9-94d9-4dd31b5aac63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:20.745072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1828e6a-0df2-4ae9-94d9-4dd31b5aac63 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:20.745262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-f12a5b3a-df40-4ea3-a77e-5d8e36274c98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:20.745262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:20.745262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:20.745262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:20.745262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:20.745262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:20.745262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:20.745262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:20.745262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:20.745262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:20.745262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:20.745262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:20.745262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:06:20.745262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:06:20.745262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:06:20.746266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:06:20.746266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:20.746266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:20.746266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:20.746266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:20.746266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:20.746266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:20.746266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:20.746266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:20.746266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:20.746266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:20.746266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:20.746266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:20.746266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:20.746266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:20.746266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:20.746266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:20.747171 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:06:20.747171 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:06:20.747171 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:06:20.747171 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:06:20.747171 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:06:20.747171 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:06:20.747171 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:20.747171 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:20.753256 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 411/812] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:06:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:20.753256 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1828e6a-0df2-4ae9-94d9-4dd31b5aac63 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:20.753482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 402/813] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:06:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:20.753482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cf235-c662-488f-93df-99e51fe0716c None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:20.753482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cf235-c662-488f-93df-99e51fe0716c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:20.753482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cf235-c662-488f-93df-99e51fe0716c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:20.770067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-be1cf235-c662-488f-93df-99e51fe0716c None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:20.771267 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-be1cf235-c662-488f-93df-99e51fe0716c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:20.847873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 403/814] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:06:20.848696 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1cf235-c662-488f-93df-99e51fe0716c None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:20.856141 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1828e6a-0df2-4ae9-94d9-4dd31b5aac63 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:20.872917 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:20.877436 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:20.890271 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254457e-48c7-40b0-a474-dbf686bb5d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:20.891154 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254457e-48c7-40b0-a474-dbf686bb5d17 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:20.891602 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254457e-48c7-40b0-a474-dbf686bb5d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:20.891878 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254457e-48c7-40b0-a474-dbf686bb5d17 None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:20.892663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254457e-48c7-40b0-a474-dbf686bb5d17 None admin] RBAC: Adding query filter params (type=network) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:20.892971 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254457e-48c7-40b0-a474-dbf686bb5d17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:20.894455 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254457e-48c7-40b0-a474-dbf686bb5d17 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:20.899218 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 412/815] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Jul 11 11:06:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:20.899995 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254457e-48c7-40b0-a474-dbf686bb5d17 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:20.947372 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1cf235-c662-488f-93df-99e51fe0716c None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:20.981677 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec9d6a-eca5-4837-acc1-af6e006845b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:20.982610 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec9d6a-eca5-4837-acc1-af6e006845b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:20.982897 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec9d6a-eca5-4837-acc1-af6e006845b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:20.983176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec9d6a-eca5-4837-acc1-af6e006845b9 None admin] PATH_INFO: `/v3/projects/38ed7416526e473b816330e24acf7a04/users/cdfa8f4012c2471b81f8749b013d3117/roles/9b682db1e9a5486884a74f5c01953fe7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:20.997808 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec9d6a-eca5-4837-acc1-af6e006845b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=38ed7416526e473b816330e24acf7a04, user_id=cdfa8f4012c2471b81f8749b013d3117, role_id=9b682db1e9a5486884a74f5c01953fe7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:20.999000 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254457e-48c7-40b0-a474-dbf686bb5d17 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:20.999240 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec9d6a-eca5-4837-acc1-af6e006845b9 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:21.031151 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de2534-f3da-4fad-bef6-fdfecfb2c4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:21.031797 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de2534-f3da-4fad-bef6-fdfecfb2c4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:21.032082 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de2534-f3da-4fad-bef6-fdfecfb2c4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:21.032361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de2534-f3da-4fad-bef6-fdfecfb2c4b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:21.033140 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de2534-f3da-4fad-bef6-fdfecfb2c4b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:21.033448 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de2534-f3da-4fad-bef6-fdfecfb2c4b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:21.035518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de2534-f3da-4fad-bef6-fdfecfb2c4b5 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:21.047013 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 413/816] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:06:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:21.047775 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de2534-f3da-4fad-bef6-fdfecfb2c4b5 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:21.088085 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:21.125179 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 404/817] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jul 11 11:06:20 2022] PUT /identity/v3/projects/38ed7416526e473b816330e24acf7a04/users/cdfa8f4012c2471b81f8749b013d3117/roles/9b682db1e9a5486884a74f5c01953fe7 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:06:21.126143 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec9d6a-eca5-4837-acc1-af6e006845b9 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:21.151423 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de2534-f3da-4fad-bef6-fdfecfb2c4b5 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:21.190179 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fda868-260d-403b-b32b-64a845044731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:21.191268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fda868-260d-403b-b32b-64a845044731 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:21.191567 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fda868-260d-403b-b32b-64a845044731 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:21.191850 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fda868-260d-403b-b32b-64a845044731 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:21.203407 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fda868-260d-403b-b32b-64a845044731 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:21.204809 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fda868-260d-403b-b32b-64a845044731 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:21.221157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:21.225542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-77fda868-260d-403b-b32b-64a845044731 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:21.225542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:21.225542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:21.225542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:21.225542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:21.225542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:21.225542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:21.225542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:21.225542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:21.225542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:21.225542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:21.225542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:21.225542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:21.225542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:21.225542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:21.226727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:21.226727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:21.226727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:21.226727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:21.226727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:21.226727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:21.226727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:21.226727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:21.226727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:21.226727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:21.226727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:21.226727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:21.226727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:21.226727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:21.226727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:21.226727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:21.226727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:21.227903 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:21.227903 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:21.227903 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:21.227903 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:21.227903 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 414/818] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:21.228251 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fda868-260d-403b-b32b-64a845044731 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:21.247373 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec9d6a-eca5-4837-acc1-af6e006845b9 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:21.289731 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c43cb-cdf7-4e2f-837b-be908e3a2bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:21.290585 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c43cb-cdf7-4e2f-837b-be908e3a2bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:21.290868 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c43cb-cdf7-4e2f-837b-be908e3a2bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:21.291146 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c43cb-cdf7-4e2f-837b-be908e3a2bb8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:21.291796 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c43cb-cdf7-4e2f-837b-be908e3a2bb8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:21.293157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c43cb-cdf7-4e2f-837b-be908e3a2bb8 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:21.306073 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-518c43cb-cdf7-4e2f-837b-be908e3a2bb8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 11:06:21.306073 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:21.306073 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:06:21.306073 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:06:21.306073 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:06:21.306073 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:06:21.306073 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:06:21.306073 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:21.306073 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 11:06:21.306073 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:21.306073 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:06:21.306073 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:21.306073 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:21.306073 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:21.306073 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:21.306073 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:21.307049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:21.307049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:21.307049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:21.307049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:21.307049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:21.307049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:21.307049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:21.307049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:06:21.307049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:06:21.307049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:06:21.307049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:06:21.307049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:21.307049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:21.307049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:21.307049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:21.307049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:21.307877 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:21.307877 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:21.307877 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:21.307877 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:21.307877 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:21.307877 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:21.307877 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:21.307877 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:21.307877 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:21.307877 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:21.307877 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:21.307877 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:06:21.307877 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:21.307877 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 11:06:21.307877 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:21.307877 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 405/819] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Jul 11 11:06:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:21.309064 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c43cb-cdf7-4e2f-837b-be908e3a2bb8 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:21.335163 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:21.344526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fda868-260d-403b-b32b-64a845044731 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:21.381293 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6a574-2d7b-41f7-aa91-7033d9934348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:21.382086 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6a574-2d7b-41f7-aa91-7033d9934348 None admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:21.382379 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6a574-2d7b-41f7-aa91-7033d9934348 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:21.383074 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6a574-2d7b-41f7-aa91-7033d9934348 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:21.383393 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6a574-2d7b-41f7-aa91-7033d9934348 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:21.384772 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6a574-2d7b-41f7-aa91-7033d9934348 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:21.417082 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c43cb-cdf7-4e2f-837b-be908e3a2bb8 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:21.451807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c6c4d-0157-413c-99c6-ded847293c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:21.452466 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c6c4d-0157-413c-99c6-ded847293c29 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:21.452755 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c6c4d-0157-413c-99c6-ded847293c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:21.453033 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c6c4d-0157-413c-99c6-ded847293c29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:21.453941 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c6c4d-0157-413c-99c6-ded847293c29 None admin] RBAC: Adding query filter params (role.id=736e70deba004b9289c2fed43eb107f7, scope.project.id=38ed7416526e473b816330e24acf7a04, user.id=5b9e7594afc346e593ef3e6c579e237b) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:21.454213 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c6c4d-0157-413c-99c6-ded847293c29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:21.455662 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c6c4d-0157-413c-99c6-ded847293c29 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:21.461584 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 406/820] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:06:21 2022] GET /identity/v3/role_assignments?user.id=5b9e7594afc346e593ef3e6c579e237b&scope.project.id=38ed7416526e473b816330e24acf7a04&role.id=736e70deba004b9289c2fed43eb107f7 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:21.462404 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c6c4d-0157-413c-99c6-ded847293c29 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:21.482754 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:21.508038 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 415/821] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Jul 11 11:06:21 2022] POST /identity/v3/endpoints => generated 327 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:06:21.508038 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6a574-2d7b-41f7-aa91-7033d9934348 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:21.688896 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c6c4d-0157-413c-99c6-ded847293c29 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:21.692319 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6a574-2d7b-41f7-aa91-7033d9934348 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:21.733232 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbc06d-8482-4dce-946d-7251bd780cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:21.733854 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbc06d-8482-4dce-946d-7251bd780cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:21.734144 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbc06d-8482-4dce-946d-7251bd780cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:21.734423 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbc06d-8482-4dce-946d-7251bd780cd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:21.735151 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbc06d-8482-4dce-946d-7251bd780cd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:21.735460 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbc06d-8482-4dce-946d-7251bd780cd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:21.736840 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbc06d-8482-4dce-946d-7251bd780cd9 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:21.736949 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9663c9-cd3d-4a69-8b30-7ae60e008d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:21.737747 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9663c9-cd3d-4a69-8b30-7ae60e008d62 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:21.738269 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9663c9-cd3d-4a69-8b30-7ae60e008d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:21.738556 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9663c9-cd3d-4a69-8b30-7ae60e008d62 None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:21.739276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9663c9-cd3d-4a69-8b30-7ae60e008d62 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:21.739595 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9663c9-cd3d-4a69-8b30-7ae60e008d62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:21.741007 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9663c9-cd3d-4a69-8b30-7ae60e008d62 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:21.747586 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 416/822] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Jul 11 11:06:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:21.752734 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 407/823] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:21.755932 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9663c9-cd3d-4a69-8b30-7ae60e008d62 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:21.759182 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbc06d-8482-4dce-946d-7251bd780cd9 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:21.773876 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:21.864554 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:21.903167 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9663c9-cd3d-4a69-8b30-7ae60e008d62 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:21.916424 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbc06d-8482-4dce-946d-7251bd780cd9 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:21.952330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e1108-de96-4222-8634-200a52e43aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:21.953006 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e1108-de96-4222-8634-200a52e43aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:21.953297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e1108-de96-4222-8634-200a52e43aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:21.953579 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e1108-de96-4222-8634-200a52e43aa4 None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:21.954532 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e1108-de96-4222-8634-200a52e43aa4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:21.954849 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e1108-de96-4222-8634-200a52e43aa4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:21.955303 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8c9f2-e71c-4252-8611-a09d6e2be8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:21.956141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8c9f2-e71c-4252-8611-a09d6e2be8ce None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:21.956321 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e1108-de96-4222-8634-200a52e43aa4 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:21.956416 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8c9f2-e71c-4252-8611-a09d6e2be8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:21.956698 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8c9f2-e71c-4252-8611-a09d6e2be8ce None admin] PATH_INFO: `/v3/users/swift` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:21.962921 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 417/824] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Jul 11 11:06:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:21.966982 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8c9f2-e71c-4252-8611-a09d6e2be8ce None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:21.968259 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e1108-de96-4222-8634-200a52e43aa4 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:21.968445 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8c9f2-e71c-4252-8611-a09d6e2be8ce None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:21.983683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-10f8c9f2-e71c-4252-8611-a09d6e2be8ce None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 11:06:21.983683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:21.983683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:21.983683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:21.983683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:21.983683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:21.983683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:21.983683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:21.983683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:21.983683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:21.983683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:21.983683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:21.983683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:06:21.983683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:06:21.983683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:06:21.983683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:06:21.984660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:21.984660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:21.984660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:06:21.984660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:21.984660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:06:21.984660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:21.984660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:21.984660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:21.984660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:21.984660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:21.984660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:21.984660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:21.984660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:21.984660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:21.984660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:21.984660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:21.984660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:21.984660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:21.986248 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:21.986248 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:21.986248 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:06:21.986248 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:06:21.986248 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:06:21.986248 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:06:21.986248 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:06:21.986248 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:06:21.986248 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 11:06:21.986248 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:21.986248 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 408/825] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:06:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:21.991820 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8c9f2-e71c-4252-8611-a09d6e2be8ce None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:22.048729 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:22.081805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e1108-de96-4222-8634-200a52e43aa4 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:22.119386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535181a-7a93-4506-a7a9-b037a8f95f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:22.120285 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535181a-7a93-4506-a7a9-b037a8f95f99 None admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:22.120406 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8c9f2-e71c-4252-8611-a09d6e2be8ce None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:22.120816 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535181a-7a93-4506-a7a9-b037a8f95f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:22.121235 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535181a-7a93-4506-a7a9-b037a8f95f99 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:22.122474 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535181a-7a93-4506-a7a9-b037a8f95f99 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:22.124794 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535181a-7a93-4506-a7a9-b037a8f95f99 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:22.149242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:22.157114 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086bc98-7dc7-4b19-845c-9f2944daa9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:22.158858 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086bc98-7dc7-4b19-845c-9f2944daa9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:22.159507 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086bc98-7dc7-4b19-845c-9f2944daa9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:22.159934 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086bc98-7dc7-4b19-845c-9f2944daa9a0 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:22.160876 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086bc98-7dc7-4b19-845c-9f2944daa9a0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:22.161195 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086bc98-7dc7-4b19-845c-9f2944daa9a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:22.162654 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086bc98-7dc7-4b19-845c-9f2944daa9a0 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:22.180743 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 409/826] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Jul 11 11:06:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:22.186319 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086bc98-7dc7-4b19-845c-9f2944daa9a0 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:22.204208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 418/827] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Jul 11 11:06:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:06:22.310343 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086bc98-7dc7-4b19-845c-9f2944daa9a0 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:22.367127 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfd460-af57-4a08-94e8-c8ff9ec8f33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:22.367974 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfd460-af57-4a08-94e8-c8ff9ec8f33c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:22.368264 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfd460-af57-4a08-94e8-c8ff9ec8f33c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:22.368544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfd460-af57-4a08-94e8-c8ff9ec8f33c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:22.380400 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfd460-af57-4a08-94e8-c8ff9ec8f33c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:22.381873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfd460-af57-4a08-94e8-c8ff9ec8f33c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:22.400365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-bdcfd460-af57-4a08-94e8-c8ff9ec8f33c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:22.400365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:22.400365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:22.400365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:22.400365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:22.400365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:22.400365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:22.400365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:22.400365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:22.400365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:22.400365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:22.400365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:22.400365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:22.400365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:22.400365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:22.401316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:22.401316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:22.401316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:22.401316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:22.401316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:22.401316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:22.401316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:22.401316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:22.401316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:22.401316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:22.401316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:22.401316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:22.401316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:22.401316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:22.401316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:22.401316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:22.401316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:22.402329 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:22.402329 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:22.402329 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:22.402329 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:22.402329 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 410/828] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:22.408698 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535181a-7a93-4506-a7a9-b037a8f95f99 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:22.527861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535181a-7a93-4506-a7a9-b037a8f95f99 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:22.561076 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:22.569554 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b78557-53f0-438d-823a-c4b0bc3711ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:22.570309 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b78557-53f0-438d-823a-c4b0bc3711ad None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:22.570599 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b78557-53f0-438d-823a-c4b0bc3711ad None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:22.570881 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b78557-53f0-438d-823a-c4b0bc3711ad None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:22.576935 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b78557-53f0-438d-823a-c4b0bc3711ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:22.576935 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b78557-53f0-438d-823a-c4b0bc3711ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:22.576935 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b78557-53f0-438d-823a-c4b0bc3711ad None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:22.585601 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 419/829] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:22.591277 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfd460-af57-4a08-94e8-c8ff9ec8f33c None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:22.630868 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:22.700946 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfd460-af57-4a08-94e8-c8ff9ec8f33c None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:22.737995 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d11c8-baeb-438f-96e1-8f23bdf64201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:22.739189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d11c8-baeb-438f-96e1-8f23bdf64201 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:22.739628 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d11c8-baeb-438f-96e1-8f23bdf64201 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:22.740083 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d11c8-baeb-438f-96e1-8f23bdf64201 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:22.750581 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d11c8-baeb-438f-96e1-8f23bdf64201 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:22.752078 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d11c8-baeb-438f-96e1-8f23bdf64201 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:22.775607 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-7a5d11c8-baeb-438f-96e1-8f23bdf64201 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:22.775607 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:22.775607 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:22.775607 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:22.775607 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:22.775607 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:22.775607 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:22.775607 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:22.775607 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:22.775607 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:22.775607 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:22.775607 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:22.775607 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:06:22.775607 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:06:22.775607 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:06:22.776765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:06:22.776765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:22.776765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:22.776765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:22.776765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:22.776765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:22.776765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:22.776765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:22.776765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:22.776765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:22.776765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:22.776765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:22.776765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:22.776765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:22.776765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:22.776765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:22.776765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:22.777922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:06:22.777922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:06:22.777922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:06:22.777922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:06:22.777922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:06:22.777922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:06:22.777922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:22.777922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:22.777922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 411/830] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:06:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:22.784496 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b78557-53f0-438d-823a-c4b0bc3711ad None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:22.893124 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b78557-53f0-438d-823a-c4b0bc3711ad None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:22.929735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b2e65-222d-42d2-8f20-6b7d07657e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:22.930792 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b2e65-222d-42d2-8f20-6b7d07657e3c None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:22.931282 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b2e65-222d-42d2-8f20-6b7d07657e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:22.931791 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b2e65-222d-42d2-8f20-6b7d07657e3c None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:22.932789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b2e65-222d-42d2-8f20-6b7d07657e3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:22.933581 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b2e65-222d-42d2-8f20-6b7d07657e3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:22.935244 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b2e65-222d-42d2-8f20-6b7d07657e3c None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:22.948231 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 420/831] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:06:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:22.954340 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d11c8-baeb-438f-96e1-8f23bdf64201 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:23.053055 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:23.060058 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d11c8-baeb-438f-96e1-8f23bdf64201 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:23.214371 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95a94a-7110-4d74-a898-c655ef3d9a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:23.215189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95a94a-7110-4d74-a898-c655ef3d9a1b None admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:23.215474 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95a94a-7110-4d74-a898-c655ef3d9a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:23.215752 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95a94a-7110-4d74-a898-c655ef3d9a1b None admin] PATH_INFO: `/v3/projects/38ed7416526e473b816330e24acf7a04/users/736f6d4d1dbb47ff98bc67e53614d49c/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:23.217719 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95a94a-7110-4d74-a898-c655ef3d9a1b None admin] RBAC: Authorizing `identity:create_grant(project_id=38ed7416526e473b816330e24acf7a04, user_id=736f6d4d1dbb47ff98bc67e53614d49c, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:23.219183 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95a94a-7110-4d74-a898-c655ef3d9a1b None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:23.289188 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 412/832] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jul 11 11:06:22 2022] PUT /identity/v3/projects/38ed7416526e473b816330e24acf7a04/users/736f6d4d1dbb47ff98bc67e53614d49c/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:06:23.341461 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1922544-3248-46fc-82fc-4ad3a9bbb2bd None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:23.342041 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1922544-3248-46fc-82fc-4ad3a9bbb2bd None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:23.342041 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1922544-3248-46fc-82fc-4ad3a9bbb2bd None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:23.343759 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 421/833] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:23.349552 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0abd5c-8608-4f82-a3cb-53d0381f7bd3 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:23.349893 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0abd5c-8608-4f82-a3cb-53d0381f7bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:23.350151 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0abd5c-8608-4f82-a3cb-53d0381f7bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:23.371516 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-3d0abd5c-8608-4f82-a3cb-53d0381f7bd3 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:23.373251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3d0abd5c-8608-4f82-a3cb-53d0381f7bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:23.455135 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 413/834] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:06:23.478731 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1922544-3248-46fc-82fc-4ad3a9bbb2bd None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:23.531398 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:23.586749 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1922544-3248-46fc-82fc-4ad3a9bbb2bd None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:23.621549 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b98be-cd32-4569-aad2-a9b9e3a68ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:23.622374 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b98be-cd32-4569-aad2-a9b9e3a68ddc None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:23.622661 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b98be-cd32-4569-aad2-a9b9e3a68ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:23.622934 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b98be-cd32-4569-aad2-a9b9e3a68ddc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:23.633618 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b98be-cd32-4569-aad2-a9b9e3a68ddc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:06:23.641259 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-677b98be-cd32-4569-aad2-a9b9e3a68ddc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:06:23.641259 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:23.641259 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:23.641259 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:23.641259 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:23.641259 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:23.641259 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:23.641259 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:23.641259 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:23.641259 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:23.641259 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:23.641259 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:23.641259 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:06:23.641259 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:06:23.641259 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:06:23.641259 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:06:23.642212 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:06:23.642212 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:06:23.642212 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:06:23.642212 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:06:23.642212 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:23.642212 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:23.642212 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:23.642212 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:23.642212 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:23.642212 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:23.642212 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:23.642212 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:23.642212 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:23.642212 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:23.642212 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:23.642212 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:23.643051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:23.643051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:23.643051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:23.643051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:23.643051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:06:23.643051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:06:23.643051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:06:23.643051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:06:23.643051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:06:23.643051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:06:23.643051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:06:23.643051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:23.643051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 422/835] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jul 11 11:06:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:23.649240 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0abd5c-8608-4f82-a3cb-53d0381f7bd3 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:23.739468 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:23.756100 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0abd5c-8608-4f82-a3cb-53d0381f7bd3 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:23.757709 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716aef4f-bc58-493a-bfe6-64bc9a860266 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:23.758155 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716aef4f-bc58-493a-bfe6-64bc9a860266 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:23.758441 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716aef4f-bc58-493a-bfe6-64bc9a860266 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:23.760068 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 423/836] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:23.765587 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe98766-5342-4f5c-bc5c-80819cf1adf4 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:23.765917 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe98766-5342-4f5c-bc5c-80819cf1adf4 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:23.766197 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe98766-5342-4f5c-bc5c-80819cf1adf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:23.785714 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-afe98766-5342-4f5c-bc5c-80819cf1adf4 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:23.786933 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-afe98766-5342-4f5c-bc5c-80819cf1adf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:23.803602 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78731b34-22e9-4dd4-bae7-b0e7ee20b412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:23.804283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78731b34-22e9-4dd4-bae7-b0e7ee20b412 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:23.804567 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78731b34-22e9-4dd4-bae7-b0e7ee20b412 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:23.804846 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78731b34-22e9-4dd4-bae7-b0e7ee20b412 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:23.805718 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78731b34-22e9-4dd4-bae7-b0e7ee20b412 None admin] RBAC: Adding query filter params (name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:23.806166 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78731b34-22e9-4dd4-bae7-b0e7ee20b412 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:23.807534 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78731b34-22e9-4dd4-bae7-b0e7ee20b412 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:23.818358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 414/837] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jul 11 11:06:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:23.823562 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78731b34-22e9-4dd4-bae7-b0e7ee20b412 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:23.873705 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 424/838] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 11:06:23.895706 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe98766-5342-4f5c-bc5c-80819cf1adf4 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:23.936510 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:23.947569 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78731b34-22e9-4dd4-bae7-b0e7ee20b412 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:23.984728 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd6078-1267-4b6c-8239-4b31b2e3e936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:23.985540 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd6078-1267-4b6c-8239-4b31b2e3e936 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:23.985865 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd6078-1267-4b6c-8239-4b31b2e3e936 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:23.986145 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd6078-1267-4b6c-8239-4b31b2e3e936 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:23.998239 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd6078-1267-4b6c-8239-4b31b2e3e936 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:23.999666 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd6078-1267-4b6c-8239-4b31b2e3e936 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:24.000506 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe98766-5342-4f5c-bc5c-80819cf1adf4 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:24.007468 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:24.020123 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-50cd6078-1267-4b6c-8239-4b31b2e3e936 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:24.020123 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:24.020123 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:24.020123 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:24.020123 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:24.020123 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:24.020123 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:24.020123 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:24.020123 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:24.020123 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:24.020123 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:24.020123 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:24.020123 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:24.020123 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:24.020123 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:24.021080 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:24.021080 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:24.021080 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:24.021080 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:24.021080 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:24.021080 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:24.021080 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:24.021080 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:24.021080 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:24.021080 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:24.021080 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:24.021080 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:24.021080 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:24.021080 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:24.021080 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:24.021080 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:24.021080 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:24.022013 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:24.022013 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:24.022013 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:24.022013 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:24.024205 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 415/839] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:24.029490 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd6078-1267-4b6c-8239-4b31b2e3e936 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:24.046890 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b80b6b-6d4c-4e7e-b306-06b791969f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:24.047716 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b80b6b-6d4c-4e7e-b306-06b791969f24 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:24.048001 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b80b6b-6d4c-4e7e-b306-06b791969f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:24.048278 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b80b6b-6d4c-4e7e-b306-06b791969f24 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:24.048928 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b80b6b-6d4c-4e7e-b306-06b791969f24 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:24.050513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b80b6b-6d4c-4e7e-b306-06b791969f24 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:24.068945 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-94b80b6b-6d4c-4e7e-b306-06b791969f24 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 11:06:24.068945 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:24.068945 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:06:24.068945 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:06:24.068945 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:06:24.068945 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:06:24.068945 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:06:24.068945 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:24.068945 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 11:06:24.068945 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:24.068945 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:06:24.068945 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:24.068945 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:24.068945 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:24.068945 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:24.068945 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:24.069983 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:24.069983 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:24.069983 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:24.069983 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:24.069983 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:24.069983 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:24.069983 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:24.069983 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:06:24.069983 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:06:24.069983 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:06:24.069983 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:06:24.069983 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:24.069983 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:24.069983 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:24.069983 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:24.069983 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:24.070827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:24.070827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:24.070827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:24.070827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:24.070827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:24.070827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:24.070827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:24.070827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:24.070827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:24.070827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:24.070827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:24.070827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:06:24.070827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:24.070827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 11:06:24.070827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:24.073956 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 425/840] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Jul 11 11:06:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:24.079430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b80b6b-6d4c-4e7e-b306-06b791969f24 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:24.159664 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd6078-1267-4b6c-8239-4b31b2e3e936 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:24.182705 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b80b6b-6d4c-4e7e-b306-06b791969f24 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:24.184589 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:24.198393 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97cbe9-2e05-4c78-91bf-6f35cfdb125a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:24.199275 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97cbe9-2e05-4c78-91bf-6f35cfdb125a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:24.199708 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97cbe9-2e05-4c78-91bf-6f35cfdb125a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:24.203407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97cbe9-2e05-4c78-91bf-6f35cfdb125a None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:24.203407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97cbe9-2e05-4c78-91bf-6f35cfdb125a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:24.203407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97cbe9-2e05-4c78-91bf-6f35cfdb125a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:24.203407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97cbe9-2e05-4c78-91bf-6f35cfdb125a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:24.216160 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 416/841] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:24.220248 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2347686-eb07-48a0-9bef-6d20e6ef2acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:24.221144 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2347686-eb07-48a0-9bef-6d20e6ef2acf None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:24.221776 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97cbe9-2e05-4c78-91bf-6f35cfdb125a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:24.222650 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2347686-eb07-48a0-9bef-6d20e6ef2acf None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:24.223639 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2347686-eb07-48a0-9bef-6d20e6ef2acf None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:24.225268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2347686-eb07-48a0-9bef-6d20e6ef2acf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:24.225786 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2347686-eb07-48a0-9bef-6d20e6ef2acf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:24.228384 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2347686-eb07-48a0-9bef-6d20e6ef2acf None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:24.234998 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 426/842] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Jul 11 11:06:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:24.240755 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2347686-eb07-48a0-9bef-6d20e6ef2acf None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:24.291901 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:24.340139 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97cbe9-2e05-4c78-91bf-6f35cfdb125a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:24.344377 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2347686-eb07-48a0-9bef-6d20e6ef2acf None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:24.378720 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5c5ba-be01-40cb-a78f-0375b6d689ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:24.379789 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5c5ba-be01-40cb-a78f-0375b6d689ad None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:24.380259 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5c5ba-be01-40cb-a78f-0375b6d689ad None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:24.380541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5c5ba-be01-40cb-a78f-0375b6d689ad None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:24.382146 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143cac76-f11c-46d1-8e50-865e6cb95cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:24.382810 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143cac76-f11c-46d1-8e50-865e6cb95cee None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:24.383094 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143cac76-f11c-46d1-8e50-865e6cb95cee None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:24.383368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143cac76-f11c-46d1-8e50-865e6cb95cee None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:24.384071 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143cac76-f11c-46d1-8e50-865e6cb95cee None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:24.384373 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143cac76-f11c-46d1-8e50-865e6cb95cee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:24.385731 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143cac76-f11c-46d1-8e50-865e6cb95cee None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:24.388567 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5c5ba-be01-40cb-a78f-0375b6d689ad None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:24.390036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5c5ba-be01-40cb-a78f-0375b6d689ad None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:24.397792 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 427/843] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Jul 11 11:06:24 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:24.397792 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5e989-a58d-4765-b83a-437f6cfdf27b None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:24.397792 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5e989-a58d-4765-b83a-437f6cfdf27b None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:24.397792 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5e989-a58d-4765-b83a-437f6cfdf27b None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:24.397792 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 428/844] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:24.401632 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066f46d-38dd-4fa5-887d-8857be4fd568 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:24.401956 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066f46d-38dd-4fa5-887d-8857be4fd568 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:24.402239 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066f46d-38dd-4fa5-887d-8857be4fd568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:24.406242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-f6b5c5ba-be01-40cb-a78f-0375b6d689ad None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 11:06:24.406242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:24.406242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:24.406242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:24.406242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:24.406242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:24.406242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:24.406242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:24.406242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:24.406242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:24.406242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:24.406242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:24.406242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:06:24.406242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:06:24.406242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:06:24.406242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:06:24.407238 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:24.407238 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:24.407238 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:06:24.407238 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:24.407238 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:06:24.407238 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:24.407238 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:24.407238 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:24.407238 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:24.407238 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:24.407238 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:24.407238 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:24.407238 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:24.407238 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:24.407238 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:24.407238 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:24.407238 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:24.407238 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:24.408174 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:24.408174 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:24.408174 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:06:24.408174 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:06:24.408174 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:06:24.408174 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:06:24.408174 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:06:24.408174 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:06:24.408174 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 11:06:24.408174 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:24.408174 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 417/845] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Jul 11 11:06:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:24.413496 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5c5ba-be01-40cb-a78f-0375b6d689ad None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:24.430879 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-4066f46d-38dd-4fa5-887d-8857be4fd568 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:24.432195 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-4066f46d-38dd-4fa5-887d-8857be4fd568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:24.468067 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:24.527194 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 429/846] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 11:06:24.538726 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5c5ba-be01-40cb-a78f-0375b6d689ad None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:24.549744 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066f46d-38dd-4fa5-887d-8857be4fd568 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:24.563483 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:24.587842 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe93d4-6271-4f94-9796-6662f6ce4649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:24.588859 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe93d4-6271-4f94-9796-6662f6ce4649 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:24.589381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe93d4-6271-4f94-9796-6662f6ce4649 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:24.589952 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe93d4-6271-4f94-9796-6662f6ce4649 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:24.590998 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe93d4-6271-4f94-9796-6662f6ce4649 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:24.591510 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe93d4-6271-4f94-9796-6662f6ce4649 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:24.593140 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe93d4-6271-4f94-9796-6662f6ce4649 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:24.614099 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 418/847] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Jul 11 11:06:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:24.622991 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe93d4-6271-4f94-9796-6662f6ce4649 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:24.669982 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066f46d-38dd-4fa5-887d-8857be4fd568 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:24.708345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bfc8b7-ce1e-427f-aac6-68ca6d68d38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:24.709243 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfc8b7-ce1e-427f-aac6-68ca6d68d38e None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:24.709617 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfc8b7-ce1e-427f-aac6-68ca6d68d38e None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:24.709991 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfc8b7-ce1e-427f-aac6-68ca6d68d38e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:24.710986 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bfc8b7-ce1e-427f-aac6-68ca6d68d38e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:24.712516 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bfc8b7-ce1e-427f-aac6-68ca6d68d38e None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:24.726123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-56bfc8b7-ce1e-427f-aac6-68ca6d68d38e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 11:06:24.726123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:24.726123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:06:24.726123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:06:24.726123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:06:24.726123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:06:24.726123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:06:24.726123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:24.726123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 11:06:24.726123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:24.726123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:06:24.726123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:24.726123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:24.726123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:24.726123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:24.726123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:24.726123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:24.727159 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:24.727159 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:24.727159 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:24.727159 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:24.727159 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:24.727159 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:24.727159 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:06:24.727159 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:06:24.727159 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:06:24.727159 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:06:24.727159 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:24.727159 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:24.727159 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:24.727159 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:24.727159 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:24.727159 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:24.728012 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:24.728012 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:24.728012 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:24.728012 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:24.728012 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:24.728012 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:24.728012 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:24.728012 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:24.728012 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:24.728012 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:24.728012 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:06:24.728012 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:24.728012 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 11:06:24.728012 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:24.732425 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 430/848] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jul 11 11:06:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:24.733809 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bfc8b7-ce1e-427f-aac6-68ca6d68d38e None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:24.750422 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe93d4-6271-4f94-9796-6662f6ce4649 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:24.768256 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:24.801129 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce0c93-cc91-43a2-97c5-ea79ac929f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:24.801726 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce0c93-cc91-43a2-97c5-ea79ac929f6c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:24.802079 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce0c93-cc91-43a2-97c5-ea79ac929f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:24.802362 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce0c93-cc91-43a2-97c5-ea79ac929f6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:24.860936 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:24.872256 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bfc8b7-ce1e-427f-aac6-68ca6d68d38e None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:24.890059 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce0c93-cc91-43a2-97c5-ea79ac929f6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:24.891654 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce0c93-cc91-43a2-97c5-ea79ac929f6c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:24.918491 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5e140-067b-4c47-ae2f-70f3a4c9e25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:24.920143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5e140-067b-4c47-ae2f-70f3a4c9e25d None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:24.920638 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5e140-067b-4c47-ae2f-70f3a4c9e25d None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:24.921339 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5e140-067b-4c47-ae2f-70f3a4c9e25d None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:24.922502 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5e140-067b-4c47-ae2f-70f3a4c9e25d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:24.923399 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5e140-067b-4c47-ae2f-70f3a4c9e25d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:24.926169 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5e140-067b-4c47-ae2f-70f3a4c9e25d None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:24.933622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 431/849] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jul 11 11:06:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:24.942106 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5e140-067b-4c47-ae2f-70f3a4c9e25d None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:25.015011 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 419/850] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:06:24 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 11:06:25.016598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce0c93-cc91-43a2-97c5-ea79ac929f6c None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:25.047499 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:25.061224 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5e140-067b-4c47-ae2f-70f3a4c9e25d None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:25.098957 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ebd1b-fe29-4fc5-9a37-deca2533782f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:25.099771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ebd1b-fe29-4fc5-9a37-deca2533782f None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:25.100156 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ebd1b-fe29-4fc5-9a37-deca2533782f None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:25.100530 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ebd1b-fe29-4fc5-9a37-deca2533782f None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:25.101384 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ebd1b-fe29-4fc5-9a37-deca2533782f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:25.101898 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ebd1b-fe29-4fc5-9a37-deca2533782f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:25.103349 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ebd1b-fe29-4fc5-9a37-deca2533782f None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:25.104106 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:25.109516 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 432/851] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jul 11 11:06:24 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:25.131899 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce0c93-cc91-43a2-97c5-ea79ac929f6c None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:25.172304 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3ab98-a692-4928-8909-36d26bb92904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:25.173129 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3ab98-a692-4928-8909-36d26bb92904 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:25.173419 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3ab98-a692-4928-8909-36d26bb92904 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:25.173702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3ab98-a692-4928-8909-36d26bb92904 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:25.186750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3ab98-a692-4928-8909-36d26bb92904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:25.188286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3ab98-a692-4928-8909-36d26bb92904 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:25.208930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-0da3ab98-a692-4928-8909-36d26bb92904 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:25.208930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:25.208930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:25.208930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:25.208930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:25.208930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:25.208930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:25.208930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:25.208930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:25.208930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:25.208930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:25.208930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:25.208930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:25.208930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:25.208930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:25.209994 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:25.209994 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:25.209994 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:25.209994 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:25.209994 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:25.209994 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:25.209994 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:25.209994 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:25.209994 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:25.209994 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:25.209994 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:25.209994 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:25.209994 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:25.209994 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:25.209994 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:25.209994 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:25.209994 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:25.210886 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:25.210886 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:25.210886 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:25.210886 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:25.210886 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 420/852] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:25.216310 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ebd1b-fe29-4fc5-9a37-deca2533782f None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:25.330362 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ebd1b-fe29-4fc5-9a37-deca2533782f None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:25.368243 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9c118-6d39-4f5f-9e0e-a64d08cde2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:25.369003 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9c118-6d39-4f5f-9e0e-a64d08cde2be None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:25.369177 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9c118-6d39-4f5f-9e0e-a64d08cde2be None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:25.369461 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9c118-6d39-4f5f-9e0e-a64d08cde2be None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:25.370227 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9c118-6d39-4f5f-9e0e-a64d08cde2be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:25.370539 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9c118-6d39-4f5f-9e0e-a64d08cde2be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:25.373474 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca10e8c-8dca-4fba-891f-66290ac70f78 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:25.373781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca10e8c-8dca-4fba-891f-66290ac70f78 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:25.374042 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9c118-6d39-4f5f-9e0e-a64d08cde2be None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:25.374146 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca10e8c-8dca-4fba-891f-66290ac70f78 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:25.375929 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 421/853] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:06:25.383640 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544decd-5de1-4a77-86dd-88095b7c1007 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:25.384055 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544decd-5de1-4a77-86dd-88095b7c1007 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:25.384989 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544decd-5de1-4a77-86dd-88095b7c1007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:25.388479 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 433/854] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:25.393593 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9c118-6d39-4f5f-9e0e-a64d08cde2be None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:25.406287 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-a544decd-5de1-4a77-86dd-88095b7c1007 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:25.407523 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a544decd-5de1-4a77-86dd-88095b7c1007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:25.413885 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:25.481790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 422/855] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 11:06:25.500609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544decd-5de1-4a77-86dd-88095b7c1007 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:25.530153 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9c118-6d39-4f5f-9e0e-a64d08cde2be None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:25.573978 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:25.577550 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585219d-b289-4af1-9eb8-98e3c1b74a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:25.578792 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585219d-b289-4af1-9eb8-98e3c1b74a91 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:25.579081 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585219d-b289-4af1-9eb8-98e3c1b74a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:25.579358 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585219d-b289-4af1-9eb8-98e3c1b74a91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:25.590018 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585219d-b289-4af1-9eb8-98e3c1b74a91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:25.591002 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585219d-b289-4af1-9eb8-98e3c1b74a91 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:25.605904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-b585219d-b289-4af1-9eb8-98e3c1b74a91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:25.605904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:25.605904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:25.605904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:25.605904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:25.605904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:25.605904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:25.605904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:25.605904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:25.605904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:25.605904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:25.605904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:25.605904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:06:25.605904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:06:25.605904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:06:25.606904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:06:25.606904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:25.606904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:25.606904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:25.606904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:25.606904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:25.606904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:25.606904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:25.606904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:25.606904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:25.606904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:25.606904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:25.606904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:25.606904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:25.606904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:25.606904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:25.606904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:25.607836 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:06:25.607836 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:06:25.607836 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:06:25.607836 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:06:25.607836 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:06:25.607836 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:06:25.607836 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:25.607836 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:25.612048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 434/856] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:06:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:25.613491 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585219d-b289-4af1-9eb8-98e3c1b74a91 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:25.632488 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544decd-5de1-4a77-86dd-88095b7c1007 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:25.669799 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eaa7ec-5318-4e63-9c71-31e528d8b0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:25.671056 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eaa7ec-5318-4e63-9c71-31e528d8b0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:25.671640 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eaa7ec-5318-4e63-9c71-31e528d8b0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:25.672120 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eaa7ec-5318-4e63-9c71-31e528d8b0b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:25.684720 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eaa7ec-5318-4e63-9c71-31e528d8b0b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:06:25.686304 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:25.695277 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-88eaa7ec-5318-4e63-9c71-31e528d8b0b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:06:25.695277 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:25.695277 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:25.695277 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:25.695277 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:25.695277 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:25.695277 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:25.695277 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:25.695277 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:25.695277 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:25.695277 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:25.695277 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:25.695277 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:06:25.695277 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:06:25.695277 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:06:25.695277 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:06:25.698067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:06:25.698067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:06:25.698067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:06:25.698067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:06:25.698067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:25.698067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:25.698067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:25.698067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:25.698067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:25.698067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:25.698067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:25.698067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:25.698067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:25.698067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:25.698067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:25.698067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:25.698920 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:25.698920 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:25.698920 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:25.698920 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:25.698920 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:06:25.698920 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:06:25.698920 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:06:25.698920 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:06:25.698920 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:06:25.698920 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:06:25.698920 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:06:25.698920 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:25.702503 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 423/857] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:06:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:25.703774 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eaa7ec-5318-4e63-9c71-31e528d8b0b8 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:25.717347 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585219d-b289-4af1-9eb8-98e3c1b74a91 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:25.752504 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebba748-6fc0-4b8d-898f-04489259fce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:25.753384 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebba748-6fc0-4b8d-898f-04489259fce0 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:25.753668 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebba748-6fc0-4b8d-898f-04489259fce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:25.753988 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebba748-6fc0-4b8d-898f-04489259fce0 None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:25.754777 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebba748-6fc0-4b8d-898f-04489259fce0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:25.755084 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebba748-6fc0-4b8d-898f-04489259fce0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:25.756509 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebba748-6fc0-4b8d-898f-04489259fce0 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:25.773932 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 435/858] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:06:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:25.775440 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebba748-6fc0-4b8d-898f-04489259fce0 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:25.825472 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eaa7ec-5318-4e63-9c71-31e528d8b0b8 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:25.845049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:25.867108 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb968cbf-5c81-4661-9ed0-ce14b3c85404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:25.868071 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb968cbf-5c81-4661-9ed0-ce14b3c85404 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:25.868387 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb968cbf-5c81-4661-9ed0-ce14b3c85404 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:25.873984 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb968cbf-5c81-4661-9ed0-ce14b3c85404 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:25.873984 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb968cbf-5c81-4661-9ed0-ce14b3c85404 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:25.873984 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb968cbf-5c81-4661-9ed0-ce14b3c85404 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:25.873984 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb968cbf-5c81-4661-9ed0-ce14b3c85404 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:25.877419 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebba748-6fc0-4b8d-898f-04489259fce0 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:25.886842 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 424/859] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:06:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:25.887908 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb968cbf-5c81-4661-9ed0-ce14b3c85404 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:25.908170 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:25.913375 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500075b-3b86-48e5-9c56-a83104d08892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:25.914058 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500075b-3b86-48e5-9c56-a83104d08892 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:25.914360 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500075b-3b86-48e5-9c56-a83104d08892 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:25.914695 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500075b-3b86-48e5-9c56-a83104d08892 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:25.915531 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500075b-3b86-48e5-9c56-a83104d08892 None admin] RBAC: Adding query filter params (role.id=9b682db1e9a5486884a74f5c01953fe7, scope.project.id=38ed7416526e473b816330e24acf7a04, user.id=cdfa8f4012c2471b81f8749b013d3117) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:25.915846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500075b-3b86-48e5-9c56-a83104d08892 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:25.917269 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500075b-3b86-48e5-9c56-a83104d08892 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:25.923529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 436/860] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:06:25 2022] GET /identity/v3/role_assignments?user.id=cdfa8f4012c2471b81f8749b013d3117&scope.project.id=38ed7416526e473b816330e24acf7a04&role.id=9b682db1e9a5486884a74f5c01953fe7 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:26.009663 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb968cbf-5c81-4661-9ed0-ce14b3c85404 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:26.047644 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbc1d0-64f9-44d3-be96-59768451e8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:26.048505 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbc1d0-64f9-44d3-be96-59768451e8b3 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:26.048789 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbc1d0-64f9-44d3-be96-59768451e8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:26.049064 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbc1d0-64f9-44d3-be96-59768451e8b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:26.060770 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fbc1d0-64f9-44d3-be96-59768451e8b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:26.062391 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fbc1d0-64f9-44d3-be96-59768451e8b3 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:26.082091 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-c0fbc1d0-64f9-44d3-be96-59768451e8b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:26.082091 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:26.082091 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:26.082091 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:26.082091 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:26.082091 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:26.082091 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:26.082091 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:26.082091 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:26.082091 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:26.082091 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:26.082091 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:26.082091 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:26.082091 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:26.082091 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:26.083182 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:26.083182 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:26.083182 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:26.083182 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:26.083182 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:26.083182 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:26.083182 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:26.083182 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:26.083182 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:26.083182 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:26.083182 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:26.083182 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:26.083182 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:26.083182 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:26.083182 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:26.083182 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:26.083182 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:26.084155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:26.084155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:26.084155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:26.084155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:26.089804 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 425/861] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:26.091783 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500075b-3b86-48e5-9c56-a83104d08892 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:26.197814 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500075b-3b86-48e5-9c56-a83104d08892 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:26.232081 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3895f-719d-4867-8730-68f7fb74b86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:26.232744 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3895f-719d-4867-8730-68f7fb74b86d None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:26.233027 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3895f-719d-4867-8730-68f7fb74b86d None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:26.233303 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3895f-719d-4867-8730-68f7fb74b86d None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:26.234070 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd3895f-719d-4867-8730-68f7fb74b86d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:26.234377 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd3895f-719d-4867-8730-68f7fb74b86d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:26.235743 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd3895f-719d-4867-8730-68f7fb74b86d None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:26.248048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 437/862] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:26.254192 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbc1d0-64f9-44d3-be96-59768451e8b3 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:26.286446 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:26.359873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbc1d0-64f9-44d3-be96-59768451e8b3 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:26.396566 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c7b48-843e-4005-8b54-ecab1863ea3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:26.397416 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c7b48-843e-4005-8b54-ecab1863ea3b None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:26.397699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c7b48-843e-4005-8b54-ecab1863ea3b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:26.398001 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c7b48-843e-4005-8b54-ecab1863ea3b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:26.405285 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c7b48-843e-4005-8b54-ecab1863ea3b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:26.406859 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c7b48-843e-4005-8b54-ecab1863ea3b None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:26.421452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-503c7b48-843e-4005-8b54-ecab1863ea3b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 11:06:26.421452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:26.421452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:26.421452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:26.421452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:26.421452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:26.421452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:26.421452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:26.421452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:26.421452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:26.421452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:26.421452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:26.421452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:06:26.421452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:06:26.421452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:06:26.421452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:06:26.422447 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:26.422447 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:26.422447 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:06:26.422447 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:26.422447 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:06:26.422447 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:26.422447 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:26.422447 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:26.422447 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:26.422447 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:26.422447 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:26.422447 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:26.422447 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:26.422447 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:26.422447 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:26.422447 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:26.422447 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:26.422447 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:26.423392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:26.423392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:26.423392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:06:26.423392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:06:26.423392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:06:26.423392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:06:26.423392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:06:26.423392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:06:26.423392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 11:06:26.423392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:26.423392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 426/863] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:06:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:26.429132 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3895f-719d-4867-8730-68f7fb74b86d None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:26.488535 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:26.520831 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7ddf4-0015-47ff-8bbd-bbe3c88984e6 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:26.521140 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7ddf4-0015-47ff-8bbd-bbe3c88984e6 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:26.521395 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7ddf4-0015-47ff-8bbd-bbe3c88984e6 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:26.524006 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 427/864] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:06:26.527963 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b6615-b9af-4c2b-bcbe-1429d0344073 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:26.528256 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b6615-b9af-4c2b-bcbe-1429d0344073 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:26.528539 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b6615-b9af-4c2b-bcbe-1429d0344073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:26.535976 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3895f-719d-4867-8730-68f7fb74b86d None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:26.545466 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-637b6615-b9af-4c2b-bcbe-1429d0344073 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:26.546759 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-637b6615-b9af-4c2b-bcbe-1429d0344073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:26.574956 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c63bc-323f-4527-85b3-43116280c1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:26.575793 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c63bc-323f-4527-85b3-43116280c1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:26.576182 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c63bc-323f-4527-85b3-43116280c1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:26.576534 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c63bc-323f-4527-85b3-43116280c1f5 None admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:26.577442 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c63bc-323f-4527-85b3-43116280c1f5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:26.577871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c63bc-323f-4527-85b3-43116280c1f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:26.579379 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c63bc-323f-4527-85b3-43116280c1f5 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:26.600296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 438/865] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Jul 11 11:06:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:26.605919 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c63bc-323f-4527-85b3-43116280c1f5 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:26.621704 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 428/866] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 11:06:26.644861 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b6615-b9af-4c2b-bcbe-1429d0344073 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:26.674343 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:26.723907 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c63bc-323f-4527-85b3-43116280c1f5 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:26.740484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:26.762956 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9aeb9-fd5b-4bba-b287-49e5e9a51ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:26.763955 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9aeb9-fd5b-4bba-b287-49e5e9a51ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:26.764469 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9aeb9-fd5b-4bba-b287-49e5e9a51ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:26.764947 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9aeb9-fd5b-4bba-b287-49e5e9a51ba4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:26.781218 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b6615-b9af-4c2b-bcbe-1429d0344073 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:26.823873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1759ee-0a55-417d-b3af-f6b219c2822a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:26.824553 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1759ee-0a55-417d-b3af-f6b219c2822a None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:26.824871 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1759ee-0a55-417d-b3af-f6b219c2822a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:26.825367 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1759ee-0a55-417d-b3af-f6b219c2822a None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:26.825962 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1759ee-0a55-417d-b3af-f6b219c2822a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:26.827334 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1759ee-0a55-417d-b3af-f6b219c2822a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:26.845524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9aeb9-fd5b-4bba-b287-49e5e9a51ba4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:26.848100 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9aeb9-fd5b-4bba-b287-49e5e9a51ba4 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:26.906403 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 429/867] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Jul 11 11:06:26 2022] POST /identity/v3/services => generated 269 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:06:26.958473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 439/868] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:06:26 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 11:06:26.964794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1759ee-0a55-417d-b3af-f6b219c2822a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:27.061318 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:27.092526 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1759ee-0a55-417d-b3af-f6b219c2822a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:27.127269 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d15f0-bcbb-4c6f-9ecb-fb0fa3b277c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:27.128271 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d15f0-bcbb-4c6f-9ecb-fb0fa3b277c5 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:27.128555 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d15f0-bcbb-4c6f-9ecb-fb0fa3b277c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:27.128834 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d15f0-bcbb-4c6f-9ecb-fb0fa3b277c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:27.139555 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d15f0-bcbb-4c6f-9ecb-fb0fa3b277c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:27.141053 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d15f0-bcbb-4c6f-9ecb-fb0fa3b277c5 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:27.160518 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-508d15f0-bcbb-4c6f-9ecb-fb0fa3b277c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:27.160518 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:27.160518 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:27.160518 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:27.160518 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:27.160518 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:27.160518 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:27.160518 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:27.160518 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:27.160518 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:27.160518 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:27.160518 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:27.160518 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:27.160518 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:27.160518 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:27.161542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:27.161542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:27.161542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:27.161542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:27.161542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:27.161542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:27.161542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:27.161542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:27.161542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:27.161542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:27.161542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:27.161542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:27.161542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:27.161542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:27.161542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:27.161542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:27.161542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:27.162562 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:27.162562 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:27.162562 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:27.162562 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:27.162562 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 430/869] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:27.169051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9aeb9-fd5b-4bba-b287-49e5e9a51ba4 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:27.186381 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:27.284821 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9aeb9-fd5b-4bba-b287-49e5e9a51ba4 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:27.322543 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6443cd4-ccb2-406a-b1db-af7f6eef57f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:27.323135 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6443cd4-ccb2-406a-b1db-af7f6eef57f3 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:27.323425 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6443cd4-ccb2-406a-b1db-af7f6eef57f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:27.323883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6443cd4-ccb2-406a-b1db-af7f6eef57f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:27.324620 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6443cd4-ccb2-406a-b1db-af7f6eef57f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:27.324939 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6443cd4-ccb2-406a-b1db-af7f6eef57f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:27.326350 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6443cd4-ccb2-406a-b1db-af7f6eef57f3 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:27.331917 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc752b-7742-4fcb-a4ec-763ec7d96194 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:27.332493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc752b-7742-4fcb-a4ec-763ec7d96194 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:27.333014 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc752b-7742-4fcb-a4ec-763ec7d96194 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:27.335007 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 431/870] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:27.339698 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 440/871] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:27.340634 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a47b55-3156-458a-8151-7093a754c3f5 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:27.340999 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a47b55-3156-458a-8151-7093a754c3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:27.341351 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a47b55-3156-458a-8151-7093a754c3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:27.347942 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6443cd4-ccb2-406a-b1db-af7f6eef57f3 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:27.360251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-70a47b55-3156-458a-8151-7093a754c3f5 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:27.361503 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-70a47b55-3156-458a-8151-7093a754c3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:27.428288 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:27.431916 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 432/872] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:27 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:06:27.454425 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a47b55-3156-458a-8151-7093a754c3f5 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:27.458998 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6443cd4-ccb2-406a-b1db-af7f6eef57f3 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:27.495468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543944e8-1eb5-4110-8afb-4d81ac010cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:27.496626 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543944e8-1eb5-4110-8afb-4d81ac010cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:27.497114 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543944e8-1eb5-4110-8afb-4d81ac010cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:27.497599 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543944e8-1eb5-4110-8afb-4d81ac010cc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:27.506074 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543944e8-1eb5-4110-8afb-4d81ac010cc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:27.507874 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543944e8-1eb5-4110-8afb-4d81ac010cc3 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:27.523104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-543944e8-1eb5-4110-8afb-4d81ac010cc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:27.523104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:27.523104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:27.523104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:27.523104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:27.523104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:27.523104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:27.523104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:27.523104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:27.523104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:27.523104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:27.523104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:27.523104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:06:27.523104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:06:27.523104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:06:27.524020 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:06:27.524020 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:27.524020 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:27.524020 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:27.524020 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:27.524020 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:27.524020 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:27.524020 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:27.524020 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:27.524020 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:27.524020 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:27.524020 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:27.524020 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:27.524020 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:27.524020 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:27.524020 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:27.524020 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:27.524930 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:06:27.524930 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:06:27.524930 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:06:27.524930 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:06:27.524930 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:06:27.524930 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:06:27.524930 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:27.524930 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:27.531910 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 441/873] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:06:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:27.532991 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543944e8-1eb5-4110-8afb-4d81ac010cc3 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:27.562150 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:27.571070 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a47b55-3156-458a-8151-7093a754c3f5 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:27.607099 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412566d-8884-458e-9545-f04d811452c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:27.607820 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412566d-8884-458e-9545-f04d811452c2 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:27.608112 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412566d-8884-458e-9545-f04d811452c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:27.608444 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412566d-8884-458e-9545-f04d811452c2 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:27.609212 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412566d-8884-458e-9545-f04d811452c2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:27.611467 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412566d-8884-458e-9545-f04d811452c2 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:27.642463 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543944e8-1eb5-4110-8afb-4d81ac010cc3 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:27.678554 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a21c8e-920c-45c9-af45-435c06e3115a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:27.679586 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a21c8e-920c-45c9-af45-435c06e3115a None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:27.680084 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a21c8e-920c-45c9-af45-435c06e3115a None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:27.680651 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a21c8e-920c-45c9-af45-435c06e3115a None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:27.681755 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a21c8e-920c-45c9-af45-435c06e3115a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:27.682304 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a21c8e-920c-45c9-af45-435c06e3115a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:27.684224 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a21c8e-920c-45c9-af45-435c06e3115a None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:27.690147 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 433/874] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Jul 11 11:06:27 2022] POST /identity/v3/services => generated 251 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:06:27.694535 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:27.699165 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 442/875] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:06:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:27.705747 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412566d-8884-458e-9545-f04d811452c2 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:27.830263 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412566d-8884-458e-9545-f04d811452c2 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:27.850965 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:27.870693 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcd50b-4f0e-459d-8b64-ef0d71697c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:27.871328 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcd50b-4f0e-459d-8b64-ef0d71697c0f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:27.871613 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcd50b-4f0e-459d-8b64-ef0d71697c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:27.871897 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcd50b-4f0e-459d-8b64-ef0d71697c0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:27.872769 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfcd50b-4f0e-459d-8b64-ef0d71697c0f None admin] RBAC: Adding query filter params (role.id=736e70deba004b9289c2fed43eb107f7, scope.project.id=38ed7416526e473b816330e24acf7a04, user.id=736f6d4d1dbb47ff98bc67e53614d49c) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:27.873085 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfcd50b-4f0e-459d-8b64-ef0d71697c0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:27.874622 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfcd50b-4f0e-459d-8b64-ef0d71697c0f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:27.885202 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 434/876] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:06:27 2022] GET /identity/v3/role_assignments?user.id=736f6d4d1dbb47ff98bc67e53614d49c&scope.project.id=38ed7416526e473b816330e24acf7a04&role.id=736e70deba004b9289c2fed43eb107f7 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:28.159644 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22f7ce-eab1-4302-bc80-818321d8c5c4 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:28.159835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22f7ce-eab1-4302-bc80-818321d8c5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:28.160130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22f7ce-eab1-4302-bc80-818321d8c5c4 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:28.161772 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 443/877] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:28.167017 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d1fdc-c162-4ea8-8034-47e07daf9a0d None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:28.167486 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d1fdc-c162-4ea8-8034-47e07daf9a0d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:28.167565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d1fdc-c162-4ea8-8034-47e07daf9a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:28.186011 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-230d1fdc-c162-4ea8-8034-47e07daf9a0d None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:28.187239 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-230d1fdc-c162-4ea8-8034-47e07daf9a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:28.260285 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 435/878] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:28 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:06:28.282793 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22f7ce-eab1-4302-bc80-818321d8c5c4 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:28.386439 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22f7ce-eab1-4302-bc80-818321d8c5c4 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:28.421019 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1ce0e-e0eb-43ff-bff4-44fccf673082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:28.421845 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1ce0e-e0eb-43ff-bff4-44fccf673082 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:28.422133 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1ce0e-e0eb-43ff-bff4-44fccf673082 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:28.422405 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1ce0e-e0eb-43ff-bff4-44fccf673082 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:28.433065 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d1ce0e-e0eb-43ff-bff4-44fccf673082 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:06:28.442297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-27d1ce0e-e0eb-43ff-bff4-44fccf673082 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 11:06:28.442297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:28.442297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:28.442297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:28.442297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:28.442297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:28.442297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:28.442297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:28.442297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:28.442297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:28.442297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:28.442297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:28.442297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:06:28.442297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:06:28.442297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:06:28.442297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:06:28.443275 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:06:28.443275 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:06:28.443275 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:06:28.443275 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:06:28.443275 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:28.443275 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:28.443275 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:28.443275 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:28.443275 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:28.443275 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:28.443275 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:28.443275 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:28.443275 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:28.443275 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:28.443275 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:28.443275 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:28.444291 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:28.444291 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:28.444291 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:28.444291 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:28.444291 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:06:28.444291 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:06:28.444291 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:06:28.444291 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:06:28.444291 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:06:28.444291 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:06:28.444291 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 11:06:28.444291 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:28.444291 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 444/879] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Jul 11 11:06:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:28.450723 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d1fdc-c162-4ea8-8034-47e07daf9a0d None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:28.555549 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d1fdc-c162-4ea8-8034-47e07daf9a0d None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:28.567481 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:28.592133 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef81be2-2870-4c93-b6bd-3634b96dbc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:28.593123 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef81be2-2870-4c93-b6bd-3634b96dbc88 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:28.593600 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef81be2-2870-4c93-b6bd-3634b96dbc88 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:28.594088 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef81be2-2870-4c93-b6bd-3634b96dbc88 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:28.595049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef81be2-2870-4c93-b6bd-3634b96dbc88 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:28.595564 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef81be2-2870-4c93-b6bd-3634b96dbc88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:28.597795 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef81be2-2870-4c93-b6bd-3634b96dbc88 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:28.606813 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 436/880] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Jul 11 11:06:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:28.611899 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1ce0e-e0eb-43ff-bff4-44fccf673082 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:28.670519 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:28.723042 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1ce0e-e0eb-43ff-bff4-44fccf673082 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:28.759012 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f2910-91ac-4975-99d2-7043e4b5144c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:28.759823 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f2910-91ac-4975-99d2-7043e4b5144c None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:28.760116 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f2910-91ac-4975-99d2-7043e4b5144c None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:28.760399 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f2910-91ac-4975-99d2-7043e4b5144c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:28.780805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f2910-91ac-4975-99d2-7043e4b5144c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:28.782351 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f2910-91ac-4975-99d2-7043e4b5144c None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:28.804109 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-fc7f2910-91ac-4975-99d2-7043e4b5144c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:28.804109 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:28.804109 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:28.804109 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:28.804109 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:28.804109 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:28.804109 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:28.804109 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:28.804109 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:28.804109 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:28.804109 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:28.804109 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:28.804109 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:28.804109 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:28.804109 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:28.805088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:28.805088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:28.805088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:28.805088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:28.805088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:28.805088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:28.805088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:28.805088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:28.805088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:28.805088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:28.805088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:28.805088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:28.805088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:28.805088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:28.805088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:28.805088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:28.805088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:28.806040 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:28.806040 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:28.806040 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:28.806040 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:28.806040 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 445/881] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:28.811316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef81be2-2870-4c93-b6bd-3634b96dbc88 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:28.921012 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef81be2-2870-4c93-b6bd-3634b96dbc88 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:28.959216 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d35a9c-7527-4291-9a76-70cbb3c81f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:28.959889 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d35a9c-7527-4291-9a76-70cbb3c81f47 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:28.960175 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d35a9c-7527-4291-9a76-70cbb3c81f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:28.960456 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d35a9c-7527-4291-9a76-70cbb3c81f47 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:28.961177 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d35a9c-7527-4291-9a76-70cbb3c81f47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:28.961489 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d35a9c-7527-4291-9a76-70cbb3c81f47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:28.962875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d35a9c-7527-4291-9a76-70cbb3c81f47 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:28.976182 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 437/882] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:28.981268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f2910-91ac-4975-99d2-7043e4b5144c None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:29.071588 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916218c3-0891-43f9-bf14-2d8625991f84 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:29.071949 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916218c3-0891-43f9-bf14-2d8625991f84 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:29.072157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916218c3-0891-43f9-bf14-2d8625991f84 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:29.073818 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 438/883] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:06:29.078855 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53319d43-6338-401d-9745-3b893ee7ee12 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:29.079144 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53319d43-6338-401d-9745-3b893ee7ee12 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:29.079428 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53319d43-6338-401d-9745-3b893ee7ee12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:29.088323 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f2910-91ac-4975-99d2-7043e4b5144c None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:29.097164 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:29.099328 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-53319d43-6338-401d-9745-3b893ee7ee12 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:29.100862 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-53319d43-6338-401d-9745-3b893ee7ee12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:29.125217 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f7801-dab9-4b9d-8464-a1b8682aa38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:29.126074 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f7801-dab9-4b9d-8464-a1b8682aa38d None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:29.126354 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f7801-dab9-4b9d-8464-a1b8682aa38d None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:29.126627 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f7801-dab9-4b9d-8464-a1b8682aa38d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:29.129964 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:29.134434 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f7801-dab9-4b9d-8464-a1b8682aa38d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:29.135935 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f7801-dab9-4b9d-8464-a1b8682aa38d None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:29.157806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-612f7801-dab9-4b9d-8464-a1b8682aa38d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 11:06:29.157806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:29.157806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:29.157806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:29.157806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:29.157806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:29.157806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:29.157806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:29.157806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:29.157806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:29.157806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:29.157806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:29.157806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:06:29.157806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:06:29.157806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:06:29.157806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:06:29.158835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:29.158835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:29.158835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:06:29.158835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:29.158835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:06:29.158835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:29.158835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:29.158835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:29.158835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:29.158835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:29.158835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:29.158835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:29.158835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:29.158835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:29.158835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:29.158835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:29.158835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:29.158835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:29.160615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:29.160615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:29.160615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:06:29.160615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:06:29.160615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:06:29.160615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:06:29.160615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:06:29.160615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:06:29.160615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 11:06:29.160615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:29.160615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 446/884] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Jul 11 11:06:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:29.160615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f7801-dab9-4b9d-8464-a1b8682aa38d None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:29.177236 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 439/885] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:29 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:06:29.200014 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53319d43-6338-401d-9745-3b893ee7ee12 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:29.275603 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f7801-dab9-4b9d-8464-a1b8682aa38d None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:29.314494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb70b0c-6341-48bb-bb7a-8055d0f8c56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:29.315700 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb70b0c-6341-48bb-bb7a-8055d0f8c56c None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:29.316194 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb70b0c-6341-48bb-bb7a-8055d0f8c56c None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:29.316779 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb70b0c-6341-48bb-bb7a-8055d0f8c56c None admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:29.318015 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb70b0c-6341-48bb-bb7a-8055d0f8c56c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:29.318599 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb70b0c-6341-48bb-bb7a-8055d0f8c56c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:29.320441 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb70b0c-6341-48bb-bb7a-8055d0f8c56c None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:29.325064 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53319d43-6338-401d-9745-3b893ee7ee12 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:29.340612 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 447/886] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Jul 11 11:06:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:29.345857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb70b0c-6341-48bb-bb7a-8055d0f8c56c None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:29.376211 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:29.377730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5c5d2-7c79-4c0c-8688-bc05c45b1ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:29.379136 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5c5d2-7c79-4c0c-8688-bc05c45b1ecd None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:29.379630 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5c5d2-7c79-4c0c-8688-bc05c45b1ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:29.380415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5c5d2-7c79-4c0c-8688-bc05c45b1ecd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:29.381548 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5c5d2-7c79-4c0c-8688-bc05c45b1ecd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:29.383719 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5c5d2-7c79-4c0c-8688-bc05c45b1ecd None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:29.401141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-a1b5c5d2-7c79-4c0c-8688-bc05c45b1ecd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 11:06:29.401141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:29.401141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:06:29.401141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:06:29.401141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:06:29.401141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:06:29.401141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:06:29.401141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:29.401141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 11:06:29.401141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:29.401141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:06:29.401141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:29.401141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:29.401141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:29.401141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:29.401141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:29.402194 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:29.402194 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:29.402194 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:29.402194 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:29.402194 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:29.402194 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:29.402194 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:29.402194 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:06:29.402194 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:06:29.402194 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:06:29.402194 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:06:29.402194 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:29.402194 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:29.402194 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:29.402194 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:29.402194 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:29.403031 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:29.403031 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:29.403031 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:29.403031 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:29.403031 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:29.403031 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:29.403031 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:29.403031 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:29.403031 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:29.403031 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:29.403031 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:29.403031 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:06:29.403031 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:29.403031 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 11:06:29.403031 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:29.409250 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 440/887] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Jul 11 11:06:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:29.410618 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5c5d2-7c79-4c0c-8688-bc05c45b1ecd None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:29.448445 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:29.470516 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb70b0c-6341-48bb-bb7a-8055d0f8c56c None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:29.519140 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5d8d2-9ede-4f25-85cc-e7599eb1cdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:29.520105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5d8d2-9ede-4f25-85cc-e7599eb1cdb1 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:29.521133 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5d8d2-9ede-4f25-85cc-e7599eb1cdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:29.521607 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5d8d2-9ede-4f25-85cc-e7599eb1cdb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:29.533049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5c5d2-7c79-4c0c-8688-bc05c45b1ecd None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:29.571984 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec3bb9-664f-487c-9d3b-8582a6dd5c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:29.572765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec3bb9-664f-487c-9d3b-8582a6dd5c3d None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:29.573112 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec3bb9-664f-487c-9d3b-8582a6dd5c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:29.573456 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec3bb9-664f-487c-9d3b-8582a6dd5c3d None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:29.574278 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec3bb9-664f-487c-9d3b-8582a6dd5c3d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:29.574708 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec3bb9-664f-487c-9d3b-8582a6dd5c3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:29.576196 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec3bb9-664f-487c-9d3b-8582a6dd5c3d None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:29.586381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 441/888] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Jul 11 11:06:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:29.587469 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec3bb9-664f-487c-9d3b-8582a6dd5c3d None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:29.616181 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5d8d2-9ede-4f25-85cc-e7599eb1cdb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:29.617701 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5d8d2-9ede-4f25-85cc-e7599eb1cdb1 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:29.645776 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:29.693923 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:29.704524 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec3bb9-664f-487c-9d3b-8582a6dd5c3d None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:29.730826 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 448/889] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:06:29 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 11:06:29.731838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5d8d2-9ede-4f25-85cc-e7599eb1cdb1 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:29.743724 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28143773-c28a-4f50-9b73-3c408ed49808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:29.744731 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28143773-c28a-4f50-9b73-3c408ed49808 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:29.745160 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28143773-c28a-4f50-9b73-3c408ed49808 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:29.747131 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28143773-c28a-4f50-9b73-3c408ed49808 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:29.747131 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28143773-c28a-4f50-9b73-3c408ed49808 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:29.747131 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28143773-c28a-4f50-9b73-3c408ed49808 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:29.748573 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28143773-c28a-4f50-9b73-3c408ed49808 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:29.758642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 442/890] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Jul 11 11:06:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:29.761428 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28143773-c28a-4f50-9b73-3c408ed49808 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:29.837248 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5d8d2-9ede-4f25-85cc-e7599eb1cdb1 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:29.861803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:29.873243 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f6f9c-acda-4ca9-b789-389f82630b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:29.874999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f6f9c-acda-4ca9-b789-389f82630b01 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:29.874999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f6f9c-acda-4ca9-b789-389f82630b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:29.874999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f6f9c-acda-4ca9-b789-389f82630b01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:29.876653 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28143773-c28a-4f50-9b73-3c408ed49808 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:29.886613 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f6f9c-acda-4ca9-b789-389f82630b01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:29.888220 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f6f9c-acda-4ca9-b789-389f82630b01 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:29.906858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-ce9f6f9c-acda-4ca9-b789-389f82630b01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:29.906858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:29.906858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:29.906858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:29.906858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:29.906858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:29.906858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:29.906858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:29.906858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:29.906858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:29.906858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:29.906858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:29.906858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:29.906858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:29.906858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:29.907819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:29.907819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:29.907819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:29.907819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:29.907819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:29.907819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:29.907819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:29.907819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:29.907819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:29.907819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:29.907819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:29.907819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:29.907819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:29.907819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:29.907819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:29.907819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:29.907819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:29.908735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:29.908735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:29.908735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:29.908735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:29.908735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 449/891] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:29.910197 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9d239-7ff3-42ca-a832-3f204782ea11 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:29.910197 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9d239-7ff3-42ca-a832-3f204782ea11 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:29.910464 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9d239-7ff3-42ca-a832-3f204782ea11 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:29.911800 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 450/892] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:29.914645 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9d239-7ff3-42ca-a832-3f204782ea11 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:29.921450 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90e1d1-b8eb-47af-a49d-039b1f23b569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:29.922159 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90e1d1-b8eb-47af-a49d-039b1f23b569 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:29.922446 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90e1d1-b8eb-47af-a49d-039b1f23b569 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:29.922729 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90e1d1-b8eb-47af-a49d-039b1f23b569 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:29.923523 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90e1d1-b8eb-47af-a49d-039b1f23b569 None admin] RBAC: Adding query filter params (interface=public, service_id=7a6f8596f6e3467a8d56962e9f49ef0e, region_id=RegionOne) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:29.923840 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90e1d1-b8eb-47af-a49d-039b1f23b569 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:29.925307 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90e1d1-b8eb-47af-a49d-039b1f23b569 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:29.931065 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 443/893] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Jul 11 11:06:29 2022] GET /identity/v3/endpoints?service_id=7a6f8596f6e3467a8d56962e9f49ef0e&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:29.932262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dffc87-9a37-4e6f-a51c-2da75ccbc8dc None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:29.932551 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dffc87-9a37-4e6f-a51c-2da75ccbc8dc None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:29.932833 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dffc87-9a37-4e6f-a51c-2da75ccbc8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:29.951645 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-c7dffc87-9a37-4e6f-a51c-2da75ccbc8dc None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:29.952833 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c7dffc87-9a37-4e6f-a51c-2da75ccbc8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:29.967069 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:30.025861 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 444/894] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:29 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:06:30.027198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dffc87-9a37-4e6f-a51c-2da75ccbc8dc None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:30.040195 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9d239-7ff3-42ca-a832-3f204782ea11 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:30.075752 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130881e-d878-43b5-bf66-66c3ea429183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:30.076411 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130881e-d878-43b5-bf66-66c3ea429183 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:30.076694 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130881e-d878-43b5-bf66-66c3ea429183 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:30.076971 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130881e-d878-43b5-bf66-66c3ea429183 None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:30.077682 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130881e-d878-43b5-bf66-66c3ea429183 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:30.078015 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130881e-d878-43b5-bf66-66c3ea429183 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:30.079375 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130881e-d878-43b5-bf66-66c3ea429183 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:30.091314 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 451/895] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:30.092450 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa422839-2dca-4275-bd19-84ef00b9fe98 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:30.092737 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa422839-2dca-4275-bd19-84ef00b9fe98 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:30.093012 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa422839-2dca-4275-bd19-84ef00b9fe98 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:30.094458 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 452/896] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:30.094976 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa422839-2dca-4275-bd19-84ef00b9fe98 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:30.130994 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:30.132127 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dffc87-9a37-4e6f-a51c-2da75ccbc8dc None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:30.165638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c812e-9d8d-4ff3-bd2c-231a2b40b559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:30.166333 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c812e-9d8d-4ff3-bd2c-231a2b40b559 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:30.166618 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c812e-9d8d-4ff3-bd2c-231a2b40b559 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:30.166894 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c812e-9d8d-4ff3-bd2c-231a2b40b559 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:30.167635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c812e-9d8d-4ff3-bd2c-231a2b40b559 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:30.168994 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c812e-9d8d-4ff3-bd2c-231a2b40b559 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:30.175592 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 445/897] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Jul 11 11:06:30 2022] GET /identity/v3/services => generated 1268 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:06:30.176371 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c812e-9d8d-4ff3-bd2c-231a2b40b559 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:30.191567 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:30.215285 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa422839-2dca-4275-bd19-84ef00b9fe98 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:30.254056 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ebd8d-caa9-4e21-9ce6-be4cf4e185af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:30.254876 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ebd8d-caa9-4e21-9ce6-be4cf4e185af None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:30.255162 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ebd8d-caa9-4e21-9ce6-be4cf4e185af None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:30.255444 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ebd8d-caa9-4e21-9ce6-be4cf4e185af None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:30.256108 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ebd8d-caa9-4e21-9ce6-be4cf4e185af None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:30.257510 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ebd8d-caa9-4e21-9ce6-be4cf4e185af None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:30.272044 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-498ebd8d-caa9-4e21-9ce6-be4cf4e185af None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 11:06:30.272044 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:30.272044 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:06:30.272044 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:06:30.272044 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:06:30.272044 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:06:30.272044 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:06:30.272044 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:30.272044 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 11:06:30.272044 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:30.272044 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:06:30.272044 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:30.272044 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:30.272044 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:30.272044 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:30.272044 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:30.272044 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:30.273136 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:30.273136 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:30.273136 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:30.273136 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:30.273136 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:30.273136 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:30.273136 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:06:30.273136 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:06:30.273136 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:06:30.273136 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:06:30.273136 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:30.273136 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:30.273136 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:30.273136 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:30.273136 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:30.273136 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:30.274111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:30.274111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:30.274111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:30.274111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:30.274111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:30.274111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:30.274111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:30.274111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:30.274111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:30.274111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:30.274111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:06:30.274111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:30.274111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 11:06:30.274111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:30.274111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 453/898] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jul 11 11:06:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:30.274899 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36882fd9-f8c4-4754-8e16-3bed5d3c9523 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:30.275509 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36882fd9-f8c4-4754-8e16-3bed5d3c9523 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:30.275509 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36882fd9-f8c4-4754-8e16-3bed5d3c9523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:30.293235 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-36882fd9-f8c4-4754-8e16-3bed5d3c9523 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:30.294493 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-36882fd9-f8c4-4754-8e16-3bed5d3c9523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:30.297027 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c812e-9d8d-4ff3-bd2c-231a2b40b559 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:30.337547 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13ade1-8405-4ec1-8800-fee4b38451be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:30.338839 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13ade1-8405-4ec1-8800-fee4b38451be None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:30.338839 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13ade1-8405-4ec1-8800-fee4b38451be None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:30.339029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13ade1-8405-4ec1-8800-fee4b38451be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:30.347770 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13ade1-8405-4ec1-8800-fee4b38451be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:30.349142 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13ade1-8405-4ec1-8800-fee4b38451be None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:30.364971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-3f13ade1-8405-4ec1-8800-fee4b38451be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:30.364971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:30.364971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:30.364971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:30.364971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:30.364971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:30.364971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:30.364971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:30.364971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:30.364971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:30.364971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:30.364971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:30.364971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:06:30.364971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:06:30.364971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:06:30.366189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:06:30.366189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:30.366189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:30.366189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:30.366189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:30.366189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:30.366189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:30.366189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:30.366189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:30.366189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:30.366189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:30.366189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:30.366189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:30.366189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:30.366189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:30.366189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:30.366189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:30.367683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:06:30.367683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:06:30.367683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:06:30.367683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:06:30.367683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:06:30.367683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:06:30.367683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:30.367683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:30.367683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 446/899] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:06:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:30.367683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13ade1-8405-4ec1-8800-fee4b38451be None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:30.374151 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 454/900] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:06:30.374151 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36882fd9-f8c4-4754-8e16-3bed5d3c9523 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:30.405825 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:30.447658 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:30.477565 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36882fd9-f8c4-4754-8e16-3bed5d3c9523 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:30.478745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13ade1-8405-4ec1-8800-fee4b38451be None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:30.514095 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a822a-7b3a-4be3-99db-dfcac585d591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:30.514758 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a822a-7b3a-4be3-99db-dfcac585d591 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:30.515042 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a822a-7b3a-4be3-99db-dfcac585d591 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:30.515308 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a822a-7b3a-4be3-99db-dfcac585d591 None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:30.516099 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a822a-7b3a-4be3-99db-dfcac585d591 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:30.516410 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a822a-7b3a-4be3-99db-dfcac585d591 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:30.516807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343554e0-5434-410e-bedb-fe5df78bf770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:30.517549 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343554e0-5434-410e-bedb-fe5df78bf770 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:30.517857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a822a-7b3a-4be3-99db-dfcac585d591 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:30.518008 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343554e0-5434-410e-bedb-fe5df78bf770 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:30.518428 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343554e0-5434-410e-bedb-fe5df78bf770 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:30.519206 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343554e0-5434-410e-bedb-fe5df78bf770 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:30.519595 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343554e0-5434-410e-bedb-fe5df78bf770 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:30.521024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343554e0-5434-410e-bedb-fe5df78bf770 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:30.530830 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 447/901] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jul 11 11:06:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:30.530830 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343554e0-5434-410e-bedb-fe5df78bf770 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:30.540775 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 455/902] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:06:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:30.540775 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a822a-7b3a-4be3-99db-dfcac585d591 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:30.637435 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:30.644778 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343554e0-5434-410e-bedb-fe5df78bf770 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:30.647408 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a822a-7b3a-4be3-99db-dfcac585d591 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:30.683529 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938dff08-945a-4dcc-be91-983164fec009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:30.684337 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938dff08-945a-4dcc-be91-983164fec009 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:30.684614 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938dff08-945a-4dcc-be91-983164fec009 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:30.684938 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938dff08-945a-4dcc-be91-983164fec009 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:30.685535 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938dff08-945a-4dcc-be91-983164fec009 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:30.685628 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46279c-ffb1-4123-9fc3-eb981c47036c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:30.686426 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46279c-ffb1-4123-9fc3-eb981c47036c None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:30.686781 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46279c-ffb1-4123-9fc3-eb981c47036c None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:30.686909 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938dff08-945a-4dcc-be91-983164fec009 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:30.687183 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46279c-ffb1-4123-9fc3-eb981c47036c None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:30.687963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46279c-ffb1-4123-9fc3-eb981c47036c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:30.688338 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46279c-ffb1-4123-9fc3-eb981c47036c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:30.689773 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46279c-ffb1-4123-9fc3-eb981c47036c None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:30.689925 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:30.695473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 456/903] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jul 11 11:06:30 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:30.696395 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46279c-ffb1-4123-9fc3-eb981c47036c None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:30.700704 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-938dff08-945a-4dcc-be91-983164fec009 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 11:06:30.700704 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:30.700704 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:06:30.700704 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:06:30.700704 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:06:30.700704 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:06:30.700704 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:06:30.700704 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:30.700704 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 11:06:30.700704 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:30.700704 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:06:30.700704 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:30.700704 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:30.700704 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:30.700704 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:30.700704 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:30.700704 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:30.708654 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:30.708654 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:30.708654 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:30.708654 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:30.708654 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:30.708654 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:30.708654 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:06:30.708654 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:06:30.708654 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:06:30.708654 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:06:30.708654 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:30.708654 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:30.708654 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:30.708654 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:30.708654 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:30.708654 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:30.709575 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:30.709575 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:30.709575 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:30.709575 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:30.709575 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:30.709575 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:30.709575 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:30.709575 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:30.709575 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:30.709575 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:30.709575 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:06:30.709575 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:30.709575 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 11:06:30.709575 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:30.709575 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 448/904] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Jul 11 11:06:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:30.710984 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938dff08-945a-4dcc-be91-983164fec009 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:30.809380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938dff08-945a-4dcc-be91-983164fec009 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:30.816326 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46279c-ffb1-4123-9fc3-eb981c47036c None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:30.844710 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78344ba6-53d8-4f12-a7bd-3c3c0372c104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:30.845471 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78344ba6-53d8-4f12-a7bd-3c3c0372c104 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:30.845897 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78344ba6-53d8-4f12-a7bd-3c3c0372c104 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:30.846249 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78344ba6-53d8-4f12-a7bd-3c3c0372c104 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:30.847164 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78344ba6-53d8-4f12-a7bd-3c3c0372c104 None admin] RBAC: Adding query filter params (interface=public, service_id=1017b60d0c3f4bb082958556e0b31ca9, region_id=RegionOne) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:30.847573 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78344ba6-53d8-4f12-a7bd-3c3c0372c104 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:30.848931 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78344ba6-53d8-4f12-a7bd-3c3c0372c104 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:30.854028 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 449/905] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Jul 11 11:06:30 2022] GET /identity/v3/endpoints?service_id=1017b60d0c3f4bb082958556e0b31ca9&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:30.854414 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09548c4d-734e-4d35-86fa-fbf256710c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:30.854799 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78344ba6-53d8-4f12-a7bd-3c3c0372c104 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:30.855384 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09548c4d-734e-4d35-86fa-fbf256710c7a None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:30.855667 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09548c4d-734e-4d35-86fa-fbf256710c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:30.855943 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09548c4d-734e-4d35-86fa-fbf256710c7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:30.856767 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09548c4d-734e-4d35-86fa-fbf256710c7a None admin] RBAC: Adding query filter params (role.id=4418ec5b68a244968638f90e957b5163, scope.project.id=38ed7416526e473b816330e24acf7a04, user.id=cdfa8f4012c2471b81f8749b013d3117) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:30.857080 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09548c4d-734e-4d35-86fa-fbf256710c7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:30.858852 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09548c4d-734e-4d35-86fa-fbf256710c7a None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:30.873807 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 457/906] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:06:30 2022] GET /identity/v3/role_assignments?user.id=cdfa8f4012c2471b81f8749b013d3117&scope.project.id=38ed7416526e473b816330e24acf7a04&role.id=4418ec5b68a244968638f90e957b5163 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:30.873807 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09548c4d-734e-4d35-86fa-fbf256710c7a None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:30.899511 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:30.931182 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:30.982780 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78344ba6-53d8-4f12-a7bd-3c3c0372c104 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:31.008556 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09548c4d-734e-4d35-86fa-fbf256710c7a None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:31.031377 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f82af-555b-4b20-a61d-d301f72567c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:31.032056 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f82af-555b-4b20-a61d-d301f72567c3 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:31.032341 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f82af-555b-4b20-a61d-d301f72567c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:31.032616 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f82af-555b-4b20-a61d-d301f72567c3 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:31.033321 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f82af-555b-4b20-a61d-d301f72567c3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:31.033628 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f82af-555b-4b20-a61d-d301f72567c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:31.035822 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f82af-555b-4b20-a61d-d301f72567c3 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:31.044781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 450/907] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Jul 11 11:06:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:31.051137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f82af-555b-4b20-a61d-d301f72567c3 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:31.052288 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55022fd7-c62c-4930-81b9-7fdd2993a894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:31.053173 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55022fd7-c62c-4930-81b9-7fdd2993a894 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:31.053666 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55022fd7-c62c-4930-81b9-7fdd2993a894 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:31.054236 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55022fd7-c62c-4930-81b9-7fdd2993a894 None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:31.055161 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55022fd7-c62c-4930-81b9-7fdd2993a894 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:31.056641 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55022fd7-c62c-4930-81b9-7fdd2993a894 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:31.069878 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 458/908] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Jul 11 11:06:30 2022] GET /identity/v3/services => generated 1268 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:06:31.174340 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f82af-555b-4b20-a61d-d301f72567c3 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:31.207325 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:31.220970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8043fd-a058-4f85-844c-40c3810a87d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:31.222226 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8043fd-a058-4f85-844c-40c3810a87d2 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:31.222508 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8043fd-a058-4f85-844c-40c3810a87d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:31.231361 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8043fd-a058-4f85-844c-40c3810a87d2 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:31.231361 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8043fd-a058-4f85-844c-40c3810a87d2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:31.231361 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8043fd-a058-4f85-844c-40c3810a87d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:31.231361 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8043fd-a058-4f85-844c-40c3810a87d2 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:31.231361 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 451/909] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Jul 11 11:06:31 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:32.279854 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab123556-f999-477e-98b5-9c0a4d4eee39 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:32.280372 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab123556-f999-477e-98b5-9c0a4d4eee39 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:32.280449 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab123556-f999-477e-98b5-9c0a4d4eee39 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:32.282081 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 459/910] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:32.288006 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a659fbc-dbfe-47c8-9660-da0570c8e6f7 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:32.288470 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a659fbc-dbfe-47c8-9660-da0570c8e6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:32.288549 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a659fbc-dbfe-47c8-9660-da0570c8e6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:32.305602 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-6a659fbc-dbfe-47c8-9660-da0570c8e6f7 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:32.306826 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6a659fbc-dbfe-47c8-9660-da0570c8e6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:32.378358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 452/911] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:06:32.402718 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab123556-f999-477e-98b5-9c0a4d4eee39 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:32.486350 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:32.506357 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab123556-f999-477e-98b5-9c0a4d4eee39 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:32.541614 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a647c6-9ad8-4347-848c-bc03e9178278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:32.542678 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a647c6-9ad8-4347-848c-bc03e9178278 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:32.543140 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a647c6-9ad8-4347-848c-bc03e9178278 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:32.543570 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a647c6-9ad8-4347-848c-bc03e9178278 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:32.544369 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a647c6-9ad8-4347-848c-bc03e9178278 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:32.546015 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a647c6-9ad8-4347-848c-bc03e9178278 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:32.559420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-c7a647c6-9ad8-4347-848c-bc03e9178278 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 11:06:32.559420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:32.559420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:06:32.559420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:06:32.559420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:06:32.559420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:06:32.559420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:06:32.559420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:32.559420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 11:06:32.559420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:32.559420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:06:32.559420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:32.559420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:32.559420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:32.559420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:32.559420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:32.560517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:32.560517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:32.560517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:32.560517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:32.560517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:32.560517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:32.560517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:32.560517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:06:32.560517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:06:32.560517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:06:32.560517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:06:32.560517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:32.560517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:32.560517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:32.560517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:32.560517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:32.561549 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:32.561549 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:32.561549 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:32.561549 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:32.561549 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:32.561549 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:32.561549 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:32.561549 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:32.561549 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:32.561549 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:32.561549 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:32.561549 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:06:32.561549 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:32.561549 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 11:06:32.561549 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:32.564211 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 460/912] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Jul 11 11:06:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:32.570270 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a659fbc-dbfe-47c8-9660-da0570c8e6f7 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:32.670476 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a659fbc-dbfe-47c8-9660-da0570c8e6f7 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:32.694158 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:32.705550 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47276d-4aea-404d-aad4-a11354e03ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:32.707268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47276d-4aea-404d-aad4-a11354e03ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:32.707268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47276d-4aea-404d-aad4-a11354e03ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:32.707268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47276d-4aea-404d-aad4-a11354e03ad1 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:32.707834 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47276d-4aea-404d-aad4-a11354e03ad1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:32.708145 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47276d-4aea-404d-aad4-a11354e03ad1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:32.709516 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47276d-4aea-404d-aad4-a11354e03ad1 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:32.714883 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 453/913] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Jul 11 11:06:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:32.720566 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a647c6-9ad8-4347-848c-bc03e9178278 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:32.838353 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a647c6-9ad8-4347-848c-bc03e9178278 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:32.873970 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24ffa5-c48f-4548-862c-4dcf2f530aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:32.874960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24ffa5-c48f-4548-862c-4dcf2f530aff None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:32.875432 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24ffa5-c48f-4548-862c-4dcf2f530aff None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:32.875899 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24ffa5-c48f-4548-862c-4dcf2f530aff None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:32.876790 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24ffa5-c48f-4548-862c-4dcf2f530aff None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:32.877282 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24ffa5-c48f-4548-862c-4dcf2f530aff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:32.879417 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24ffa5-c48f-4548-862c-4dcf2f530aff None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:32.885495 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 461/914] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Jul 11 11:06:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:32.890805 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47276d-4aea-404d-aad4-a11354e03ad1 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:32.996745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47276d-4aea-404d-aad4-a11354e03ad1 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:33.031752 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceec5fd-987f-4eb1-a994-58700c1c9ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:33.032436 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceec5fd-987f-4eb1-a994-58700c1c9ae9 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:33.032723 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceec5fd-987f-4eb1-a994-58700c1c9ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:33.033005 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceec5fd-987f-4eb1-a994-58700c1c9ae9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:33.033753 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceec5fd-987f-4eb1-a994-58700c1c9ae9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:33.035705 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceec5fd-987f-4eb1-a994-58700c1c9ae9 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:33.052516 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a36b8-fe31-4360-898d-1466348051e3 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:33.053089 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a36b8-fe31-4360-898d-1466348051e3 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:33.058706 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a36b8-fe31-4360-898d-1466348051e3 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:33.058706 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 462/915] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:33.060353 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128d107-d036-470e-9ccb-0880e3086d90 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:33.060638 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128d107-d036-470e-9ccb-0880e3086d90 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:33.060915 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128d107-d036-470e-9ccb-0880e3086d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:33.077873 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-a128d107-d036-470e-9ccb-0880e3086d90 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:33.079046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-a128d107-d036-470e-9ccb-0880e3086d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:33.082631 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:33.133606 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 454/916] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Jul 11 11:06:32 2022] POST /identity/v3/endpoints => generated 347 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:06:33.158666 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 463/917] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 11:06:33.181910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceec5fd-987f-4eb1-a994-58700c1c9ae9 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:33.232286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:33.264545 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2724a3a-e87c-4492-8257-7c967b162701 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:33.264858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2724a3a-e87c-4492-8257-7c967b162701 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:33.265120 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2724a3a-e87c-4492-8257-7c967b162701 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:33.267895 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 464/918] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:33.273537 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa668978-2a6c-45ba-a7db-f190a7b83f0d None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:33.273891 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa668978-2a6c-45ba-a7db-f190a7b83f0d None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:33.274143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa668978-2a6c-45ba-a7db-f190a7b83f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:33.296859 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-aa668978-2a6c-45ba-a7db-f190a7b83f0d None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:33.299264 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-aa668978-2a6c-45ba-a7db-f190a7b83f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:33.307187 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceec5fd-987f-4eb1-a994-58700c1c9ae9 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:33.344300 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033c6fa-4567-497e-b216-0d5e1d094357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:33.345286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033c6fa-4567-497e-b216-0d5e1d094357 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:33.345499 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033c6fa-4567-497e-b216-0d5e1d094357 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:33.345804 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033c6fa-4567-497e-b216-0d5e1d094357 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:33.357509 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f033c6fa-4567-497e-b216-0d5e1d094357 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:06:33.366478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-f033c6fa-4567-497e-b216-0d5e1d094357 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 11:06:33.366478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:33.366478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:33.366478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:33.366478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:33.366478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:33.366478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:33.366478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:33.366478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:33.366478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:33.366478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:33.366478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:33.366478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:06:33.366478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:06:33.366478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:06:33.366478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:06:33.367415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:06:33.367415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:06:33.367415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:06:33.367415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:06:33.367415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:33.367415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:33.367415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:33.367415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:33.367415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:33.367415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:33.367415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:33.367415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:33.367415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:33.367415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:33.367415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:33.367415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:33.368249 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:33.368249 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:33.368249 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:33.368249 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:33.368249 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:06:33.368249 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:06:33.368249 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:06:33.368249 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:06:33.368249 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:06:33.368249 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:06:33.368249 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 11:06:33.368249 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:33.368249 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 455/919] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Jul 11 11:06:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:33.369411 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc4bf5-4f56-4f74-8de8-3fec3aa27f16 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:33.369411 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc4bf5-4f56-4f74-8de8-3fec3aa27f16 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:33.369578 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc4bf5-4f56-4f74-8de8-3fec3aa27f16 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:33.370999 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 456/920] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:33.374639 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc4bf5-4f56-4f74-8de8-3fec3aa27f16 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:33.384534 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 465/921] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 11:06:33.384534 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e80423-9d61-4a11-8d40-16387addbd72 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:33.384534 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e80423-9d61-4a11-8d40-16387addbd72 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:33.384534 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e80423-9d61-4a11-8d40-16387addbd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:33.404934 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-38e80423-9d61-4a11-8d40-16387addbd72 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:33.406409 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-38e80423-9d61-4a11-8d40-16387addbd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:33.472910 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:33.479584 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 466/922] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:06:33.482814 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e80423-9d61-4a11-8d40-16387addbd72 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:33.483145 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc4bf5-4f56-4f74-8de8-3fec3aa27f16 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:33.484828 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:33.521107 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33029d-d5c1-4fd0-b985-26a8c9f3738f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:33.521799 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33029d-d5c1-4fd0-b985-26a8c9f3738f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:33.522088 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33029d-d5c1-4fd0-b985-26a8c9f3738f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:33.522365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33029d-d5c1-4fd0-b985-26a8c9f3738f None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:33.523116 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33029d-d5c1-4fd0-b985-26a8c9f3738f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:33.523427 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33029d-d5c1-4fd0-b985-26a8c9f3738f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:33.524790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33029d-d5c1-4fd0-b985-26a8c9f3738f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:33.537964 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 457/923] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Jul 11 11:06:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:33.537964 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33029d-d5c1-4fd0-b985-26a8c9f3738f None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:33.599306 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e80423-9d61-4a11-8d40-16387addbd72 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:33.635650 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc4698-69dd-4114-bc54-1ed684a055e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:33.636369 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc4698-69dd-4114-bc54-1ed684a055e1 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:33.636653 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc4698-69dd-4114-bc54-1ed684a055e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:33.636929 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc4698-69dd-4114-bc54-1ed684a055e1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:33.637117 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33029d-d5c1-4fd0-b985-26a8c9f3738f None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:33.637579 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc4698-69dd-4114-bc54-1ed684a055e1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:33.639384 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc4698-69dd-4114-bc54-1ed684a055e1 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:33.652613 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-0bbc4698-69dd-4114-bc54-1ed684a055e1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 11:06:33.652613 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:33.652613 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:06:33.652613 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:06:33.652613 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:06:33.652613 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:06:33.652613 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:06:33.652613 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:33.652613 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 11:06:33.652613 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:33.652613 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:06:33.652613 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:33.652613 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:33.652613 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:33.652613 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:33.652613 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:33.652613 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:33.653610 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:33.653610 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:33.653610 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:33.653610 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:33.653610 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:33.653610 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:33.653610 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:06:33.653610 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:06:33.653610 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:06:33.653610 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:06:33.653610 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:33.653610 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:33.653610 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:33.653610 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:33.653610 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:33.653610 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:33.654501 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:33.654501 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:33.654501 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:33.654501 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:33.654501 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:33.654501 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:33.654501 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:33.654501 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:33.654501 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:33.654501 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:33.654501 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:06:33.654501 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:33.654501 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 11:06:33.654501 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:33.654501 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 467/924] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jul 11 11:06:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:33.655313 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc4698-69dd-4114-bc54-1ed684a055e1 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:33.681126 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbebfc5-6693-42af-8c23-ff1a41fe8f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:33.681987 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbebfc5-6693-42af-8c23-ff1a41fe8f7f None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:33.682277 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbebfc5-6693-42af-8c23-ff1a41fe8f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:33.682556 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbebfc5-6693-42af-8c23-ff1a41fe8f7f None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:33.683526 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbebfc5-6693-42af-8c23-ff1a41fe8f7f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:33.684896 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbebfc5-6693-42af-8c23-ff1a41fe8f7f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:33.720106 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:33.761255 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc4698-69dd-4114-bc54-1ed684a055e1 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:33.765751 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 458/925] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Jul 11 11:06:33 2022] POST /identity/v3/services => generated 241 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:06:33.766898 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbebfc5-6693-42af-8c23-ff1a41fe8f7f None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:33.804255 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:33.830257 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1e63e-e4df-428d-afe3-2e2c2d9f4916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:33.831858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1e63e-e4df-428d-afe3-2e2c2d9f4916 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:33.832620 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1e63e-e4df-428d-afe3-2e2c2d9f4916 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:33.833122 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1e63e-e4df-428d-afe3-2e2c2d9f4916 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:33.851446 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1e63e-e4df-428d-afe3-2e2c2d9f4916 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:33.854396 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1e63e-e4df-428d-afe3-2e2c2d9f4916 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:33.881305 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-87b1e63e-e4df-428d-afe3-2e2c2d9f4916 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:33.881305 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:33.881305 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:33.881305 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:33.881305 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:33.881305 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:33.881305 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:33.881305 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:33.881305 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:33.881305 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:33.881305 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:33.881305 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:33.881305 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:33.881305 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:33.881305 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:33.882316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:33.882316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:33.882316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:33.882316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:33.882316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:33.882316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:33.882316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:33.882316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:33.882316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:33.882316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:33.882316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:33.882316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:33.882316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:33.882316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:33.882316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:33.882316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:33.882316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:33.883211 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:33.883211 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:33.883211 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:33.883211 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:33.890740 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 468/926] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:33.892789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1e63e-e4df-428d-afe3-2e2c2d9f4916 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:33.907158 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbebfc5-6693-42af-8c23-ff1a41fe8f7f None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:33.952708 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc476dbc-4e73-453d-9555-3fbbd40682c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:33.953381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc476dbc-4e73-453d-9555-3fbbd40682c4 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:33.953663 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc476dbc-4e73-453d-9555-3fbbd40682c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:33.953959 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc476dbc-4e73-453d-9555-3fbbd40682c4 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:33.954678 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc476dbc-4e73-453d-9555-3fbbd40682c4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:33.954969 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc476dbc-4e73-453d-9555-3fbbd40682c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:33.957012 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc476dbc-4e73-453d-9555-3fbbd40682c4 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:33.963629 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 459/927] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jul 11 11:06:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:33.969157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc476dbc-4e73-453d-9555-3fbbd40682c4 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:34.028498 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1e63e-e4df-428d-afe3-2e2c2d9f4916 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:34.046230 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:34.072371 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:34.072587 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8c53c-145b-4d0f-8a3a-12b99e8e3172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:34.073586 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8c53c-145b-4d0f-8a3a-12b99e8e3172 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:34.073586 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8c53c-145b-4d0f-8a3a-12b99e8e3172 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:34.073878 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8c53c-145b-4d0f-8a3a-12b99e8e3172 None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:34.074552 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8c53c-145b-4d0f-8a3a-12b99e8e3172 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:34.074844 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8c53c-145b-4d0f-8a3a-12b99e8e3172 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:34.076213 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8c53c-145b-4d0f-8a3a-12b99e8e3172 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:34.089730 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 469/928] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:34.090561 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc476dbc-4e73-453d-9555-3fbbd40682c4 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:34.095201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8c53c-145b-4d0f-8a3a-12b99e8e3172 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:34.136115 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f35949-e76c-4736-af20-b472fe434231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:34.137682 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f35949-e76c-4736-af20-b472fe434231 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:34.138207 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f35949-e76c-4736-af20-b472fe434231 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:34.138689 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f35949-e76c-4736-af20-b472fe434231 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:34.140096 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f35949-e76c-4736-af20-b472fe434231 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:34.140639 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f35949-e76c-4736-af20-b472fe434231 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:34.142916 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f35949-e76c-4736-af20-b472fe434231 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:34.151009 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 460/929] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jul 11 11:06:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:34.156470 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f35949-e76c-4736-af20-b472fe434231 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:34.223971 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8c53c-145b-4d0f-8a3a-12b99e8e3172 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:34.265860 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f35949-e76c-4736-af20-b472fe434231 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:34.273724 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d983df5-58c5-40b0-b2f1-b6e73e46be09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:34.275371 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d983df5-58c5-40b0-b2f1-b6e73e46be09 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:34.275884 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d983df5-58c5-40b0-b2f1-b6e73e46be09 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:34.276791 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d983df5-58c5-40b0-b2f1-b6e73e46be09 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:34.286742 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d983df5-58c5-40b0-b2f1-b6e73e46be09 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:34.288294 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d983df5-58c5-40b0-b2f1-b6e73e46be09 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:34.303752 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501cb36-0c9c-4092-bcc8-bd5181e14cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:34.304526 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501cb36-0c9c-4092-bcc8-bd5181e14cf4 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:34.304882 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501cb36-0c9c-4092-bcc8-bd5181e14cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:34.305227 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501cb36-0c9c-4092-bcc8-bd5181e14cf4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:34.306060 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501cb36-0c9c-4092-bcc8-bd5181e14cf4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:34.306770 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-8d983df5-58c5-40b0-b2f1-b6e73e46be09 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 11:06:34.306770 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:34.306770 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:34.306770 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:34.306770 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:34.306770 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:34.306770 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:34.306770 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:34.306770 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:34.306770 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:34.306770 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:34.306770 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:34.306770 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:06:34.306770 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:06:34.306770 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:06:34.306770 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:06:34.308201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:34.308201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:34.308201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:06:34.308201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:34.308201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:06:34.308201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:34.308201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:34.308201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:34.308201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:34.308201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:34.308201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:34.308201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:34.308201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:34.308201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:34.308201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:34.308201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:34.308201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:34.308201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:34.309603 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:34.309603 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:34.309603 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:06:34.309603 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:06:34.309603 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:06:34.309603 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:06:34.309603 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:06:34.309603 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:06:34.309603 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 11:06:34.309603 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:34.310277 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501cb36-0c9c-4092-bcc8-bd5181e14cf4 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:34.311244 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 470/930] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Jul 11 11:06:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:34.316584 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d983df5-58c5-40b0-b2f1-b6e73e46be09 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:34.350763 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:34.410475 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 461/931] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Jul 11 11:06:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:06:34.436903 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d983df5-58c5-40b0-b2f1-b6e73e46be09 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:34.483654 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751eaeb3-6b0c-4976-b26c-d446d5b7c5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:34.484340 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751eaeb3-6b0c-4976-b26c-d446d5b7c5c9 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:34.484671 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751eaeb3-6b0c-4976-b26c-d446d5b7c5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:34.484957 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751eaeb3-6b0c-4976-b26c-d446d5b7c5c9 None admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:34.485901 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751eaeb3-6b0c-4976-b26c-d446d5b7c5c9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:34.486221 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751eaeb3-6b0c-4976-b26c-d446d5b7c5c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:34.487698 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751eaeb3-6b0c-4976-b26c-d446d5b7c5c9 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:34.508334 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 471/932] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Jul 11 11:06:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:34.514126 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501cb36-0c9c-4092-bcc8-bd5181e14cf4 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:34.527609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:34.625070 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501cb36-0c9c-4092-bcc8-bd5181e14cf4 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:34.659393 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc01a3-6683-490c-9ea9-e7f093e36e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:34.660589 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc01a3-6683-490c-9ea9-e7f093e36e26 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:34.661070 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc01a3-6683-490c-9ea9-e7f093e36e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:34.661541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc01a3-6683-490c-9ea9-e7f093e36e26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:34.672609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc01a3-6683-490c-9ea9-e7f093e36e26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:34.674916 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc01a3-6683-490c-9ea9-e7f093e36e26 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:34.693718 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-ffcc01a3-6683-490c-9ea9-e7f093e36e26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:34.693718 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:34.693718 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:34.693718 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:34.693718 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:34.693718 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:34.693718 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:34.693718 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:34.693718 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:34.693718 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:34.693718 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:34.693718 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:34.693718 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:34.693718 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:34.693718 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:34.694666 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:34.694666 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:34.694666 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:34.694666 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:34.694666 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:34.694666 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:34.694666 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:34.694666 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:34.694666 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:34.694666 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:34.694666 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:34.694666 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:34.694666 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:34.694666 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:34.694666 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:34.694666 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:34.694666 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:34.695639 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:34.695639 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:34.695639 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:34.695639 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:34.701859 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 462/933] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:34.704200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751eaeb3-6b0c-4976-b26c-d446d5b7c5c9 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:34.793812 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:34.813470 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751eaeb3-6b0c-4976-b26c-d446d5b7c5c9 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:34.849351 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d1475-ce32-4b52-979d-e663afefac1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:34.850048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d1475-ce32-4b52-979d-e663afefac1c None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:34.850334 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d1475-ce32-4b52-979d-e663afefac1c None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:34.850610 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d1475-ce32-4b52-979d-e663afefac1c None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:34.851338 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d1475-ce32-4b52-979d-e663afefac1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:34.851646 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d1475-ce32-4b52-979d-e663afefac1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:34.853012 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d1475-ce32-4b52-979d-e663afefac1c None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:34.865778 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 472/934] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:34.871331 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc01a3-6683-490c-9ea9-e7f093e36e26 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:34.937199 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:34.985353 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc01a3-6683-490c-9ea9-e7f093e36e26 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:35.024999 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb2c42-8885-46d0-af21-2e213724c631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:35.025817 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb2c42-8885-46d0-af21-2e213724c631 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:35.026105 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb2c42-8885-46d0-af21-2e213724c631 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:35.026383 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb2c42-8885-46d0-af21-2e213724c631 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:35.033454 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb2c42-8885-46d0-af21-2e213724c631 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:35.035561 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb2c42-8885-46d0-af21-2e213724c631 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:35.050326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-49fb2c42-8885-46d0-af21-2e213724c631 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:35.050326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:35.050326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:35.050326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:35.050326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:35.050326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:35.050326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:35.050326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:35.050326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:35.050326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:35.050326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:35.050326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:35.050326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:06:35.050326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:06:35.050326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:06:35.051251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:06:35.051251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:35.051251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:35.051251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:35.051251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:35.051251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:35.051251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:35.051251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:35.051251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:35.051251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:35.051251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:35.051251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:35.051251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:35.051251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:35.051251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:35.051251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:35.051251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:35.052137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:06:35.052137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:06:35.052137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:06:35.052137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:06:35.052137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:06:35.052137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:06:35.052137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:35.052137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:35.052137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 463/935] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:06:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:35.057643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d1475-ce32-4b52-979d-e663afefac1c None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:35.164210 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d1475-ce32-4b52-979d-e663afefac1c None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:35.199536 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62995547-f002-4d61-823d-fe7d062c4dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:35.200124 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62995547-f002-4d61-823d-fe7d062c4dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:35.200410 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62995547-f002-4d61-823d-fe7d062c4dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:35.200686 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62995547-f002-4d61-823d-fe7d062c4dd6 None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:35.201469 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62995547-f002-4d61-823d-fe7d062c4dd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:35.201796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62995547-f002-4d61-823d-fe7d062c4dd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:35.203224 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62995547-f002-4d61-823d-fe7d062c4dd6 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:35.216316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 473/936] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:06:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:35.222824 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb2c42-8885-46d0-af21-2e213724c631 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:35.294239 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015b54f-b383-4a9d-9e35-3000386c6d06 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:35.294558 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015b54f-b383-4a9d-9e35-3000386c6d06 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:35.294810 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015b54f-b383-4a9d-9e35-3000386c6d06 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:35.296643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 474/937] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:35.302020 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf93c97-cec2-4046-afed-9963f0073715 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:35.302315 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf93c97-cec2-4046-afed-9963f0073715 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:35.302599 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf93c97-cec2-4046-afed-9963f0073715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:35.310824 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:35.323363 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-7cf93c97-cec2-4046-afed-9963f0073715 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:35.324632 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-7cf93c97-cec2-4046-afed-9963f0073715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:35.334434 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb2c42-8885-46d0-af21-2e213724c631 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:35.361723 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:35.380863 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ef15a-f21f-4de8-978e-151c473a5b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:35.382169 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ef15a-f21f-4de8-978e-151c473a5b31 None admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:35.382674 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ef15a-f21f-4de8-978e-151c473a5b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:35.383701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ef15a-f21f-4de8-978e-151c473a5b31 None admin] PATH_INFO: `/v3/projects/38ed7416526e473b816330e24acf7a04/users/cdfa8f4012c2471b81f8749b013d3117/roles/4418ec5b68a244968638f90e957b5163` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:35.387708 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ef15a-f21f-4de8-978e-151c473a5b31 None admin] RBAC: Authorizing `identity:create_grant(project_id=38ed7416526e473b816330e24acf7a04, user_id=cdfa8f4012c2471b81f8749b013d3117, role_id=4418ec5b68a244968638f90e957b5163)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:35.389894 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ef15a-f21f-4de8-978e-151c473a5b31 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:35.399614 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 475/938] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 11:06:35.421507 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf93c97-cec2-4046-afed-9963f0073715 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:35.468019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 464/939] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jul 11 11:06:35 2022] PUT /identity/v3/projects/38ed7416526e473b816330e24acf7a04/users/cdfa8f4012c2471b81f8749b013d3117/roles/4418ec5b68a244968638f90e957b5163 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:06:35.541328 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf93c97-cec2-4046-afed-9963f0073715 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:35.576351 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:35.583176 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53232a2e-f524-45aa-a7f1-a99095bbac07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:35.584074 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53232a2e-f524-45aa-a7f1-a99095bbac07 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:35.584361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53232a2e-f524-45aa-a7f1-a99095bbac07 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:35.584636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53232a2e-f524-45aa-a7f1-a99095bbac07 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:35.585375 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53232a2e-f524-45aa-a7f1-a99095bbac07 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:35.587079 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53232a2e-f524-45aa-a7f1-a99095bbac07 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:35.600072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-53232a2e-f524-45aa-a7f1-a99095bbac07 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 11:06:35.600072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:35.600072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:06:35.600072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:06:35.600072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:06:35.600072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:06:35.600072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:06:35.600072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:35.600072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 11:06:35.600072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:35.600072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:06:35.600072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:35.600072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:35.600072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:35.600072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:35.600072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:35.600072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:35.601104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:35.601104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:35.601104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:35.601104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:35.601104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:35.601104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:35.601104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:06:35.601104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:06:35.601104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:06:35.601104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:06:35.601104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:35.601104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:35.601104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:35.601104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:35.601104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:35.601104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:35.601944 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:35.601944 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:35.601944 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:35.601944 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:35.601944 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:35.601944 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:35.601944 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:35.601944 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:35.601944 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:35.601944 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:35.601944 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:06:35.601944 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:35.601944 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 11:06:35.601944 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:35.601944 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 476/940] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:06:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:35.607883 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ef15a-f21f-4de8-978e-151c473a5b31 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:35.720467 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ef15a-f21f-4de8-978e-151c473a5b31 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:35.756051 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c1bf4-b7a6-452d-b7e8-2241f60e880d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:35.756719 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c1bf4-b7a6-452d-b7e8-2241f60e880d None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:35.757003 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c1bf4-b7a6-452d-b7e8-2241f60e880d None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:35.767876 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c1bf4-b7a6-452d-b7e8-2241f60e880d None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:35.768744 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c1bf4-b7a6-452d-b7e8-2241f60e880d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:35.769066 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c1bf4-b7a6-452d-b7e8-2241f60e880d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:35.770489 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c1bf4-b7a6-452d-b7e8-2241f60e880d None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:35.776374 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 465/941] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Jul 11 11:06:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:35.782155 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53232a2e-f524-45aa-a7f1-a99095bbac07 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:35.885303 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53232a2e-f524-45aa-a7f1-a99095bbac07 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:35.920273 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686594b-ea48-4887-ac56-27aced97d7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:35.920949 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686594b-ea48-4887-ac56-27aced97d7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:35.921239 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686594b-ea48-4887-ac56-27aced97d7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:35.921487 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87205a8-5b24-4504-a1c1-9922fa590974 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:35.921597 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686594b-ea48-4887-ac56-27aced97d7d8 None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:35.921800 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87205a8-5b24-4504-a1c1-9922fa590974 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:35.922084 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87205a8-5b24-4504-a1c1-9922fa590974 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:35.922248 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686594b-ea48-4887-ac56-27aced97d7d8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:35.922547 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686594b-ea48-4887-ac56-27aced97d7d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:35.923915 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686594b-ea48-4887-ac56-27aced97d7d8 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:35.925065 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 466/942] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:06:35.929127 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b7b99-1b09-4f7f-b42d-edf181bc9be8 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:35.929255 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 477/943] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Jul 11 11:06:35 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:35.929474 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b7b99-1b09-4f7f-b42d-edf181bc9be8 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:35.929771 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b7b99-1b09-4f7f-b42d-edf181bc9be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:35.948633 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-903b7b99-1b09-4f7f-b42d-edf181bc9be8 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:35.949927 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-903b7b99-1b09-4f7f-b42d-edf181bc9be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:35.999405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:36.033940 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 467/944] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 11:06:36.054232 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686594b-ea48-4887-ac56-27aced97d7d8 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:36.126980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:36.166340 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686594b-ea48-4887-ac56-27aced97d7d8 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:36.201103 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924ccba-3fef-4776-b558-89e8e4eef131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:36.201946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924ccba-3fef-4776-b558-89e8e4eef131 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:36.202237 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924ccba-3fef-4776-b558-89e8e4eef131 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:36.202517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924ccba-3fef-4776-b558-89e8e4eef131 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:36.203171 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924ccba-3fef-4776-b558-89e8e4eef131 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:36.204551 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924ccba-3fef-4776-b558-89e8e4eef131 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:36.217785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-7924ccba-3fef-4776-b558-89e8e4eef131 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 11:06:36.217785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:36.217785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:06:36.217785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:06:36.217785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:06:36.217785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:06:36.217785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:06:36.217785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:36.217785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 11:06:36.217785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:36.217785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:06:36.217785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:36.217785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:36.217785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:36.217785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:36.217785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:36.217785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:36.218803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:36.218803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:36.218803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:36.218803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:36.218803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:36.218803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:36.218803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:06:36.218803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:06:36.218803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:06:36.218803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:06:36.218803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:36.218803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:36.218803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:36.218803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:36.218803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:36.218803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:36.219622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:36.219622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:36.219622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:36.219622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:36.219622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:36.219622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:36.219622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:36.219622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:36.219622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:36.219622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:36.219622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:06:36.219622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:36.219622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 11:06:36.219622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:36.219622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 478/945] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Jul 11 11:06:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:36.225620 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b7b99-1b09-4f7f-b42d-edf181bc9be8 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:36.330017 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b7b99-1b09-4f7f-b42d-edf181bc9be8 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:36.366060 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811e569-5ca8-41d1-beb6-9f5320675ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:36.366836 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811e569-5ca8-41d1-beb6-9f5320675ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:36.366993 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811e569-5ca8-41d1-beb6-9f5320675ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:36.367350 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811e569-5ca8-41d1-beb6-9f5320675ec9 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:36.369348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e811e569-5ca8-41d1-beb6-9f5320675ec9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:36.369348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e811e569-5ca8-41d1-beb6-9f5320675ec9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:36.374580 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e811e569-5ca8-41d1-beb6-9f5320675ec9 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:36.380414 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 468/946] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Jul 11 11:06:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:36.381787 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924ccba-3fef-4776-b558-89e8e4eef131 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:36.487665 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924ccba-3fef-4776-b558-89e8e4eef131 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:36.511976 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:36.523405 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d80be6-e63f-4f55-bc30-81256065c101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:36.527542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d80be6-e63f-4f55-bc30-81256065c101 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:36.527542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d80be6-e63f-4f55-bc30-81256065c101 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:36.527542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d80be6-e63f-4f55-bc30-81256065c101 None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:36.527542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d80be6-e63f-4f55-bc30-81256065c101 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:36.527542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d80be6-e63f-4f55-bc30-81256065c101 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:36.527542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d80be6-e63f-4f55-bc30-81256065c101 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:36.537795 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 479/947] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Jul 11 11:06:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:36.539158 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811e569-5ca8-41d1-beb6-9f5320675ec9 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:36.582259 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:36.609106 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008cb1d-209d-48c0-b706-1be7d1f1c19d None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:36.609425 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008cb1d-209d-48c0-b706-1be7d1f1c19d None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:36.609843 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008cb1d-209d-48c0-b706-1be7d1f1c19d None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:36.611475 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 480/948] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:06:36.616570 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae8a63-d78e-4c71-89d1-4a1a4fa92bbe None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:36.616863 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae8a63-d78e-4c71-89d1-4a1a4fa92bbe None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:36.617150 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae8a63-d78e-4c71-89d1-4a1a4fa92bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:36.636222 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-54ae8a63-d78e-4c71-89d1-4a1a4fa92bbe None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:36.637463 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-54ae8a63-d78e-4c71-89d1-4a1a4fa92bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:36.646204 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811e569-5ca8-41d1-beb6-9f5320675ec9 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:36.685153 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe6b5a-8ece-4bb5-adc2-35ba06b3518f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:36.686113 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe6b5a-8ece-4bb5-adc2-35ba06b3518f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:36.686401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe6b5a-8ece-4bb5-adc2-35ba06b3518f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:36.687714 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe6b5a-8ece-4bb5-adc2-35ba06b3518f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:36.688524 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe6b5a-8ece-4bb5-adc2-35ba06b3518f None admin] RBAC: Adding query filter params (interface=public, service_id=8694ef4703df4687a6931ae5a33528a3, region_id=RegionOne) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:36.688847 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe6b5a-8ece-4bb5-adc2-35ba06b3518f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:36.690833 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe6b5a-8ece-4bb5-adc2-35ba06b3518f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:36.699865 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 469/949] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Jul 11 11:06:36 2022] GET /identity/v3/endpoints?service_id=8694ef4703df4687a6931ae5a33528a3&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:36.704901 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe6b5a-8ece-4bb5-adc2-35ba06b3518f None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:36.733053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 481/950] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 11:06:36.752149 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae8a63-d78e-4c71-89d1-4a1a4fa92bbe None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:36.817030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe6b5a-8ece-4bb5-adc2-35ba06b3518f None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:36.818609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:36.853757 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114711f7-ee08-4fcd-9bdd-a854fd3833c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:36.854446 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114711f7-ee08-4fcd-9bdd-a854fd3833c3 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:36.854733 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114711f7-ee08-4fcd-9bdd-a854fd3833c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:36.855014 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114711f7-ee08-4fcd-9bdd-a854fd3833c3 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:36.855694 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114711f7-ee08-4fcd-9bdd-a854fd3833c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:36.857056 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114711f7-ee08-4fcd-9bdd-a854fd3833c3 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:36.864575 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae8a63-d78e-4c71-89d1-4a1a4fa92bbe None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:36.869952 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 470/951] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Jul 11 11:06:36 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:06:36.884965 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:36.907643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061caf2-a6fb-4ce9-932b-c8a69a606204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:36.908592 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061caf2-a6fb-4ce9-932b-c8a69a606204 None admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:36.909119 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061caf2-a6fb-4ce9-932b-c8a69a606204 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:36.909577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061caf2-a6fb-4ce9-932b-c8a69a606204 None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:36.910522 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061caf2-a6fb-4ce9-932b-c8a69a606204 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:36.912170 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061caf2-a6fb-4ce9-932b-c8a69a606204 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:36.914014 dv-cinder-848429-2-smb devstack@keystone.service[80522]: WARNING keystone.server.flask.common [None req-4061caf2-a6fb-4ce9-932b-c8a69a606204 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 11 11:06:36.967860 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.sql.core [None req-4061caf2-a6fb-4ce9-932b-c8a69a606204 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 11:06:36.967860 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 11 11:06:36.967860 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [parameters: {'id': 'e4bc7a62f523403eb6c31d38cb6c85d4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 11 11:06:36.967860 dv-cinder-848429-2-smb devstack@keystone.service[80522]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80522) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 11:06:36.977738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-4061caf2-a6fb-4ce9-932b-c8a69a606204 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e4bc7a62f523403eb6c31d38cb6c85d4.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e4bc7a62f523403eb6c31d38cb6c85d4. Jul 11 11:06:36.977738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:36.977738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 11:06:36.977738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 11:06:36.977738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 11:06:36.977738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 11:06:36.977738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 11:06:36.977738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 11:06:36.977738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 11:06:36.977738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application conn.query(q) Jul 11 11:06:36.977738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 11:06:36.977738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 11:06:36.977738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 11:06:36.978856 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application result.read() Jul 11 11:06:36.978856 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 11:06:36.978856 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 11:06:36.978856 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 11:06:36.978856 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 11:06:36.978856 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 11:06:36.978856 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 11:06:36.978856 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 11:06:36.978856 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 11:06:36.978856 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 11:06:36.978856 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:36.978856 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 11:06:36.978856 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:36.978856 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:36.978856 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 11:06:36.978856 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 11:06:36.978856 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 11 11:06:36.978856 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 11 11:06:36.980048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 11:06:36.980048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application next(self.gen) Jul 11 11:06:36.980048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 11:06:36.980048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application yield resource Jul 11 11:06:36.980048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 11:06:36.980048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application next(self.gen) Jul 11 11:06:36.980048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 11:06:36.980048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 11:06:36.980048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 11:06:36.980048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 11:06:36.980048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 11:06:36.980048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise self.value Jul 11 11:06:36.980048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 11:06:36.980048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 11:06:36.980048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 11:06:36.980048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application session.commit() Jul 11 11:06:36.980048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 11:06:36.981186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 11:06:36.981186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 11:06:36.981186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 11:06:36.981186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 11:06:36.981186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self.session.flush() Jul 11 11:06:36.981186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 11:06:36.981186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 11:06:36.981186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 11:06:36.981186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 11:06:36.981186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 11:06:36.981186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application compat.raise_( Jul 11 11:06:36.981186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 11:06:36.981186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception Jul 11 11:06:36.981186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 11:06:36.981186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 11:06:36.981186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 11:06:36.981186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 11:06:36.982345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 11:06:36.982345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 11:06:36.982345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 11:06:36.982345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 11:06:36.982345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 11 11:06:36.982345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 11 11:06:36.982345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 11:06:36.982345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 11:06:36.982345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 11:06:36.982345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 11:06:36.982345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 11:06:36.982345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 11:06:36.982345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 11:06:36.982345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 11:06:36.982345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 11:06:36.983200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 11:06:36.983200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 11:06:36.983200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception Jul 11 11:06:36.983200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 11:06:36.983200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 11:06:36.983200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 11:06:36.983200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 11:06:36.983200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 11:06:36.983200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 11:06:36.983200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 11:06:36.983200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application conn.query(q) Jul 11 11:06:36.983200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 11:06:36.983200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 11:06:36.983200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 11:06:36.983200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application result.read() Jul 11 11:06:36.983200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 11:06:36.983200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 11:06:36.984073 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 11:06:36.984073 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 11:06:36.984073 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 11:06:36.984073 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 11:06:36.984073 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 11:06:36.984073 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 11:06:36.984073 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 11:06:36.984073 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 11 11:06:36.984073 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [parameters: {'id': 'e4bc7a62f523403eb6c31d38cb6c85d4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 11 11:06:36.984073 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 11:06:36.984073 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:36.984073 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:06:36.984073 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:36.984073 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:36.984073 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 11 11:06:36.984858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 11 11:06:36.984858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 11:06:36.984858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 11:06:36.984858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 11 11:06:36.984858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:36.984858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:06:36.984858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:36.984858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:36.984858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:36.984858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:36.984858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:36.984858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:36.984858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:36.984858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:36.984858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:36.984858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:36.984858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:36.986111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:36.986111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 11 11:06:36.986111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 11 11:06:36.986111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:36.986111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:36.986111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 11 11:06:36.986111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 11 11:06:36.986111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e4bc7a62f523403eb6c31d38cb6c85d4. Jul 11 11:06:36.986111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:36.989542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 482/952] 10.222.0.23 () {60 vars in 1140 bytes} [Mon Jul 11 11:06:36 2022] POST /identity/v3/projects => generated 262 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:36.996020 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114711f7-ee08-4fcd-9bdd-a854fd3833c3 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:37.103449 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114711f7-ee08-4fcd-9bdd-a854fd3833c3 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:37.140401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd33608-9ef6-45d3-a4b1-eb219a414ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:37.141116 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd33608-9ef6-45d3-a4b1-eb219a414ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:37.141403 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd33608-9ef6-45d3-a4b1-eb219a414ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:37.141687 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd33608-9ef6-45d3-a4b1-eb219a414ae9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:37.149454 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd33608-9ef6-45d3-a4b1-eb219a414ae9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:37.150979 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd33608-9ef6-45d3-a4b1-eb219a414ae9 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:37.166532 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-afd33608-9ef6-45d3-a4b1-eb219a414ae9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:37.166532 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:37.166532 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:37.166532 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:37.166532 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:37.166532 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:37.166532 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:37.166532 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:37.166532 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:37.166532 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:37.166532 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:37.166532 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:37.166532 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:06:37.166532 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:06:37.166532 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:06:37.168323 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:06:37.168323 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:37.168323 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:37.168323 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:37.168323 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:37.168323 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:37.168323 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:37.168323 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:37.168323 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:37.168323 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:37.168323 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:37.168323 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:37.168323 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:37.168323 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:37.168323 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:37.168323 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:37.168323 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:37.169490 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:06:37.169490 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:06:37.169490 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:06:37.169490 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:06:37.169490 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:06:37.169490 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:06:37.169490 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:37.169490 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:37.169490 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 471/953] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:06:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:37.177662 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061caf2-a6fb-4ce9-932b-c8a69a606204 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:37.289048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061caf2-a6fb-4ce9-932b-c8a69a606204 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:37.325033 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf7844-5779-4e87-9bc8-d1951f9fd255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:37.325700 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf7844-5779-4e87-9bc8-d1951f9fd255 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:37.326019 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf7844-5779-4e87-9bc8-d1951f9fd255 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:37.326290 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf7844-5779-4e87-9bc8-d1951f9fd255 None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:37.327050 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf7844-5779-4e87-9bc8-d1951f9fd255 None admin] RBAC: Adding query filter params (name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:37.327357 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf7844-5779-4e87-9bc8-d1951f9fd255 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:37.328982 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf7844-5779-4e87-9bc8-d1951f9fd255 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:37.350531 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 483/954] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Jul 11 11:06:37 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:37.708416 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbec39-86c9-4ccc-8623-83390ed84717 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:37.708942 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbec39-86c9-4ccc-8623-83390ed84717 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:37.708942 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbec39-86c9-4ccc-8623-83390ed84717 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:37.710615 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 472/955] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:37.715852 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e1f6c-8b03-4d29-9ff5-59dce9ca29fd None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:37.716266 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e1f6c-8b03-4d29-9ff5-59dce9ca29fd None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:37.716437 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e1f6c-8b03-4d29-9ff5-59dce9ca29fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:37.734311 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-0d6e1f6c-8b03-4d29-9ff5-59dce9ca29fd None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:37.735805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-0d6e1f6c-8b03-4d29-9ff5-59dce9ca29fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:37.776476 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:37.820688 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 484/956] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:06:37.845213 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dbec39-86c9-4ccc-8623-83390ed84717 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:37.876922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:37.960491 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dbec39-86c9-4ccc-8623-83390ed84717 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:37.997734 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cbe08-8103-482f-81a1-d8d31af1041f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:37.998624 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cbe08-8103-482f-81a1-d8d31af1041f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:37.998906 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cbe08-8103-482f-81a1-d8d31af1041f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:37.999181 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cbe08-8103-482f-81a1-d8d31af1041f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:38.012870 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5cbe08-8103-482f-81a1-d8d31af1041f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:06:38.025986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-be5cbe08-8103-482f-81a1-d8d31af1041f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 11:06:38.025986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:38.025986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:38.025986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:38.025986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:38.025986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:38.025986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:38.025986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:38.025986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:38.025986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:38.025986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:38.025986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:38.025986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:06:38.025986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:06:38.025986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:06:38.025986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:06:38.027030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:06:38.027030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:06:38.027030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:06:38.027030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:06:38.027030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:38.027030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:38.027030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:38.027030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:38.027030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:38.027030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:38.027030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:38.027030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:38.027030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:38.027030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:38.027030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:38.027030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:38.027967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:38.027967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:38.027967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:38.027967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:38.027967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:06:38.027967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:06:38.027967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:06:38.027967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:06:38.027967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:06:38.027967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:06:38.027967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 11:06:38.027967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:38.029209 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 473/957] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Jul 11 11:06:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:38.035226 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e1f6c-8b03-4d29-9ff5-59dce9ca29fd None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:38.128587 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f53572-b2b9-42b1-baff-9238124df2a2 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:38.128936 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f53572-b2b9-42b1-baff-9238124df2a2 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:38.129233 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f53572-b2b9-42b1-baff-9238124df2a2 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:38.130886 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 474/958] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:38.138564 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302a80f-738e-47f4-996f-a6a8c53424f6 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:38.138853 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302a80f-738e-47f4-996f-a6a8c53424f6 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:38.139139 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302a80f-738e-47f4-996f-a6a8c53424f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:38.146138 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e1f6c-8b03-4d29-9ff5-59dce9ca29fd None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:38.156396 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-1302a80f-738e-47f4-996f-a6a8c53424f6 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:38.157603 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1302a80f-738e-47f4-996f-a6a8c53424f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:38.199341 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9f1fa-2798-4532-8496-daa15aee851e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:38.200045 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9f1fa-2798-4532-8496-daa15aee851e None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:38.200308 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9f1fa-2798-4532-8496-daa15aee851e None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:38.200585 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9f1fa-2798-4532-8496-daa15aee851e None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:38.201340 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9f1fa-2798-4532-8496-daa15aee851e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:38.201652 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9f1fa-2798-4532-8496-daa15aee851e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:38.203178 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9f1fa-2798-4532-8496-daa15aee851e None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:38.213099 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 485/959] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Jul 11 11:06:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:38.218882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9f1fa-2798-4532-8496-daa15aee851e None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:38.243048 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 475/960] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:06:38.271137 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:38.274548 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302a80f-738e-47f4-996f-a6a8c53424f6 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:38.304105 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:38.380663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9f1fa-2798-4532-8496-daa15aee851e None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:38.410634 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302a80f-738e-47f4-996f-a6a8c53424f6 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:38.423950 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb33bc7-fa42-498c-ae04-9a77e21ad683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:38.425479 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb33bc7-fa42-498c-ae04-9a77e21ad683 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:38.425930 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb33bc7-fa42-498c-ae04-9a77e21ad683 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:38.426241 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb33bc7-fa42-498c-ae04-9a77e21ad683 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:38.445233 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb33bc7-fa42-498c-ae04-9a77e21ad683 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:38.448763 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb33bc7-fa42-498c-ae04-9a77e21ad683 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:38.453094 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cf39d-b859-4dc1-8a5b-1a95d4a6928e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:38.454162 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cf39d-b859-4dc1-8a5b-1a95d4a6928e None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:38.454650 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cf39d-b859-4dc1-8a5b-1a95d4a6928e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:38.455107 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cf39d-b859-4dc1-8a5b-1a95d4a6928e None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:38.457017 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44cf39d-b859-4dc1-8a5b-1a95d4a6928e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:38.459011 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44cf39d-b859-4dc1-8a5b-1a95d4a6928e None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:38.474053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-fbb33bc7-fa42-498c-ae04-9a77e21ad683 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:38.474053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:38.474053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:38.474053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:38.474053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:38.474053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:38.474053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:38.474053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:38.474053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:38.474053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:38.474053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:38.474053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:38.474053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:38.474053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:38.474053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:38.474975 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:38.474975 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:38.474975 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:38.474975 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:38.474975 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:38.474975 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:38.474975 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:38.474975 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:38.474975 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:38.474975 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:38.474975 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:38.474975 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:38.474975 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:38.474975 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:38.474975 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:38.474975 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:38.474975 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:38.476285 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:38.476285 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:38.476285 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:38.476285 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:38.476285 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 486/961] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:38.481819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb33bc7-fa42-498c-ae04-9a77e21ad683 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:38.545064 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 476/962] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Jul 11 11:06:38 2022] POST /identity/v3/services => generated 242 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:06:38.595504 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:38.631914 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb33bc7-fa42-498c-ae04-9a77e21ad683 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:38.686330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a0007-cfeb-456b-acdb-705db58925ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:38.687421 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a0007-cfeb-456b-acdb-705db58925ca None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:38.687880 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a0007-cfeb-456b-acdb-705db58925ca None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:38.688326 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a0007-cfeb-456b-acdb-705db58925ca None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:38.689625 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a0007-cfeb-456b-acdb-705db58925ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:38.690251 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a0007-cfeb-456b-acdb-705db58925ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:38.691740 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a0007-cfeb-456b-acdb-705db58925ca None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:38.705135 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 487/963] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:38.711805 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cf39d-b859-4dc1-8a5b-1a95d4a6928e None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:38.819867 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:38.845181 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cf39d-b859-4dc1-8a5b-1a95d4a6928e None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:38.898010 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adda467-0fe4-458f-9b42-eb719532111c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:38.898010 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adda467-0fe4-458f-9b42-eb719532111c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:38.898010 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adda467-0fe4-458f-9b42-eb719532111c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:38.898010 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adda467-0fe4-458f-9b42-eb719532111c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:38.906238 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adda467-0fe4-458f-9b42-eb719532111c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:38.907860 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adda467-0fe4-458f-9b42-eb719532111c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:38.924247 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-0adda467-0fe4-458f-9b42-eb719532111c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 11:06:38.924247 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:38.924247 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:38.924247 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:38.924247 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:38.924247 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:38.924247 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:38.924247 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:38.924247 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:38.924247 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:38.924247 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:38.924247 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:38.924247 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:06:38.924247 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:06:38.924247 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:06:38.924247 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:06:38.926120 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:38.926120 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:38.926120 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:06:38.926120 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:38.926120 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:06:38.926120 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:38.926120 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:38.926120 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:38.926120 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:38.926120 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:38.926120 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:38.926120 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:38.926120 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:38.926120 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:38.926120 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:38.926120 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:38.926120 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:38.926120 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:38.927261 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:38.927261 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:38.927261 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:06:38.927261 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:06:38.927261 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:06:38.927261 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:06:38.927261 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:06:38.927261 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:06:38.927261 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 11:06:38.927261 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:38.929573 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 477/964] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Jul 11 11:06:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:38.935273 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a0007-cfeb-456b-acdb-705db58925ca None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:39.013884 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf75323-84dc-46a2-a08d-cc831b0cd868 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:39.014078 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf75323-84dc-46a2-a08d-cc831b0cd868 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:39.014359 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf75323-84dc-46a2-a08d-cc831b0cd868 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:39.016036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 478/965] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:39.022233 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab7fe8-7a56-4293-aed2-9d9b0154bd6a None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:39.022640 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab7fe8-7a56-4293-aed2-9d9b0154bd6a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:39.023043 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab7fe8-7a56-4293-aed2-9d9b0154bd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:39.041629 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-4fab7fe8-7a56-4293-aed2-9d9b0154bd6a None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:39.043176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4fab7fe8-7a56-4293-aed2-9d9b0154bd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:39.052758 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a0007-cfeb-456b-acdb-705db58925ca None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:39.088527 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df9a6e-d9dd-4849-b42b-48baf5e6597c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:39.089480 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df9a6e-d9dd-4849-b42b-48baf5e6597c None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:39.089946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df9a6e-d9dd-4849-b42b-48baf5e6597c None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:39.090385 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df9a6e-d9dd-4849-b42b-48baf5e6597c None admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:39.091239 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df9a6e-d9dd-4849-b42b-48baf5e6597c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:39.091554 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df9a6e-d9dd-4849-b42b-48baf5e6597c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:39.092994 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df9a6e-d9dd-4849-b42b-48baf5e6597c None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:39.094989 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:39.113806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 488/966] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Jul 11 11:06:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:39.119775 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df9a6e-d9dd-4849-b42b-48baf5e6597c None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:39.137891 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 479/967] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 11:06:39.154720 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab7fe8-7a56-4293-aed2-9d9b0154bd6a None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:39.227474 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:39.248151 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df9a6e-d9dd-4849-b42b-48baf5e6597c None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:39.264645 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab7fe8-7a56-4293-aed2-9d9b0154bd6a None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:39.294701 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668fccc-d96e-4c56-9af5-7a18d05f35d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:39.296023 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668fccc-d96e-4c56-9af5-7a18d05f35d1 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:39.296754 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668fccc-d96e-4c56-9af5-7a18d05f35d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:39.297185 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668fccc-d96e-4c56-9af5-7a18d05f35d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:39.304444 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7276e-57b8-4f93-9e48-0c5d19499e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:39.305326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7276e-57b8-4f93-9e48-0c5d19499e42 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:39.305684 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7276e-57b8-4f93-9e48-0c5d19499e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:39.306045 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7276e-57b8-4f93-9e48-0c5d19499e42 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:39.306775 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7276e-57b8-4f93-9e48-0c5d19499e42 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:39.308934 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7276e-57b8-4f93-9e48-0c5d19499e42 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:39.322919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-9fd7276e-57b8-4f93-9e48-0c5d19499e42 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 11:06:39.322919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:39.322919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:06:39.322919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:06:39.322919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:06:39.322919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:06:39.322919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:06:39.322919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:39.322919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 11:06:39.322919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:39.322919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:06:39.322919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:39.322919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:39.322919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:39.322919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:39.322919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:39.322919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:39.324208 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:39.324208 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:39.324208 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:39.324208 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:39.324208 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:39.324208 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:39.324208 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:06:39.324208 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:06:39.324208 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:06:39.324208 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:06:39.324208 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:39.324208 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:39.324208 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:39.324208 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:39.324208 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:39.324208 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:39.325348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:39.325348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:39.325348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:39.325348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:39.325348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:39.325348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:39.325348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:39.325348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:39.325348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:39.325348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:39.325348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:06:39.325348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:39.325348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 11:06:39.325348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:39.331800 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 480/968] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Jul 11 11:06:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:39.332786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7276e-57b8-4f93-9e48-0c5d19499e42 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:39.385357 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:39.395478 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668fccc-d96e-4c56-9af5-7a18d05f35d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:39.396939 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668fccc-d96e-4c56-9af5-7a18d05f35d1 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:39.445253 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7276e-57b8-4f93-9e48-0c5d19499e42 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:39.475919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:39.482334 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805d2b7-b13f-405c-80bb-81c8de49b460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:39.483246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805d2b7-b13f-405c-80bb-81c8de49b460 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:39.483770 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805d2b7-b13f-405c-80bb-81c8de49b460 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:39.484310 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805d2b7-b13f-405c-80bb-81c8de49b460 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:39.485222 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805d2b7-b13f-405c-80bb-81c8de49b460 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:39.485698 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805d2b7-b13f-405c-80bb-81c8de49b460 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:39.487931 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805d2b7-b13f-405c-80bb-81c8de49b460 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:39.498123 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 481/969] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Jul 11 11:06:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:39.499277 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805d2b7-b13f-405c-80bb-81c8de49b460 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:39.504831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 489/970] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:06:39 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 11:06:39.510036 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668fccc-d96e-4c56-9af5-7a18d05f35d1 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:39.603508 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805d2b7-b13f-405c-80bb-81c8de49b460 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:39.619821 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:39.628248 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668fccc-d96e-4c56-9af5-7a18d05f35d1 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:39.642773 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581af37-24f7-4dcd-9b49-041ea8926a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:39.643961 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581af37-24f7-4dcd-9b49-041ea8926a6a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:39.644624 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581af37-24f7-4dcd-9b49-041ea8926a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:39.645128 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581af37-24f7-4dcd-9b49-041ea8926a6a None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:39.646396 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581af37-24f7-4dcd-9b49-041ea8926a6a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:39.646892 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581af37-24f7-4dcd-9b49-041ea8926a6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:39.648883 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581af37-24f7-4dcd-9b49-041ea8926a6a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:39.659638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 482/971] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Jul 11 11:06:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:39.659638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1dd485-8fd4-4c11-9399-684a52204b74 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:39.659638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1dd485-8fd4-4c11-9399-684a52204b74 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:39.659638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1dd485-8fd4-4c11-9399-684a52204b74 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:39.659638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 483/972] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:39.660565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1dd485-8fd4-4c11-9399-684a52204b74 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:39.669097 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc1d73-9a83-4473-9205-5b0693e6dadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:39.669954 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc1d73-9a83-4473-9205-5b0693e6dadd None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:39.670244 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc1d73-9a83-4473-9205-5b0693e6dadd None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:39.670526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc1d73-9a83-4473-9205-5b0693e6dadd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:39.683705 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc1d73-9a83-4473-9205-5b0693e6dadd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:39.685152 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc1d73-9a83-4473-9205-5b0693e6dadd None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:39.703035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-d0fc1d73-9a83-4473-9205-5b0693e6dadd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:39.703035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:39.703035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:39.703035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:39.703035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:39.703035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:39.703035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:39.703035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:39.703035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:39.703035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:39.703035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:39.703035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:39.703035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:39.703035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:39.703035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:39.703929 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:39.703929 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:39.703929 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:39.703929 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:39.703929 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:39.703929 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:39.703929 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:39.703929 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:39.703929 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:39.703929 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:39.703929 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:39.703929 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:39.703929 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:39.703929 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:39.703929 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:39.703929 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:39.703929 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:39.704840 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:39.704840 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:39.704840 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:39.704840 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:39.704840 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 490/973] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:39.705564 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5e78a-523b-47c7-8c08-4efb562483da None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:39.705685 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5e78a-523b-47c7-8c08-4efb562483da None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:39.706000 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5e78a-523b-47c7-8c08-4efb562483da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:39.724147 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-d9e5e78a-523b-47c7-8c08-4efb562483da None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:39.725334 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-d9e5e78a-523b-47c7-8c08-4efb562483da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:39.733082 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:39.784099 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1dd485-8fd4-4c11-9399-684a52204b74 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:39.809914 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 491/974] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:06:39.811118 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5e78a-523b-47c7-8c08-4efb562483da None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:39.823238 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32302d47-343d-470f-a9ac-64d1bb993be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:39.823911 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32302d47-343d-470f-a9ac-64d1bb993be1 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:39.824200 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32302d47-343d-470f-a9ac-64d1bb993be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:39.824485 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32302d47-343d-470f-a9ac-64d1bb993be1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:39.825231 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32302d47-343d-470f-a9ac-64d1bb993be1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:39.826663 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32302d47-343d-470f-a9ac-64d1bb993be1 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:39.893522 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:39.918159 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5e78a-523b-47c7-8c08-4efb562483da None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:39.922468 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 484/975] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Jul 11 11:06:39 2022] POST /identity/v3/endpoints => generated 349 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:06:39.923115 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32302d47-343d-470f-a9ac-64d1bb993be1 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:39.982502 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63467920-d34a-4208-9166-f115edb989f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:39.984653 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63467920-d34a-4208-9166-f115edb989f2 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:39.985178 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63467920-d34a-4208-9166-f115edb989f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:39.985695 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63467920-d34a-4208-9166-f115edb989f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:39.987890 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63467920-d34a-4208-9166-f115edb989f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:39.988407 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63467920-d34a-4208-9166-f115edb989f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:39.990858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63467920-d34a-4208-9166-f115edb989f2 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:40.009001 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 492/976] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:40.014569 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63467920-d34a-4208-9166-f115edb989f2 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:40.070045 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32302d47-343d-470f-a9ac-64d1bb993be1 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:40.085087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:40.113281 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09884c-4866-4cd1-8305-a92d1e468f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:40.115161 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09884c-4866-4cd1-8305-a92d1e468f9d None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:40.115668 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09884c-4866-4cd1-8305-a92d1e468f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:40.116154 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09884c-4866-4cd1-8305-a92d1e468f9d None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:40.117851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09884c-4866-4cd1-8305-a92d1e468f9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:40.119535 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09884c-4866-4cd1-8305-a92d1e468f9d None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:40.121644 dv-cinder-848429-2-smb devstack@keystone.service[80521]: WARNING keystone.server.flask.common [None req-3c09884c-4866-4cd1-8305-a92d1e468f9d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 11 11:06:40.149311 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63467920-d34a-4208-9166-f115edb989f2 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:40.179376 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:40.185368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6b97b-1058-4d17-879d-9e385c45f858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:40.186199 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6b97b-1058-4d17-879d-9e385c45f858 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:40.186480 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6b97b-1058-4d17-879d-9e385c45f858 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:40.186754 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6b97b-1058-4d17-879d-9e385c45f858 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:40.194171 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6b97b-1058-4d17-879d-9e385c45f858 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:40.195728 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.sql.core [None req-3c09884c-4866-4cd1-8305-a92d1e468f9d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 11:06:40.195728 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 11 11:06:40.195728 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [parameters: {'user_id': 'f135aa7d1b604311ba2d78575d5741d0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 11 11:06:40.195728 dv-cinder-848429-2-smb devstack@keystone.service[80521]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80521) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 11:06:40.201026 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6b97b-1058-4d17-879d-9e385c45f858 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:40.213036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-3c09884c-4866-4cd1-8305-a92d1e468f9d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 11 11:06:40.213036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:40.213036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 11:06:40.213036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 11:06:40.213036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 11:06:40.213036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 11:06:40.213036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 11:06:40.213036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 11:06:40.213036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 11:06:40.213036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application conn.query(q) Jul 11 11:06:40.213036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 11:06:40.213036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 11:06:40.213036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 11:06:40.213036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application result.read() Jul 11 11:06:40.213036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 11:06:40.214023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 11:06:40.214023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 11:06:40.214023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 11:06:40.214023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 11:06:40.214023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 11:06:40.214023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 11:06:40.214023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 11:06:40.214023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 11:06:40.214023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:40.214023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 11:06:40.214023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:40.214023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:40.214023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 11:06:40.214023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 11:06:40.214023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 11 11:06:40.214023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 11 11:06:40.214023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 11:06:40.214023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application next(self.gen) Jul 11 11:06:40.215016 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 11:06:40.215016 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application yield resource Jul 11 11:06:40.215016 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 11:06:40.215016 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application next(self.gen) Jul 11 11:06:40.215016 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 11:06:40.215016 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 11:06:40.215016 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 11:06:40.215016 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 11:06:40.215016 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 11:06:40.215016 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise self.value Jul 11 11:06:40.215016 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 11:06:40.215016 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 11:06:40.215016 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 11:06:40.215016 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application session.commit() Jul 11 11:06:40.215016 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 11:06:40.215016 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 11:06:40.215016 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 11:06:40.215941 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 11:06:40.215941 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 11:06:40.215941 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self.session.flush() Jul 11 11:06:40.215941 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 11:06:40.215941 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 11:06:40.215941 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 11:06:40.215941 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 11:06:40.215941 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 11:06:40.215941 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application compat.raise_( Jul 11 11:06:40.215941 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 11:06:40.215941 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception Jul 11 11:06:40.215941 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 11:06:40.215941 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 11:06:40.215941 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 11:06:40.215941 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 11:06:40.215941 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 11:06:40.215941 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 11:06:40.216878 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 11:06:40.216878 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 11:06:40.216878 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 11 11:06:40.216878 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 11 11:06:40.216878 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 11:06:40.216878 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 11:06:40.216878 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 11:06:40.216878 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 11:06:40.216878 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 11:06:40.216878 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 11:06:40.216878 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 11:06:40.216878 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 11:06:40.216878 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 11:06:40.216878 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 11:06:40.216878 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 11:06:40.216878 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception Jul 11 11:06:40.218779 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 11:06:40.218779 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 11:06:40.218779 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 11:06:40.218779 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 11:06:40.218779 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 11:06:40.218779 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 11:06:40.218779 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 11:06:40.218779 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application conn.query(q) Jul 11 11:06:40.218779 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 11:06:40.218779 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 11:06:40.218779 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 11:06:40.218779 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application result.read() Jul 11 11:06:40.218779 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 11:06:40.218779 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 11:06:40.218779 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 11:06:40.218779 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 11:06:40.220237 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 11:06:40.220237 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 11:06:40.220237 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 11:06:40.220237 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 11:06:40.220237 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 11:06:40.220237 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 11 11:06:40.220237 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f135aa7d1b604311ba2d78575d5741d0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 11 11:06:40.220237 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 11:06:40.220237 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:40.220237 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:06:40.220237 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:40.220237 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:40.220237 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:40.220237 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:40.220237 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:40.221334 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:40.221334 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:40.221334 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:40.221334 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:40.221334 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:40.221334 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:40.221334 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:40.221334 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 11 11:06:40.221334 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 11 11:06:40.221334 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:40.221334 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:40.221334 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:06:40.221334 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:40.221334 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:06:40.221334 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:40.221334 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 11 11:06:40.221334 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 11 11:06:40.222783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 11 11:06:40.222783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 11 11:06:40.222783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 11:06:40.222783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 11:06:40.222783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 11 11:06:40.222783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:40.222783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 485/977] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Jul 11 11:06:39 2022] POST /identity/v3/users => generated 160 bytes in 292 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:40.223903 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09884c-4866-4cd1-8305-a92d1e468f9d None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:40.230642 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-dbf6b97b-1058-4d17-879d-9e385c45f858 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:40.230642 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:40.230642 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:40.230642 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:40.230642 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:40.230642 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:40.230642 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:40.230642 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:40.230642 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:40.230642 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:40.230642 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:40.230642 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:40.230642 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:06:40.230642 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:06:40.230642 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:06:40.231749 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:06:40.231749 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:40.231749 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:40.231749 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:40.231749 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:40.231749 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:40.231749 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:40.231749 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:40.231749 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:40.231749 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:40.231749 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:40.231749 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:40.231749 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:40.231749 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:40.231749 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:40.231749 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:40.231749 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:40.232924 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:06:40.232924 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:06:40.232924 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:06:40.232924 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:06:40.232924 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:06:40.232924 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:06:40.232924 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:40.232924 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:40.235439 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 493/978] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:06:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:40.240757 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6b97b-1058-4d17-879d-9e385c45f858 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:40.350787 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6b97b-1058-4d17-879d-9e385c45f858 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:40.365373 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09884c-4866-4cd1-8305-a92d1e468f9d None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:40.400183 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085ef98-e69a-465f-9969-617a11b04749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:40.401201 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbc35c-28f3-45ce-a738-5e7a4383a3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:40.401415 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085ef98-e69a-465f-9969-617a11b04749 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:40.401916 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085ef98-e69a-465f-9969-617a11b04749 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:40.402364 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbc35c-28f3-45ce-a738-5e7a4383a3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:40.402547 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085ef98-e69a-465f-9969-617a11b04749 None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:40.402718 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbc35c-28f3-45ce-a738-5e7a4383a3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:40.403107 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbc35c-28f3-45ce-a738-5e7a4383a3f3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:40.403886 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085ef98-e69a-465f-9969-617a11b04749 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:40.404550 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085ef98-e69a-465f-9969-617a11b04749 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:40.407186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085ef98-e69a-465f-9969-617a11b04749 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:40.412508 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcbc35c-28f3-45ce-a738-5e7a4383a3f3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:40.414350 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcbc35c-28f3-45ce-a738-5e7a4383a3f3 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:40.422960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 494/979] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:06:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:40.428987 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085ef98-e69a-465f-9969-617a11b04749 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:40.437824 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-1dcbc35c-28f3-45ce-a738-5e7a4383a3f3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 11:06:40.437824 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:40.437824 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:40.437824 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:40.437824 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:40.437824 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:40.437824 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:40.437824 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:40.437824 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:40.437824 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:40.437824 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:40.437824 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:40.437824 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:06:40.437824 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:06:40.437824 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:06:40.437824 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:06:40.438790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:40.438790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:40.438790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:06:40.438790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:40.438790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:06:40.438790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:40.438790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:40.438790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:40.438790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:40.438790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:40.438790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:40.438790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:40.438790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:40.438790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:40.438790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:40.438790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:40.438790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:40.438790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:40.440422 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:40.440422 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:40.440422 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:06:40.440422 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:06:40.440422 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:06:40.440422 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:06:40.440422 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:06:40.440422 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:06:40.440422 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 11:06:40.440422 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:40.440422 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 486/980] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:06:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:40.445294 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbc35c-28f3-45ce-a738-5e7a4383a3f3 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:40.482434 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:40.496983 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:40.552213 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085ef98-e69a-465f-9969-617a11b04749 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:40.567822 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbc35c-28f3-45ce-a738-5e7a4383a3f3 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:40.589505 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91d605-34dd-47c3-9822-d5576af8473a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:40.590382 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91d605-34dd-47c3-9822-d5576af8473a None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:40.590494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91d605-34dd-47c3-9822-d5576af8473a None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:40.590761 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91d605-34dd-47c3-9822-d5576af8473a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:40.591591 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91d605-34dd-47c3-9822-d5576af8473a None admin] RBAC: Adding query filter params (role.id=4418ec5b68a244968638f90e957b5163, scope.project.id=38ed7416526e473b816330e24acf7a04, user.id=cdfa8f4012c2471b81f8749b013d3117) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:40.591904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91d605-34dd-47c3-9822-d5576af8473a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:40.593334 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91d605-34dd-47c3-9822-d5576af8473a None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:40.606206 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 495/981] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:06:40 2022] GET /identity/v3/role_assignments?user.id=cdfa8f4012c2471b81f8749b013d3117&scope.project.id=38ed7416526e473b816330e24acf7a04&role.id=4418ec5b68a244968638f90e957b5163 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:40.610270 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d584ef-1dfe-4c4d-bbdd-eca30455e1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:40.611343 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d584ef-1dfe-4c4d-bbdd-eca30455e1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:40.612384 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d584ef-1dfe-4c4d-bbdd-eca30455e1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:40.612864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d584ef-1dfe-4c4d-bbdd-eca30455e1c1 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:40.613942 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d584ef-1dfe-4c4d-bbdd-eca30455e1c1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:40.614471 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d584ef-1dfe-4c4d-bbdd-eca30455e1c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:40.616210 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d584ef-1dfe-4c4d-bbdd-eca30455e1c1 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:40.660360 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 487/982] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jul 11 11:06:40 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:40.807172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b70b94-27eb-4d84-8930-1a723dcc5c09 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:40.807481 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b70b94-27eb-4d84-8930-1a723dcc5c09 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:40.807739 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b70b94-27eb-4d84-8930-1a723dcc5c09 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:40.809724 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 496/983] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:40.815916 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcee19-e1d5-4ca7-a399-1d5ba83e19f5 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:40.816424 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcee19-e1d5-4ca7-a399-1d5ba83e19f5 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:40.816500 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcee19-e1d5-4ca7-a399-1d5ba83e19f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:40.837535 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-26fcee19-e1d5-4ca7-a399-1d5ba83e19f5 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:40.839117 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-26fcee19-e1d5-4ca7-a399-1d5ba83e19f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:40.913935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 488/984] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 11:06:40.935347 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b70b94-27eb-4d84-8930-1a723dcc5c09 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:41.050284 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b70b94-27eb-4d84-8930-1a723dcc5c09 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:41.067020 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:41.087966 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb2294-467b-4ba6-9873-f2cf6f690080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:41.088756 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb2294-467b-4ba6-9873-f2cf6f690080 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:41.089043 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb2294-467b-4ba6-9873-f2cf6f690080 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:41.089321 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb2294-467b-4ba6-9873-f2cf6f690080 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:41.090016 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb2294-467b-4ba6-9873-f2cf6f690080 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:41.091390 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb2294-467b-4ba6-9873-f2cf6f690080 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:41.105030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-08eb2294-467b-4ba6-9873-f2cf6f690080 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 11:06:41.105030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:41.105030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:06:41.105030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:06:41.105030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:06:41.105030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:06:41.105030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:06:41.105030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:41.105030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 11:06:41.105030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:41.105030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:06:41.105030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:41.105030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:41.105030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:41.105030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:41.105030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:41.105030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:41.106279 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:41.106279 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:41.106279 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:41.106279 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:41.106279 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:41.106279 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:41.106279 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:06:41.106279 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:06:41.106279 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:06:41.106279 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:06:41.106279 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:41.106279 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:41.106279 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:41.106279 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:41.106279 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:41.106279 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:41.112719 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:41.112719 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:41.112719 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:41.112719 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:41.112719 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:41.112719 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:41.112719 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:41.112719 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:41.112719 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:41.112719 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:41.112719 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:06:41.112719 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:41.112719 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 11:06:41.112719 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:41.112719 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 497/985] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:06:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:41.115503 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcee19-e1d5-4ca7-a399-1d5ba83e19f5 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:41.142670 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:41.218906 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcee19-e1d5-4ca7-a399-1d5ba83e19f5 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:41.255392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32c911-dc95-4195-abbb-19c3b213dd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:41.256059 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32c911-dc95-4195-abbb-19c3b213dd7f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:41.256345 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32c911-dc95-4195-abbb-19c3b213dd7f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:41.256679 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32c911-dc95-4195-abbb-19c3b213dd7f None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:41.257383 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32c911-dc95-4195-abbb-19c3b213dd7f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:41.257741 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32c911-dc95-4195-abbb-19c3b213dd7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:41.259174 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32c911-dc95-4195-abbb-19c3b213dd7f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:41.264254 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 489/986] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Jul 11 11:06:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:41.270070 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb2294-467b-4ba6-9873-f2cf6f690080 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:41.376071 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb2294-467b-4ba6-9873-f2cf6f690080 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:41.411475 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641792a-3391-4c95-9aef-fd8fdbc33e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:41.412141 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641792a-3391-4c95-9aef-fd8fdbc33e9c None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:41.412468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641792a-3391-4c95-9aef-fd8fdbc33e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:41.412760 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641792a-3391-4c95-9aef-fd8fdbc33e9c None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:41.413465 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641792a-3391-4c95-9aef-fd8fdbc33e9c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:41.413789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641792a-3391-4c95-9aef-fd8fdbc33e9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:41.415392 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641792a-3391-4c95-9aef-fd8fdbc33e9c None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:41.426227 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 498/987] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Jul 11 11:06:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:41.427145 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32c911-dc95-4195-abbb-19c3b213dd7f None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:41.515755 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:41.528008 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32c911-dc95-4195-abbb-19c3b213dd7f None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:41.563120 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cb0aa-c947-4de1-b3fb-0b7c4c6cad37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:41.563784 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cb0aa-c947-4de1-b3fb-0b7c4c6cad37 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:41.564070 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cb0aa-c947-4de1-b3fb-0b7c4c6cad37 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:41.564349 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cb0aa-c947-4de1-b3fb-0b7c4c6cad37 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:41.565679 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3cb0aa-c947-4de1-b3fb-0b7c4c6cad37 None admin] RBAC: Adding query filter params (interface=public, service_id=1a55fe2dbec94447b7f7deb884389d52, region_id=RegionOne) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:41.566019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3cb0aa-c947-4de1-b3fb-0b7c4c6cad37 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:41.567378 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3cb0aa-c947-4de1-b3fb-0b7c4c6cad37 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:41.573804 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 490/988] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Jul 11 11:06:41 2022] GET /identity/v3/endpoints?service_id=1a55fe2dbec94447b7f7deb884389d52&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:41.578431 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641792a-3391-4c95-9aef-fd8fdbc33e9c None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:41.624119 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:41.683547 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641792a-3391-4c95-9aef-fd8fdbc33e9c None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:41.716916 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1200f-9b79-4c24-b642-9f5753c4c688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:41.717592 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1200f-9b79-4c24-b642-9f5753c4c688 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:41.717913 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1200f-9b79-4c24-b642-9f5753c4c688 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:41.718197 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1200f-9b79-4c24-b642-9f5753c4c688 None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:41.718880 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1200f-9b79-4c24-b642-9f5753c4c688 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:41.720252 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1200f-9b79-4c24-b642-9f5753c4c688 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:41.733867 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 499/989] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Jul 11 11:06:41 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:06:42.050418 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0d42d-6cf0-495f-a19b-b74d834179f8 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:42.050931 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0d42d-6cf0-495f-a19b-b74d834179f8 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:42.051009 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0d42d-6cf0-495f-a19b-b74d834179f8 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:42.052514 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 491/990] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:42.057432 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b93d1-4ba1-46af-b049-a59b298ec10e None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:42.057849 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b93d1-4ba1-46af-b049-a59b298ec10e None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:42.058018 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b93d1-4ba1-46af-b049-a59b298ec10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:42.074924 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-b05b93d1-4ba1-46af-b049-a59b298ec10e None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:42.076097 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-b05b93d1-4ba1-46af-b049-a59b298ec10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:42.144010 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 500/991] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:06:42.166144 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0d42d-6cf0-495f-a19b-b74d834179f8 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:42.267425 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0d42d-6cf0-495f-a19b-b74d834179f8 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:42.302264 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fed242-493a-4f6b-9a18-e832539b1dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:42.303160 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fed242-493a-4f6b-9a18-e832539b1dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:42.303443 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fed242-493a-4f6b-9a18-e832539b1dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:42.303713 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fed242-493a-4f6b-9a18-e832539b1dd5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:42.304393 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fed242-493a-4f6b-9a18-e832539b1dd5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:42.305801 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fed242-493a-4f6b-9a18-e832539b1dd5 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:42.318314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-c9fed242-493a-4f6b-9a18-e832539b1dd5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 11:06:42.318314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:42.318314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:06:42.318314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:06:42.318314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:06:42.318314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:06:42.318314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:06:42.318314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:42.318314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 11:06:42.318314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:42.318314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:06:42.318314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:42.318314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:42.318314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:42.318314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:42.318314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:42.318314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:42.319290 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:42.319290 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:42.319290 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:42.319290 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:42.319290 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:42.319290 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:42.319290 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:06:42.319290 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:06:42.319290 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:06:42.319290 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:06:42.319290 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:42.319290 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:42.319290 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:42.319290 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:42.319290 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:42.319290 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:42.320141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:42.320141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:42.320141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:42.320141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:42.320141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:42.320141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:42.320141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:42.320141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:42.320141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:42.320141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:42.320141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:06:42.320141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:42.320141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 11:06:42.320141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:42.321938 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 492/992] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Jul 11 11:06:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:42.325463 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b93d1-4ba1-46af-b049-a59b298ec10e None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:42.360765 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:42.427421 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b93d1-4ba1-46af-b049-a59b298ec10e None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:42.462191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294687e-4612-42af-9770-85703e334f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:42.462856 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294687e-4612-42af-9770-85703e334f6e None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:42.463139 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294687e-4612-42af-9770-85703e334f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:42.463411 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294687e-4612-42af-9770-85703e334f6e None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:42.464109 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294687e-4612-42af-9770-85703e334f6e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:42.464414 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294687e-4612-42af-9770-85703e334f6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:42.465785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294687e-4612-42af-9770-85703e334f6e None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:42.470869 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 501/993] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Jul 11 11:06:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:42.476797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fed242-493a-4f6b-9a18-e832539b1dd5 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:42.495480 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:42.577952 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fed242-493a-4f6b-9a18-e832539b1dd5 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:42.611227 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe5cc5-6eaa-4aac-a4e9-49e7058e4565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:42.612677 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe5cc5-6eaa-4aac-a4e9-49e7058e4565 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:42.612962 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe5cc5-6eaa-4aac-a4e9-49e7058e4565 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:42.613235 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe5cc5-6eaa-4aac-a4e9-49e7058e4565 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:42.614013 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe5cc5-6eaa-4aac-a4e9-49e7058e4565 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:42.614323 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe5cc5-6eaa-4aac-a4e9-49e7058e4565 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:42.615735 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe5cc5-6eaa-4aac-a4e9-49e7058e4565 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:42.625239 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 493/994] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Jul 11 11:06:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:42.626784 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294687e-4612-42af-9770-85703e334f6e None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:42.726946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:42.730419 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294687e-4612-42af-9770-85703e334f6e None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:42.737526 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e35589-f9f8-49b7-b942-00fea62d85c3 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:42.738024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e35589-f9f8-49b7-b942-00fea62d85c3 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:42.738817 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e35589-f9f8-49b7-b942-00fea62d85c3 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:42.739744 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 494/995] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:42.744745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e3ccf-041e-4356-b298-e2363f925217 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:42.745040 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e3ccf-041e-4356-b298-e2363f925217 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:42.745337 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e3ccf-041e-4356-b298-e2363f925217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:42.767683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-6f6e3ccf-041e-4356-b298-e2363f925217 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:42.768929 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6f6e3ccf-041e-4356-b298-e2363f925217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:42.774180 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c25878-f4bd-4fbd-a631-e3684cf6b998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:42.774879 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c25878-f4bd-4fbd-a631-e3684cf6b998 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:42.775169 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c25878-f4bd-4fbd-a631-e3684cf6b998 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:42.775517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c25878-f4bd-4fbd-a631-e3684cf6b998 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:42.776328 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c25878-f4bd-4fbd-a631-e3684cf6b998 None admin] RBAC: Adding query filter params (interface=admin, service_id=8694ef4703df4687a6931ae5a33528a3, region_id=RegionOne) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:42.777115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c25878-f4bd-4fbd-a631-e3684cf6b998 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:42.778517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c25878-f4bd-4fbd-a631-e3684cf6b998 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:42.789321 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 502/996] 10.222.0.23 () {56 vars in 1249 bytes} [Mon Jul 11 11:06:42 2022] GET /identity/v3/endpoints?service_id=8694ef4703df4687a6931ae5a33528a3&interface=admin®ion_id=RegionOne => generated 193 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:42.794573 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c25878-f4bd-4fbd-a631-e3684cf6b998 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:42.843917 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 495/997] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 11:06:42.866888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e3ccf-041e-4356-b298-e2363f925217 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:42.878848 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:42.921138 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c25878-f4bd-4fbd-a631-e3684cf6b998 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:42.957772 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c1448-8c5d-4259-868e-d49f6a15ee5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:42.958459 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c1448-8c5d-4259-868e-d49f6a15ee5a None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:42.958751 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c1448-8c5d-4259-868e-d49f6a15ee5a None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:42.959042 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c1448-8c5d-4259-868e-d49f6a15ee5a None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:42.959728 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c1448-8c5d-4259-868e-d49f6a15ee5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:42.961103 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c1448-8c5d-4259-868e-d49f6a15ee5a None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:42.967777 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 503/998] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Jul 11 11:06:42 2022] GET /identity/v3/services => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:06:42.982746 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e3ccf-041e-4356-b298-e2363f925217 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:43.021947 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0931f55-ab59-4eca-8a10-ddb60e0a852b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:43.022779 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0931f55-ab59-4eca-8a10-ddb60e0a852b None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:43.023064 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0931f55-ab59-4eca-8a10-ddb60e0a852b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:43.023340 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0931f55-ab59-4eca-8a10-ddb60e0a852b None admin] PATH_INFO: `/v3/services/image` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:43.024009 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0931f55-ab59-4eca-8a10-ddb60e0a852b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:43.025413 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0931f55-ab59-4eca-8a10-ddb60e0a852b None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:43.038736 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-e0931f55-ab59-4eca-8a10-ddb60e0a852b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 11:06:43.038736 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:43.038736 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:06:43.038736 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:06:43.038736 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:06:43.038736 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:06:43.038736 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:06:43.038736 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:43.038736 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 11:06:43.038736 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:43.038736 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:06:43.038736 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:43.038736 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:43.038736 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:43.038736 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:43.038736 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:43.038736 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:43.039797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:43.039797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:43.039797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:43.039797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:43.039797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:43.039797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:43.039797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:06:43.039797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:06:43.039797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:06:43.039797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:06:43.039797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:43.039797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:43.039797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:43.039797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:43.039797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:43.039797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:43.040740 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:43.040740 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:43.040740 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:43.040740 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:43.040740 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:43.040740 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:43.040740 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:43.040740 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:43.040740 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:43.040740 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:43.040740 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:06:43.040740 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:43.040740 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 11:06:43.040740 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:43.040740 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 496/999] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Jul 11 11:06:42 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:43.048012 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c1448-8c5d-4259-868e-d49f6a15ee5a None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:43.080291 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:43.157376 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c1448-8c5d-4259-868e-d49f6a15ee5a None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:43.192697 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b94f3-b964-417f-a36f-99e287736cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:43.193366 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b94f3-b964-417f-a36f-99e287736cfa None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:43.193657 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b94f3-b964-417f-a36f-99e287736cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:43.193963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b94f3-b964-417f-a36f-99e287736cfa None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:43.194671 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b94f3-b964-417f-a36f-99e287736cfa None admin] RBAC: Adding query filter params (name=image) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:43.194981 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b94f3-b964-417f-a36f-99e287736cfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:43.196354 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b94f3-b964-417f-a36f-99e287736cfa None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:43.201252 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 504/1000] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:43.207251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0931f55-ab59-4eca-8a10-ddb60e0a852b None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:43.285630 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:43.311078 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0931f55-ab59-4eca-8a10-ddb60e0a852b None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:43.345363 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc103e-b14f-4570-894b-c7f4e14d95ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:43.346684 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc103e-b14f-4570-894b-c7f4e14d95ed None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:43.347183 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc103e-b14f-4570-894b-c7f4e14d95ed None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:43.347359 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc103e-b14f-4570-894b-c7f4e14d95ed None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:43.348041 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc103e-b14f-4570-894b-c7f4e14d95ed None admin] RBAC: Adding query filter params (type=image) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:43.348347 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc103e-b14f-4570-894b-c7f4e14d95ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:43.349696 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc103e-b14f-4570-894b-c7f4e14d95ed None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:43.354409 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 497/1001] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:43 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:43.779384 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ec952-0fab-4ef6-a2f7-3360ba1dd8e2 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:43.779925 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ec952-0fab-4ef6-a2f7-3360ba1dd8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:43.780371 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ec952-0fab-4ef6-a2f7-3360ba1dd8e2 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:43.782537 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 505/1002] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:43.787860 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcc367-ffba-494c-a16b-afe7cd7f2d8b None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:43.788151 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcc367-ffba-494c-a16b-afe7cd7f2d8b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:43.788526 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcc367-ffba-494c-a16b-afe7cd7f2d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:43.805215 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-29fcc367-ffba-494c-a16b-afe7cd7f2d8b None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:43.806419 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-29fcc367-ffba-494c-a16b-afe7cd7f2d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:43.873920 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 498/1003] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:43 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:06:43.894866 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ec952-0fab-4ef6-a2f7-3360ba1dd8e2 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:43.987630 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:43.997578 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ec952-0fab-4ef6-a2f7-3360ba1dd8e2 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:44.032576 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62fcb5-00e8-4427-91c6-95a85446fdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:44.033947 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62fcb5-00e8-4427-91c6-95a85446fdb2 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:44.034270 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62fcb5-00e8-4427-91c6-95a85446fdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:44.034545 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62fcb5-00e8-4427-91c6-95a85446fdb2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:44.035197 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62fcb5-00e8-4427-91c6-95a85446fdb2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:44.036564 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62fcb5-00e8-4427-91c6-95a85446fdb2 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:44.048579 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-9f62fcb5-00e8-4427-91c6-95a85446fdb2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 11:06:44.048579 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:44.048579 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:06:44.048579 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:06:44.048579 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:06:44.048579 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:06:44.048579 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:06:44.048579 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:44.048579 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 11:06:44.048579 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:44.048579 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:06:44.048579 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:44.048579 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:44.048579 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:44.048579 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:44.048579 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:44.048579 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:44.050204 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:44.050204 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:44.050204 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:44.050204 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:44.050204 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:44.050204 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:44.050204 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:06:44.050204 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:06:44.050204 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:06:44.050204 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:06:44.050204 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:44.050204 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:44.050204 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:44.050204 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:44.050204 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:44.050204 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:44.051045 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:44.051045 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:44.051045 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:44.051045 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:44.051045 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:44.051045 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:44.051045 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:44.051045 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:44.051045 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:44.051045 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:44.051045 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:06:44.051045 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:44.051045 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 11:06:44.051045 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:44.051045 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 506/1004] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:06:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:44.057934 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcc367-ffba-494c-a16b-afe7cd7f2d8b None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:44.128823 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:44.162148 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcc367-ffba-494c-a16b-afe7cd7f2d8b None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:44.196940 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924ebb8-83a8-4008-8d7d-520b9f8a299e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:44.197608 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924ebb8-83a8-4008-8d7d-520b9f8a299e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:44.197929 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924ebb8-83a8-4008-8d7d-520b9f8a299e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:44.198213 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924ebb8-83a8-4008-8d7d-520b9f8a299e None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:44.198918 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924ebb8-83a8-4008-8d7d-520b9f8a299e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:44.199233 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924ebb8-83a8-4008-8d7d-520b9f8a299e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:44.200595 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924ebb8-83a8-4008-8d7d-520b9f8a299e None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:44.205566 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 499/1005] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Jul 11 11:06:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:44.211054 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62fcb5-00e8-4427-91c6-95a85446fdb2 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:44.312519 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62fcb5-00e8-4427-91c6-95a85446fdb2 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:44.347419 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e31ea-f6a2-49ad-8d05-eb386adc9ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:44.348088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e31ea-f6a2-49ad-8d05-eb386adc9ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:44.348376 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e31ea-f6a2-49ad-8d05-eb386adc9ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:44.348670 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e31ea-f6a2-49ad-8d05-eb386adc9ca0 None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:44.349362 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e31ea-f6a2-49ad-8d05-eb386adc9ca0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:44.349682 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e31ea-f6a2-49ad-8d05-eb386adc9ca0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:44.351085 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e31ea-f6a2-49ad-8d05-eb386adc9ca0 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:44.356146 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 507/1006] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Jul 11 11:06:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:44.361483 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924ebb8-83a8-4008-8d7d-520b9f8a299e None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:44.462600 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924ebb8-83a8-4008-8d7d-520b9f8a299e None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:44.493368 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:44.499061 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56259423-fa51-475d-9e37-93b718d92023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:44.499731 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56259423-fa51-475d-9e37-93b718d92023 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:44.500019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56259423-fa51-475d-9e37-93b718d92023 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:44.500295 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56259423-fa51-475d-9e37-93b718d92023 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:44.501051 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56259423-fa51-475d-9e37-93b718d92023 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:44.503010 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56259423-fa51-475d-9e37-93b718d92023 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:44.625563 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 500/1007] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Jul 11 11:06:44 2022] POST /identity/v3/endpoints => generated 334 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:06:45.044687 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9bc52-4496-43d8-8521-92517e7d2acc None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:45.045036 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9bc52-4496-43d8-8521-92517e7d2acc None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:45.045264 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9bc52-4496-43d8-8521-92517e7d2acc None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:45.046821 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 508/1008] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:45.052118 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139956b-873e-48bf-9ee7-780ffe0d6923 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:45.052416 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139956b-873e-48bf-9ee7-780ffe0d6923 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:45.052699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139956b-873e-48bf-9ee7-780ffe0d6923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:45.069700 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-f139956b-873e-48bf-9ee7-780ffe0d6923 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:45.070929 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f139956b-873e-48bf-9ee7-780ffe0d6923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:45.146584 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 501/1009] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:45 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:06:45.169998 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9bc52-4496-43d8-8521-92517e7d2acc None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:45.196121 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:45.279148 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9bc52-4496-43d8-8521-92517e7d2acc None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:45.314350 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77fe4b-d8d9-4c8d-9cf8-031982d06cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:45.315692 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77fe4b-d8d9-4c8d-9cf8-031982d06cdf None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:45.315974 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77fe4b-d8d9-4c8d-9cf8-031982d06cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:45.316248 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77fe4b-d8d9-4c8d-9cf8-031982d06cdf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:45.316892 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77fe4b-d8d9-4c8d-9cf8-031982d06cdf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:45.318277 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77fe4b-d8d9-4c8d-9cf8-031982d06cdf None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:45.330157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-2a77fe4b-d8d9-4c8d-9cf8-031982d06cdf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 11:06:45.330157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:45.330157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:06:45.330157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:06:45.330157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:06:45.330157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:06:45.330157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:06:45.330157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:45.330157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 11:06:45.330157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:45.330157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:06:45.330157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:45.330157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:45.330157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:45.330157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:45.330157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:45.330157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:45.331306 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:45.331306 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:45.331306 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:45.331306 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:45.331306 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:45.331306 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:45.331306 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:06:45.331306 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:06:45.331306 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:06:45.331306 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:06:45.331306 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:45.331306 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:45.331306 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:45.331306 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:45.331306 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:45.331306 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:45.332172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:45.332172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:45.332172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:45.332172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:45.332172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:45.332172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:45.332172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:45.332172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:45.332172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:45.332172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:45.332172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:06:45.332172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:45.332172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 11:06:45.332172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:45.333851 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 509/1010] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Jul 11 11:06:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:45.337953 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139956b-873e-48bf-9ee7-780ffe0d6923 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:45.388075 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de8a03-553e-4379-8aaf-1fdacabc2763 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:45.388435 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de8a03-553e-4379-8aaf-1fdacabc2763 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:45.388623 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de8a03-553e-4379-8aaf-1fdacabc2763 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:45.390030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 510/1011] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:45.395013 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a15b04-e26e-4214-8dc0-02f2d6f2f876 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:45.395301 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a15b04-e26e-4214-8dc0-02f2d6f2f876 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:45.395579 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a15b04-e26e-4214-8dc0-02f2d6f2f876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:45.412168 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-d0a15b04-e26e-4214-8dc0-02f2d6f2f876 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:45.413359 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-d0a15b04-e26e-4214-8dc0-02f2d6f2f876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:45.443627 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139956b-873e-48bf-9ee7-780ffe0d6923 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:45.458566 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:45.478844 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bf59a-1890-4059-b2d7-017e037bfdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:45.479510 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bf59a-1890-4059-b2d7-017e037bfdb4 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:45.479803 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bf59a-1890-4059-b2d7-017e037bfdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:45.480085 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bf59a-1890-4059-b2d7-017e037bfdb4 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:45.480793 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57bf59a-1890-4059-b2d7-017e037bfdb4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:45.481106 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57bf59a-1890-4059-b2d7-017e037bfdb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:45.482500 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57bf59a-1890-4059-b2d7-017e037bfdb4 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:45.487246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 502/1012] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Jul 11 11:06:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:45.493078 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 511/1013] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:45 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:06:45.493296 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bf59a-1890-4059-b2d7-017e037bfdb4 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:45.516166 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a15b04-e26e-4214-8dc0-02f2d6f2f876 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:45.532830 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:45.602216 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bf59a-1890-4059-b2d7-017e037bfdb4 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:45.624524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a15b04-e26e-4214-8dc0-02f2d6f2f876 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:45.639065 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8727e-ed09-4550-88a1-f1c68c3d1c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:45.639739 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8727e-ed09-4550-88a1-f1c68c3d1c14 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:45.640024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8727e-ed09-4550-88a1-f1c68c3d1c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:45.640303 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8727e-ed09-4550-88a1-f1c68c3d1c14 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:45.641009 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8727e-ed09-4550-88a1-f1c68c3d1c14 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:45.641316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8727e-ed09-4550-88a1-f1c68c3d1c14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:45.642712 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8727e-ed09-4550-88a1-f1c68c3d1c14 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:45.648888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 503/1014] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Jul 11 11:06:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:45.654515 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8727e-ed09-4550-88a1-f1c68c3d1c14 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:45.667054 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b950959-0ea5-41fb-a00a-467879133bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:45.667716 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b950959-0ea5-41fb-a00a-467879133bf5 None admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:45.667999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b950959-0ea5-41fb-a00a-467879133bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:45.668272 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b950959-0ea5-41fb-a00a-467879133bf5 None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:45.668986 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b950959-0ea5-41fb-a00a-467879133bf5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:45.670388 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b950959-0ea5-41fb-a00a-467879133bf5 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:45.698758 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:45.749170 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 512/1015] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Jul 11 11:06:45 2022] POST /identity/v3/services => generated 242 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:06:45.753589 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8727e-ed09-4550-88a1-f1c68c3d1c14 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:45.807259 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c799290-cde2-4782-805e-ba0b8c257432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:45.807996 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c799290-cde2-4782-805e-ba0b8c257432 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:45.808280 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c799290-cde2-4782-805e-ba0b8c257432 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:45.808816 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c799290-cde2-4782-805e-ba0b8c257432 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:45.809588 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c799290-cde2-4782-805e-ba0b8c257432 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:45.811030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c799290-cde2-4782-805e-ba0b8c257432 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:45.904902 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 504/1016] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Jul 11 11:06:45 2022] POST /identity/v3/endpoints => generated 325 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:06:46.759210 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9616ad4-fcb6-401b-acb3-bc9f97b4cdf0 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:46.759775 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9616ad4-fcb6-401b-acb3-bc9f97b4cdf0 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:46.759856 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9616ad4-fcb6-401b-acb3-bc9f97b4cdf0 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:46.761791 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 513/1017] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:46.769656 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514d2e9-164e-4a67-a531-b4b60a802fb0 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:46.770104 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514d2e9-164e-4a67-a531-b4b60a802fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:46.770296 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514d2e9-164e-4a67-a531-b4b60a802fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:46.787577 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-1514d2e9-164e-4a67-a531-b4b60a802fb0 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:46.788764 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1514d2e9-164e-4a67-a531-b4b60a802fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:46.863871 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 505/1018] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:06:46.886935 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9616ad4-fcb6-401b-acb3-bc9f97b4cdf0 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:46.966570 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:46.994043 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9616ad4-fcb6-401b-acb3-bc9f97b4cdf0 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:47.028351 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f9a35-fa04-4b27-90b8-cc5da5f06769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:47.029900 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f9a35-fa04-4b27-90b8-cc5da5f06769 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:47.030416 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f9a35-fa04-4b27-90b8-cc5da5f06769 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:47.030906 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f9a35-fa04-4b27-90b8-cc5da5f06769 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:47.044916 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f9a35-fa04-4b27-90b8-cc5da5f06769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:06:47.055357 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-566f9a35-fa04-4b27-90b8-cc5da5f06769 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 11:06:47.055357 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:47.055357 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:47.055357 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:47.055357 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:47.055357 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:47.055357 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:47.055357 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:47.055357 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:47.055357 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:47.055357 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:47.055357 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:47.055357 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:06:47.055357 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:06:47.055357 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:06:47.055357 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:06:47.056276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:06:47.056276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:06:47.056276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:06:47.056276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:06:47.056276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:47.056276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:47.056276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:47.056276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:47.056276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:47.056276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:47.056276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:47.056276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:47.056276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:47.056276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:47.056276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:47.056276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:47.057116 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:47.057116 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:47.057116 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:47.057116 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:47.057116 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:06:47.057116 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:06:47.057116 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:06:47.057116 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:06:47.057116 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:06:47.057116 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:06:47.057116 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 11:06:47.057116 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:47.059552 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 514/1019] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Jul 11 11:06:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:47.065250 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514d2e9-164e-4a67-a531-b4b60a802fb0 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:47.090475 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:47.165420 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514d2e9-164e-4a67-a531-b4b60a802fb0 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:47.199117 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdedec-12f4-4f99-a10c-7a1331e46f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:47.199797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdedec-12f4-4f99-a10c-7a1331e46f7c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:47.200083 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdedec-12f4-4f99-a10c-7a1331e46f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:47.200362 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdedec-12f4-4f99-a10c-7a1331e46f7c None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:47.201111 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfdedec-12f4-4f99-a10c-7a1331e46f7c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:47.201422 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfdedec-12f4-4f99-a10c-7a1331e46f7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:47.202809 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfdedec-12f4-4f99-a10c-7a1331e46f7c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:47.215615 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 506/1020] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Jul 11 11:06:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:47.216848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f9a35-fa04-4b27-90b8-cc5da5f06769 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:47.319793 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f9a35-fa04-4b27-90b8-cc5da5f06769 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:47.354113 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77520659-424d-4637-87e2-4c63d7712b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:47.354909 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77520659-424d-4637-87e2-4c63d7712b26 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:47.355195 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77520659-424d-4637-87e2-4c63d7712b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:47.355475 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77520659-424d-4637-87e2-4c63d7712b26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:47.357405 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:47.367184 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77520659-424d-4637-87e2-4c63d7712b26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:47.368705 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77520659-424d-4637-87e2-4c63d7712b26 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:47.385794 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-77520659-424d-4637-87e2-4c63d7712b26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:47.385794 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:47.385794 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:47.385794 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:47.385794 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:47.385794 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:47.385794 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:47.385794 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:47.385794 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:47.385794 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:47.385794 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:47.385794 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:47.385794 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:47.385794 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:47.385794 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:47.386883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:47.386883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:47.386883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:47.386883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:47.386883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:47.386883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:47.386883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:47.386883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:47.386883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:47.386883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:47.386883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:47.386883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:47.386883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:47.386883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:47.386883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:47.386883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:47.386883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:47.387930 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:47.387930 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:47.387930 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:47.387930 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:47.390085 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 515/1021] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:47.394619 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdedec-12f4-4f99-a10c-7a1331e46f7c None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:47.483360 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:47.498480 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdedec-12f4-4f99-a10c-7a1331e46f7c None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:47.541352 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61faab10-39b1-4e47-86ff-ba728c86080e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:47.542054 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61faab10-39b1-4e47-86ff-ba728c86080e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:47.542344 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61faab10-39b1-4e47-86ff-ba728c86080e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:47.542624 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61faab10-39b1-4e47-86ff-ba728c86080e None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:47.543344 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61faab10-39b1-4e47-86ff-ba728c86080e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:47.543656 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61faab10-39b1-4e47-86ff-ba728c86080e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:47.545017 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61faab10-39b1-4e47-86ff-ba728c86080e None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:47.561663 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 507/1022] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:47.562965 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77520659-424d-4637-87e2-4c63d7712b26 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:47.666247 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77520659-424d-4637-87e2-4c63d7712b26 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:47.700565 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6129d-67b8-4e29-814c-9f8d598cd9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:47.701356 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6129d-67b8-4e29-814c-9f8d598cd9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:47.701642 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6129d-67b8-4e29-814c-9f8d598cd9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:47.701950 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6129d-67b8-4e29-814c-9f8d598cd9b2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:47.709597 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6129d-67b8-4e29-814c-9f8d598cd9b2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:47.711069 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6129d-67b8-4e29-814c-9f8d598cd9b2 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:47.725404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-21d6129d-67b8-4e29-814c-9f8d598cd9b2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 11:06:47.725404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:47.725404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:47.725404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:47.725404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:47.725404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:47.725404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:47.725404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:47.725404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:47.725404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:47.725404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:47.725404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:47.725404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:06:47.725404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:06:47.725404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:06:47.725404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:06:47.726582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:47.726582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:47.726582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:06:47.726582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:47.726582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:06:47.726582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:47.726582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:47.726582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:47.726582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:47.726582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:47.726582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:47.726582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:47.726582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:47.726582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:47.726582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:47.726582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:47.726582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:47.726582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:47.732401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:47.732401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:47.732401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:06:47.732401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:06:47.732401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:06:47.732401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:06:47.732401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:06:47.732401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:06:47.732401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 11:06:47.732401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:47.732401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 516/1023] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Jul 11 11:06:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:47.733023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61faab10-39b1-4e47-86ff-ba728c86080e None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:47.842572 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63986e7-b075-444a-9f73-f6daf8f6affa None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:47.843127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63986e7-b075-444a-9f73-f6daf8f6affa None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:47.843127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63986e7-b075-444a-9f73-f6daf8f6affa None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:47.844766 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 517/1024] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:06:47.845548 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61faab10-39b1-4e47-86ff-ba728c86080e None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:47.849820 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259ac6f-7fd9-4447-baeb-165be824e83e None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:47.850114 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259ac6f-7fd9-4447-baeb-165be824e83e None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:47.850396 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259ac6f-7fd9-4447-baeb-165be824e83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:47.866845 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-7259ac6f-7fd9-4447-baeb-165be824e83e None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:47.868033 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-7259ac6f-7fd9-4447-baeb-165be824e83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:47.881174 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ca7b1-6f62-4d01-8e0c-c5c7f9fd5532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:47.881939 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ca7b1-6f62-4d01-8e0c-c5c7f9fd5532 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:47.882386 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ca7b1-6f62-4d01-8e0c-c5c7f9fd5532 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:47.882672 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ca7b1-6f62-4d01-8e0c-c5c7f9fd5532 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:47.883641 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ca7b1-6f62-4d01-8e0c-c5c7f9fd5532 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:47.883960 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ca7b1-6f62-4d01-8e0c-c5c7f9fd5532 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:47.885383 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ca7b1-6f62-4d01-8e0c-c5c7f9fd5532 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:47.910226 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 508/1025] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Jul 11 11:06:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:47.911563 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ca7b1-6f62-4d01-8e0c-c5c7f9fd5532 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:47.913034 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:47.916022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:47.937705 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 518/1026] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 11:06:47.960811 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259ac6f-7fd9-4447-baeb-165be824e83e None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:48.014561 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ca7b1-6f62-4d01-8e0c-c5c7f9fd5532 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:48.048598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2ffd0-78b0-4ed6-9229-adbdf4d7ff12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:48.049885 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2ffd0-78b0-4ed6-9229-adbdf4d7ff12 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:48.050169 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2ffd0-78b0-4ed6-9229-adbdf4d7ff12 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:48.050452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2ffd0-78b0-4ed6-9229-adbdf4d7ff12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:48.058886 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259ac6f-7fd9-4447-baeb-165be824e83e None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:48.092079 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7be7c-eb7c-4942-99a7-bc05f2765bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:48.092866 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7be7c-eb7c-4942-99a7-bc05f2765bcc None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:48.093146 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7be7c-eb7c-4942-99a7-bc05f2765bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:48.093418 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7be7c-eb7c-4942-99a7-bc05f2765bcc None admin] PATH_INFO: `/v3/services/image` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:48.094093 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7be7c-eb7c-4942-99a7-bc05f2765bcc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:48.095447 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7be7c-eb7c-4942-99a7-bc05f2765bcc None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:48.107150 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-45c7be7c-eb7c-4942-99a7-bc05f2765bcc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 11:06:48.107150 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:48.107150 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:06:48.107150 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:06:48.107150 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:06:48.107150 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:06:48.107150 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:06:48.107150 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:48.107150 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 11:06:48.107150 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:48.107150 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:06:48.107150 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:48.107150 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:48.107150 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:48.107150 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:48.107150 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:48.107150 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:48.108135 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:48.108135 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:48.108135 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:48.108135 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:48.108135 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:48.108135 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:48.108135 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:06:48.108135 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:06:48.108135 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:06:48.108135 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:06:48.108135 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:48.108135 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:48.108135 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:48.108135 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:48.108135 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:48.108135 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:48.108977 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:48.108977 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:48.108977 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:48.108977 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:48.108977 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:48.108977 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:48.108977 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:48.108977 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:48.108977 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:48.108977 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:48.108977 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:06:48.108977 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:48.108977 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 11:06:48.108977 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:48.108977 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 519/1027] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Jul 11 11:06:47 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:48.109941 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46864c16-27a9-42c3-a4a9-7e94eadeb3f0 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:48.109941 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46864c16-27a9-42c3-a4a9-7e94eadeb3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:48.110608 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46864c16-27a9-42c3-a4a9-7e94eadeb3f0 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:48.111430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 520/1028] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:48.114396 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46864c16-27a9-42c3-a4a9-7e94eadeb3f0 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:48.117508 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2ffd0-78b0-4ed6-9229-adbdf4d7ff12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:48.119000 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2ffd0-78b0-4ed6-9229-adbdf4d7ff12 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:48.121628 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:48.156672 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:48.215779 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46864c16-27a9-42c3-a4a9-7e94eadeb3f0 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:48.215957 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 509/1029] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:06:47 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 11:06:48.217157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2b10a-f1f4-4b43-a91b-530d3042ed10 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:48.217448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2b10a-f1f4-4b43-a91b-530d3042ed10 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:48.217726 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2b10a-f1f4-4b43-a91b-530d3042ed10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:48.233275 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-faa2b10a-f1f4-4b43-a91b-530d3042ed10 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:48.234501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-faa2b10a-f1f4-4b43-a91b-530d3042ed10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:48.250761 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17141c94-7ab6-407f-bfb2-72ade884c333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:48.251424 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17141c94-7ab6-407f-bfb2-72ade884c333 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:48.251713 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17141c94-7ab6-407f-bfb2-72ade884c333 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:48.251997 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17141c94-7ab6-407f-bfb2-72ade884c333 None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:48.252940 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17141c94-7ab6-407f-bfb2-72ade884c333 None admin] RBAC: Adding query filter params (name=image) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:48.253253 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17141c94-7ab6-407f-bfb2-72ade884c333 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:48.254655 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17141c94-7ab6-407f-bfb2-72ade884c333 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:48.259614 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 521/1030] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:48.260464 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17141c94-7ab6-407f-bfb2-72ade884c333 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:48.305206 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 510/1031] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:06:48.306067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2b10a-f1f4-4b43-a91b-530d3042ed10 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:48.341718 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:48.360401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17141c94-7ab6-407f-bfb2-72ade884c333 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:48.363209 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:48.396008 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da34a2-cbd8-4879-88f7-06793678a623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:48.396796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da34a2-cbd8-4879-88f7-06793678a623 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:48.397499 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da34a2-cbd8-4879-88f7-06793678a623 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:48.397806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da34a2-cbd8-4879-88f7-06793678a623 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:48.408397 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da34a2-cbd8-4879-88f7-06793678a623 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:48.408618 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2b10a-f1f4-4b43-a91b-530d3042ed10 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:48.409889 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da34a2-cbd8-4879-88f7-06793678a623 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:48.427517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-c8da34a2-cbd8-4879-88f7-06793678a623 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:48.427517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:48.427517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:48.427517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:48.427517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:48.427517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:48.427517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:48.427517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:48.427517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:48.427517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:48.427517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:48.427517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:48.427517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:48.427517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:48.427517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:48.428553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:48.428553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:48.428553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:48.428553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:48.428553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:48.428553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:48.428553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:48.428553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:48.428553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:48.428553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:48.428553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:48.428553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:48.428553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:48.428553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:48.428553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:48.428553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:48.428553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:48.429444 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:48.429444 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:48.429444 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:48.429444 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:48.429444 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 522/1032] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:48.429737 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da34a2-cbd8-4879-88f7-06793678a623 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:48.445013 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac742fa-065b-47ff-885c-5c7029c5aa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:48.445682 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac742fa-065b-47ff-885c-5c7029c5aa14 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:48.446018 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac742fa-065b-47ff-885c-5c7029c5aa14 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:48.446302 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac742fa-065b-47ff-885c-5c7029c5aa14 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:48.447007 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac742fa-065b-47ff-885c-5c7029c5aa14 None admin] RBAC: Adding query filter params (type=image) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:48.447322 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac742fa-065b-47ff-885c-5c7029c5aa14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:48.448708 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac742fa-065b-47ff-885c-5c7029c5aa14 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:48.453452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 511/1033] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:48.454281 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac742fa-065b-47ff-885c-5c7029c5aa14 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:48.533538 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da34a2-cbd8-4879-88f7-06793678a623 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:48.549356 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:48.553684 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac742fa-065b-47ff-885c-5c7029c5aa14 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:48.568143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3c825-fc4e-4ffb-a7cf-953091fd94f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:48.568932 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3c825-fc4e-4ffb-a7cf-953091fd94f2 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:48.569221 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3c825-fc4e-4ffb-a7cf-953091fd94f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:48.569497 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3c825-fc4e-4ffb-a7cf-953091fd94f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:48.570702 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d3c825-fc4e-4ffb-a7cf-953091fd94f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:48.572156 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d3c825-fc4e-4ffb-a7cf-953091fd94f2 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:48.573798 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 523/1034] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:48.574566 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3c825-fc4e-4ffb-a7cf-953091fd94f2 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:48.588075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a6b1c-7253-4359-82f7-88c5a1b3ec45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:48.588751 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a6b1c-7253-4359-82f7-88c5a1b3ec45 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:48.589041 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a6b1c-7253-4359-82f7-88c5a1b3ec45 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:48.589314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a6b1c-7253-4359-82f7-88c5a1b3ec45 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:48.590059 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a6b1c-7253-4359-82f7-88c5a1b3ec45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:48.590369 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a6b1c-7253-4359-82f7-88c5a1b3ec45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:48.591710 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a6b1c-7253-4359-82f7-88c5a1b3ec45 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:48.607478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 512/1035] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:48.607478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a6b1c-7253-4359-82f7-88c5a1b3ec45 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:48.608446 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:48.677160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3c825-fc4e-4ffb-a7cf-953091fd94f2 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:48.705780 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a6b1c-7253-4359-82f7-88c5a1b3ec45 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:48.711344 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5cdc25-1805-4c79-b625-75ed99f8ebfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:48.712000 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5cdc25-1805-4c79-b625-75ed99f8ebfa None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:48.712288 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5cdc25-1805-4c79-b625-75ed99f8ebfa None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:48.712566 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5cdc25-1805-4c79-b625-75ed99f8ebfa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:48.713349 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5cdc25-1805-4c79-b625-75ed99f8ebfa None admin] RBAC: Adding query filter params (interface=public, service_id=bbd8d18972424b84a2ce5834f231a8e9, region_id=RegionOne) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:48.713664 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5cdc25-1805-4c79-b625-75ed99f8ebfa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:48.715058 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5cdc25-1805-4c79-b625-75ed99f8ebfa None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:48.719987 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 524/1036] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Jul 11 11:06:48 2022] GET /identity/v3/endpoints?service_id=bbd8d18972424b84a2ce5834f231a8e9&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:48.720963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5cdc25-1805-4c79-b625-75ed99f8ebfa None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:48.745629 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644b53f-f893-4755-9106-7f59c2fe6e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:48.746328 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644b53f-f893-4755-9106-7f59c2fe6e64 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:48.747732 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644b53f-f893-4755-9106-7f59c2fe6e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:48.747732 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644b53f-f893-4755-9106-7f59c2fe6e64 None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:48.747732 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644b53f-f893-4755-9106-7f59c2fe6e64 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:48.749079 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644b53f-f893-4755-9106-7f59c2fe6e64 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:48.808211 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:48.820751 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5cdc25-1805-4c79-b625-75ed99f8ebfa None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:48.857797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 513/1037] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Jul 11 11:06:48 2022] POST /identity/v3/projects => generated 311 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:06:48.857797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644b53f-f893-4755-9106-7f59c2fe6e64 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:48.859667 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e83a5-ccee-4abe-a4ef-6b01fa93f989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:48.860901 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e83a5-ccee-4abe-a4ef-6b01fa93f989 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:48.861186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e83a5-ccee-4abe-a4ef-6b01fa93f989 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:48.862251 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e83a5-ccee-4abe-a4ef-6b01fa93f989 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:48.868576 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:48.872246 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e83a5-ccee-4abe-a4ef-6b01fa93f989 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:48.873875 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e83a5-ccee-4abe-a4ef-6b01fa93f989 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:48.889515 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-648e83a5-ccee-4abe-a4ef-6b01fa93f989 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:48.889515 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:48.889515 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:48.889515 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:48.889515 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:48.889515 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:48.889515 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:48.889515 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:48.889515 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:48.889515 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:48.889515 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:48.889515 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:48.889515 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:06:48.889515 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:06:48.889515 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:06:48.890561 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:06:48.890561 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:48.890561 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:48.890561 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:48.890561 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:48.890561 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:48.890561 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:48.890561 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:48.890561 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:48.890561 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:48.890561 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:48.890561 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:48.890561 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:48.890561 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:48.890561 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:48.890561 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:48.890561 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:48.891894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:06:48.891894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:06:48.891894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:06:48.891894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:06:48.891894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:06:48.891894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:06:48.891894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:48.891894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:48.891894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 525/1038] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:06:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:48.897024 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e83a5-ccee-4abe-a4ef-6b01fa93f989 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:48.973395 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644b53f-f893-4755-9106-7f59c2fe6e64 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:49.011079 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e83a5-ccee-4abe-a4ef-6b01fa93f989 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:49.014720 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6847d6-7617-4815-9827-fee3220faaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:49.015398 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6847d6-7617-4815-9827-fee3220faaba None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:49.015691 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6847d6-7617-4815-9827-fee3220faaba None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:49.015969 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6847d6-7617-4815-9827-fee3220faaba None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:49.016659 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6847d6-7617-4815-9827-fee3220faaba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:49.018075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6847d6-7617-4815-9827-fee3220faaba None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:49.024936 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 514/1039] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Jul 11 11:06:48 2022] GET /identity/v3/services => generated 1957 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:06:49.054885 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4998cad-3211-43fc-85d0-b41353e78cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:49.055747 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4998cad-3211-43fc-85d0-b41353e78cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:49.056248 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4998cad-3211-43fc-85d0-b41353e78cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:49.056450 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4998cad-3211-43fc-85d0-b41353e78cf2 None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:49.058570 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4998cad-3211-43fc-85d0-b41353e78cf2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:49.058570 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4998cad-3211-43fc-85d0-b41353e78cf2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:49.059565 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4998cad-3211-43fc-85d0-b41353e78cf2 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:49.074971 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 526/1040] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:06:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:49.082148 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6847d6-7617-4815-9827-fee3220faaba None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:49.167250 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:49.196378 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6847d6-7617-4815-9827-fee3220faaba None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:49.232046 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bce6c-32c8-499d-8bfd-45f0967f3e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:49.232954 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bce6c-32c8-499d-8bfd-45f0967f3e09 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:49.233385 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bce6c-32c8-499d-8bfd-45f0967f3e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:49.233864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bce6c-32c8-499d-8bfd-45f0967f3e09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:49.234867 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bce6c-32c8-499d-8bfd-45f0967f3e09 None admin] RBAC: Adding query filter params (role.id=4418ec5b68a244968638f90e957b5163, scope.project.id=38ed7416526e473b816330e24acf7a04, user.id=5b9e7594afc346e593ef3e6c579e237b) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:49.235333 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bce6c-32c8-499d-8bfd-45f0967f3e09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:49.237037 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bce6c-32c8-499d-8bfd-45f0967f3e09 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:49.243439 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 515/1041] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:06:49 2022] GET /identity/v3/role_assignments?user.id=5b9e7594afc346e593ef3e6c579e237b&scope.project.id=38ed7416526e473b816330e24acf7a04&role.id=4418ec5b68a244968638f90e957b5163 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:50.973388 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e4ec4-c0e4-48a0-8923-b5f9c3f2ad3b None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:50.973927 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e4ec4-c0e4-48a0-8923-b5f9c3f2ad3b None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:50.974004 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e4ec4-c0e4-48a0-8923-b5f9c3f2ad3b None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:50.975482 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 527/1042] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:50.980451 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eab7e5-9762-4a13-b933-8636693b471d None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:50.980834 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eab7e5-9762-4a13-b933-8636693b471d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:50.981022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eab7e5-9762-4a13-b933-8636693b471d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:50.998546 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-96eab7e5-9762-4a13-b933-8636693b471d None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:50.999741 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-96eab7e5-9762-4a13-b933-8636693b471d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:51.064215 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdf1ab-5ea6-45ec-a038-ae2541ec7c8d None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:51.064525 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdf1ab-5ea6-45ec-a038-ae2541ec7c8d None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:51.064929 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdf1ab-5ea6-45ec-a038-ae2541ec7c8d None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:51.066641 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 528/1043] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:51.067856 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 516/1044] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:50 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:06:51.071431 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802e8ee-58fc-4248-8df2-74ffa3f9b101 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:51.071720 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802e8ee-58fc-4248-8df2-74ffa3f9b101 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:51.072000 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802e8ee-58fc-4248-8df2-74ffa3f9b101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:51.088695 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-5802e8ee-58fc-4248-8df2-74ffa3f9b101 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:51.089891 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-5802e8ee-58fc-4248-8df2-74ffa3f9b101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:51.091866 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:51.093377 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eab7e5-9762-4a13-b933-8636693b471d None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:51.163346 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:51.164572 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 529/1045] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 11:06:51.187178 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802e8ee-58fc-4248-8df2-74ffa3f9b101 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:51.200737 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eab7e5-9762-4a13-b933-8636693b471d None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:51.239459 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f638f30-7339-4c10-a3e2-8ed2382fd73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:51.240258 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f638f30-7339-4c10-a3e2-8ed2382fd73e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:51.240545 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f638f30-7339-4c10-a3e2-8ed2382fd73e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:51.240823 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f638f30-7339-4c10-a3e2-8ed2382fd73e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:51.242126 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f638f30-7339-4c10-a3e2-8ed2382fd73e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:51.243566 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f638f30-7339-4c10-a3e2-8ed2382fd73e None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:51.245227 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 517/1046] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:51.248269 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592225c-799c-4764-8f9a-d04ceec50844 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:51.248563 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592225c-799c-4764-8f9a-d04ceec50844 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:51.248846 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592225c-799c-4764-8f9a-d04ceec50844 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:51.250305 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 518/1047] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:06:51.251036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592225c-799c-4764-8f9a-d04ceec50844 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:51.304890 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802e8ee-58fc-4248-8df2-74ffa3f9b101 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:51.340159 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90afae8-bd98-4dc3-909b-16a0f2ec47c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:51.340876 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90afae8-bd98-4dc3-909b-16a0f2ec47c6 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:51.341166 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90afae8-bd98-4dc3-909b-16a0f2ec47c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:51.341442 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90afae8-bd98-4dc3-909b-16a0f2ec47c6 None admin] PATH_INFO: `/v3/services/image` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:51.342126 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90afae8-bd98-4dc3-909b-16a0f2ec47c6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:51.343500 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90afae8-bd98-4dc3-909b-16a0f2ec47c6 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:51.351444 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592225c-799c-4764-8f9a-d04ceec50844 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:51.355643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-d90afae8-bd98-4dc3-909b-16a0f2ec47c6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 11:06:51.355643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:51.355643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:06:51.355643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:06:51.355643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:06:51.355643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:06:51.355643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:06:51.355643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:51.355643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 11:06:51.355643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:51.355643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:06:51.355643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:51.355643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:51.355643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:51.355643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:51.355643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:51.355643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:51.356782 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:51.356782 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:51.356782 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:51.356782 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:51.356782 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:51.356782 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:51.356782 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:06:51.356782 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:06:51.356782 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:06:51.356782 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:06:51.356782 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:51.356782 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:51.356782 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:51.356782 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:51.356782 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:51.356782 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:51.357636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:51.357636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:51.357636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:51.357636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:51.357636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:51.357636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:51.357636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:51.357636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:51.357636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:51.357636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:51.357636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:06:51.357636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:06:51.357636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 11:06:51.357636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:51.357636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 530/1048] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Jul 11 11:06:51 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:51.359193 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0ad2e-eb8e-4788-adad-670796b09a5e None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:51.359474 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0ad2e-eb8e-4788-adad-670796b09a5e None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:51.359756 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0ad2e-eb8e-4788-adad-670796b09a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:51.364644 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:51.376589 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-86b0ad2e-eb8e-4788-adad-670796b09a5e None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:51.378029 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-86b0ad2e-eb8e-4788-adad-670796b09a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:51.386034 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f61b6-74f0-407b-a59c-49f70dc317b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:51.386709 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f61b6-74f0-407b-a59c-49f70dc317b6 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:51.387003 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f61b6-74f0-407b-a59c-49f70dc317b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:51.387285 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f61b6-74f0-407b-a59c-49f70dc317b6 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:51.387992 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f61b6-74f0-407b-a59c-49f70dc317b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:51.389542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f61b6-74f0-407b-a59c-49f70dc317b6 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:51.397557 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:51.444962 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 531/1049] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:06:51.445899 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0ad2e-eb8e-4788-adad-670796b09a5e None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:51.497055 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 519/1050] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jul 11 11:06:51 2022] POST /identity/v3/users => generated 285 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:06:51.498213 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f61b6-74f0-407b-a59c-49f70dc317b6 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:51.568135 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0ad2e-eb8e-4788-adad-670796b09a5e None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:51.600678 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:51.606097 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8172aa-9266-43f3-84c4-b6c458000551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:51.606774 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8172aa-9266-43f3-84c4-b6c458000551 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:51.607064 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8172aa-9266-43f3-84c4-b6c458000551 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:51.607368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8172aa-9266-43f3-84c4-b6c458000551 None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:51.608072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8172aa-9266-43f3-84c4-b6c458000551 None admin] RBAC: Adding query filter params (name=image) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:51.608389 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8172aa-9266-43f3-84c4-b6c458000551 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:51.610017 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8172aa-9266-43f3-84c4-b6c458000551 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:51.617703 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f61b6-74f0-407b-a59c-49f70dc317b6 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:51.620625 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 532/1051] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:51.621576 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8172aa-9266-43f3-84c4-b6c458000551 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:51.660323 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc58617-c144-4020-bd9a-6dc7acc3a74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:51.661158 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc58617-c144-4020-bd9a-6dc7acc3a74f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:51.661448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc58617-c144-4020-bd9a-6dc7acc3a74f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:51.661858 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc58617-c144-4020-bd9a-6dc7acc3a74f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:51.676611 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc58617-c144-4020-bd9a-6dc7acc3a74f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:06:51.685246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-2bc58617-c144-4020-bd9a-6dc7acc3a74f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 11:06:51.685246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:51.685246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:51.685246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:51.685246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:51.685246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:51.685246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:51.685246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:51.685246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:51.685246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:51.685246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:51.685246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:51.685246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:06:51.685246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:06:51.685246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:06:51.685246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:06:51.686388 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:06:51.686388 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:06:51.686388 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:06:51.686388 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:06:51.686388 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:51.686388 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:51.686388 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:51.686388 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:51.686388 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:51.686388 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:51.686388 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:51.686388 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:51.686388 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:51.686388 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:51.686388 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:51.686388 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:51.687219 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:51.687219 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:51.687219 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:51.687219 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:51.687219 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:06:51.687219 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:06:51.687219 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:06:51.687219 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:06:51.687219 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:06:51.687219 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:06:51.687219 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 11:06:51.687219 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:51.687850 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 520/1052] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Jul 11 11:06:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:51.693784 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc58617-c144-4020-bd9a-6dc7acc3a74f None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:51.753695 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8172aa-9266-43f3-84c4-b6c458000551 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:51.764139 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:51.791769 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f601ade-8631-48ef-908e-4570e3e75f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:51.792430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f601ade-8631-48ef-908e-4570e3e75f8a None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:51.792713 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f601ade-8631-48ef-908e-4570e3e75f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:51.792713 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f601ade-8631-48ef-908e-4570e3e75f8a None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:51.793682 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f601ade-8631-48ef-908e-4570e3e75f8a None admin] RBAC: Adding query filter params (type=image) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:51.794017 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f601ade-8631-48ef-908e-4570e3e75f8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:51.795382 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f601ade-8631-48ef-908e-4570e3e75f8a None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:51.805867 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 533/1053] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:51.811169 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f601ade-8631-48ef-908e-4570e3e75f8a None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:51.822084 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc58617-c144-4020-bd9a-6dc7acc3a74f None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:51.863661 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de8716-4458-4a83-b347-3a2d233ef49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:51.864266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de8716-4458-4a83-b347-3a2d233ef49e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:51.864549 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de8716-4458-4a83-b347-3a2d233ef49e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:51.864828 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de8716-4458-4a83-b347-3a2d233ef49e None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:51.865578 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de8716-4458-4a83-b347-3a2d233ef49e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:51.865921 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de8716-4458-4a83-b347-3a2d233ef49e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:51.867281 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de8716-4458-4a83-b347-3a2d233ef49e None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:51.868875 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:51.876043 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 521/1054] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Jul 11 11:06:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:51.881409 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de8716-4458-4a83-b347-3a2d233ef49e None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:51.914826 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f601ade-8631-48ef-908e-4570e3e75f8a None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:51.948773 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37527b12-9756-4649-8451-bc3ac1cea23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:51.949431 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37527b12-9756-4649-8451-bc3ac1cea23b None admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:51.949714 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37527b12-9756-4649-8451-bc3ac1cea23b None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:51.950016 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37527b12-9756-4649-8451-bc3ac1cea23b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:51.950752 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37527b12-9756-4649-8451-bc3ac1cea23b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:51.952114 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37527b12-9756-4649-8451-bc3ac1cea23b None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:51.984635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de8716-4458-4a83-b347-3a2d233ef49e None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:51.998400 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:52.018044 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdac98d-1c72-486b-a36c-715fa9c9fa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:52.018841 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdac98d-1c72-486b-a36c-715fa9c9fa94 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:52.019122 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdac98d-1c72-486b-a36c-715fa9c9fa94 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:52.019399 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdac98d-1c72-486b-a36c-715fa9c9fa94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:52.029677 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdac98d-1c72-486b-a36c-715fa9c9fa94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:52.031163 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdac98d-1c72-486b-a36c-715fa9c9fa94 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:52.043067 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 534/1055] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Jul 11 11:06:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:06:52.056605 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-8bdac98d-1c72-486b-a36c-715fa9c9fa94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:52.056605 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:52.056605 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:52.056605 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:52.056605 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:52.056605 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:52.056605 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:52.056605 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:52.056605 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:52.056605 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:52.056605 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:52.056605 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:52.056605 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:52.056605 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:52.056605 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:52.058283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:52.058283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:52.058283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:52.058283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:52.058283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:52.058283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:52.058283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:52.058283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:52.058283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:52.058283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:52.058283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:52.058283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:52.058283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:52.058283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:52.058283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:52.058283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:52.058283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:52.059536 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:52.059536 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:52.059536 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:52.059536 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:52.059536 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 522/1056] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:52.064056 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37527b12-9756-4649-8451-bc3ac1cea23b None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:52.191856 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37527b12-9756-4649-8451-bc3ac1cea23b None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:52.241533 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:52.264018 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca8dd8-6899-4530-83c7-eee77135edf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:52.264694 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca8dd8-6899-4530-83c7-eee77135edf8 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:52.264983 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca8dd8-6899-4530-83c7-eee77135edf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:52.265266 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca8dd8-6899-4530-83c7-eee77135edf8 None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:52.266083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca8dd8-6899-4530-83c7-eee77135edf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:52.266397 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca8dd8-6899-4530-83c7-eee77135edf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:52.268305 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca8dd8-6899-4530-83c7-eee77135edf8 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:52.280092 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 535/1057] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:52.285936 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdac98d-1c72-486b-a36c-715fa9c9fa94 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:52.387174 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdac98d-1c72-486b-a36c-715fa9c9fa94 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:52.422241 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde65de-8a7f-4d8e-b884-85758f2b90fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:52.423035 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde65de-8a7f-4d8e-b884-85758f2b90fa None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:52.423318 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde65de-8a7f-4d8e-b884-85758f2b90fa None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:52.423590 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde65de-8a7f-4d8e-b884-85758f2b90fa None admin] PATH_INFO: `/v3/users/nova` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:52.431522 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde65de-8a7f-4d8e-b884-85758f2b90fa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:52.432960 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde65de-8a7f-4d8e-b884-85758f2b90fa None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:52.447760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-bbde65de-8a7f-4d8e-b884-85758f2b90fa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 11:06:52.447760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:52.447760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:52.447760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:52.447760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:52.447760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:52.447760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:52.447760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:52.447760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:52.447760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:52.447760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:52.447760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:52.447760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:06:52.447760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:06:52.447760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:06:52.447760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:06:52.448696 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:52.448696 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:52.448696 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:06:52.448696 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:52.448696 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:06:52.448696 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:52.448696 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:52.448696 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:52.448696 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:52.448696 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:52.448696 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:52.448696 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:52.448696 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:52.448696 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:52.448696 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:52.448696 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:52.448696 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:52.448696 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:52.449638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:52.449638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:52.449638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:06:52.449638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:06:52.449638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:06:52.449638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:06:52.449638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:06:52.449638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:06:52.449638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 11:06:52.449638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:52.453600 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 523/1058] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Jul 11 11:06:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:52.455041 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca8dd8-6899-4530-83c7-eee77135edf8 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:52.559406 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca8dd8-6899-4530-83c7-eee77135edf8 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:52.593646 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403f50f-ed2c-4485-956e-fa90d7cff9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:52.594665 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403f50f-ed2c-4485-956e-fa90d7cff9aa None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:52.595130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403f50f-ed2c-4485-956e-fa90d7cff9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:52.595602 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403f50f-ed2c-4485-956e-fa90d7cff9aa None admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:52.596614 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403f50f-ed2c-4485-956e-fa90d7cff9aa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:52.597101 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403f50f-ed2c-4485-956e-fa90d7cff9aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:52.598748 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403f50f-ed2c-4485-956e-fa90d7cff9aa None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:52.616797 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 536/1059] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Jul 11 11:06:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:52.622518 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde65de-8a7f-4d8e-b884-85758f2b90fa None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:52.651757 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:52.725872 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde65de-8a7f-4d8e-b884-85758f2b90fa None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:52.761375 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f9cb0-2b8d-45cf-98db-18a65bc5c7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:52.761956 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f9cb0-2b8d-45cf-98db-18a65bc5c7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:52.764023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f9cb0-2b8d-45cf-98db-18a65bc5c7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:52.764023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f9cb0-2b8d-45cf-98db-18a65bc5c7d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:52.778825 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f9cb0-2b8d-45cf-98db-18a65bc5c7d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:52.780284 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f9cb0-2b8d-45cf-98db-18a65bc5c7d5 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:52.797701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-056f9cb0-2b8d-45cf-98db-18a65bc5c7d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:52.797701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:52.797701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:52.797701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:52.797701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:52.797701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:52.797701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:52.797701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:52.797701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:52.797701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:52.797701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:52.797701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:52.797701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:52.797701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:52.797701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:52.798670 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:52.798670 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:52.798670 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:52.798670 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:52.798670 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:52.798670 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:52.798670 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:52.798670 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:52.798670 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:52.798670 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:52.798670 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:52.798670 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:52.798670 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:52.798670 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:52.798670 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:52.798670 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:52.798670 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:52.800910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:52.800910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:52.800910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:52.800910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:52.800910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 524/1060] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:52.805036 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403f50f-ed2c-4485-956e-fa90d7cff9aa None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:52.837955 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:52.908167 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403f50f-ed2c-4485-956e-fa90d7cff9aa None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:52.942468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9858b-8450-44a6-9dfd-873dae7738fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:52.943197 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9858b-8450-44a6-9dfd-873dae7738fa None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:52.943549 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9858b-8450-44a6-9dfd-873dae7738fa None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:52.943890 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9858b-8450-44a6-9dfd-873dae7738fa None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:52.944671 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9858b-8450-44a6-9dfd-873dae7738fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:52.945049 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9858b-8450-44a6-9dfd-873dae7738fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:52.946561 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9858b-8450-44a6-9dfd-873dae7738fa None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:52.962175 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 537/1061] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:52.963521 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f9cb0-2b8d-45cf-98db-18a65bc5c7d5 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:53.041352 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:53.063544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f9cb0-2b8d-45cf-98db-18a65bc5c7d5 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:53.098454 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1766e50-2db3-4e17-b12e-ef6b38c2cc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:53.099335 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1766e50-2db3-4e17-b12e-ef6b38c2cc10 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:53.099688 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1766e50-2db3-4e17-b12e-ef6b38c2cc10 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:53.100034 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1766e50-2db3-4e17-b12e-ef6b38c2cc10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:53.106880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1766e50-2db3-4e17-b12e-ef6b38c2cc10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:53.108388 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1766e50-2db3-4e17-b12e-ef6b38c2cc10 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:53.122750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-c1766e50-2db3-4e17-b12e-ef6b38c2cc10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:53.122750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:53.122750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:53.122750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:53.122750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:53.122750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:53.122750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:53.122750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:53.122750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:53.122750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:53.122750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:53.122750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:53.122750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:06:53.122750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:06:53.122750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:06:53.123814 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:06:53.123814 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:53.123814 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:53.123814 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:53.123814 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:53.123814 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:53.123814 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:53.123814 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:53.123814 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:53.123814 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:53.123814 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:53.123814 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:53.123814 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:53.123814 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:53.123814 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:53.123814 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:53.123814 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:53.124915 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:06:53.124915 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:06:53.124915 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:06:53.124915 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:06:53.124915 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:06:53.124915 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:06:53.124915 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:53.124915 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:53.129834 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 525/1062] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:06:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:53.132059 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9858b-8450-44a6-9dfd-873dae7738fa None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:53.228803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:53.239375 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9858b-8450-44a6-9dfd-873dae7738fa None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:53.273875 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432fc3bb-e773-4b46-a0bc-5e152da0dab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:53.274681 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fc3bb-e773-4b46-a0bc-5e152da0dab6 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:53.275098 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fc3bb-e773-4b46-a0bc-5e152da0dab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:53.275460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fc3bb-e773-4b46-a0bc-5e152da0dab6 None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:53.276340 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432fc3bb-e773-4b46-a0bc-5e152da0dab6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:53.276748 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432fc3bb-e773-4b46-a0bc-5e152da0dab6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:53.278299 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432fc3bb-e773-4b46-a0bc-5e152da0dab6 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:53.295219 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 538/1063] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:06:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:53.296710 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1766e50-2db3-4e17-b12e-ef6b38c2cc10 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:53.397429 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1766e50-2db3-4e17-b12e-ef6b38c2cc10 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:53.430732 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7f38d-45f8-4cce-a854-6d35ebd4d249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:53.431620 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7f38d-45f8-4cce-a854-6d35ebd4d249 None admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:53.431896 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7f38d-45f8-4cce-a854-6d35ebd4d249 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:53.432176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7f38d-45f8-4cce-a854-6d35ebd4d249 None admin] PATH_INFO: `/v3/projects/38ed7416526e473b816330e24acf7a04/users/5b9e7594afc346e593ef3e6c579e237b/roles/4418ec5b68a244968638f90e957b5163` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:53.434656 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7f38d-45f8-4cce-a854-6d35ebd4d249 None admin] RBAC: Authorizing `identity:create_grant(project_id=38ed7416526e473b816330e24acf7a04, user_id=5b9e7594afc346e593ef3e6c579e237b, role_id=4418ec5b68a244968638f90e957b5163)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:53.436077 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7f38d-45f8-4cce-a854-6d35ebd4d249 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:53.499080 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:53.505566 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 526/1064] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jul 11 11:06:53 2022] PUT /identity/v3/projects/38ed7416526e473b816330e24acf7a04/users/5b9e7594afc346e593ef3e6c579e237b/roles/4418ec5b68a244968638f90e957b5163 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:06:53.628471 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea09d19-f223-4654-b42c-69f217680af0 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:53.628736 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea09d19-f223-4654-b42c-69f217680af0 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:53.628965 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea09d19-f223-4654-b42c-69f217680af0 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:53.630455 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 539/1065] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:53.635997 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f881135-8896-4db8-815f-8ddaace424f4 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:53.636296 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f881135-8896-4db8-815f-8ddaace424f4 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:53.636582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f881135-8896-4db8-815f-8ddaace424f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:53.655442 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-9f881135-8896-4db8-815f-8ddaace424f4 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:53.656653 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9f881135-8896-4db8-815f-8ddaace424f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:53.730206 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 527/1066] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:06:53.754040 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea09d19-f223-4654-b42c-69f217680af0 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:53.862694 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea09d19-f223-4654-b42c-69f217680af0 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:53.897458 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd186f4-a1ef-4853-818b-736cba5bd00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:53.898208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd186f4-a1ef-4853-818b-736cba5bd00e None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:53.898498 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd186f4-a1ef-4853-818b-736cba5bd00e None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:53.898776 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd186f4-a1ef-4853-818b-736cba5bd00e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:53.909675 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd186f4-a1ef-4853-818b-736cba5bd00e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:06:53.917240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-4fd186f4-a1ef-4853-818b-736cba5bd00e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:06:53.917240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:53.917240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:53.917240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:53.917240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:53.917240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:53.917240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:53.917240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:53.917240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:53.917240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:53.917240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:53.917240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:53.917240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:06:53.917240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:06:53.917240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:06:53.917240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:06:53.918397 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:06:53.918397 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:06:53.918397 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:06:53.918397 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:06:53.918397 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:53.918397 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:53.918397 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:53.918397 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:53.918397 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:53.918397 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:53.918397 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:53.918397 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:53.918397 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:53.918397 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:53.918397 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:53.918397 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:53.919270 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:53.919270 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:53.919270 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:53.919270 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:53.919270 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:06:53.919270 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:06:53.919270 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:06:53.919270 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:06:53.919270 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:06:53.919270 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:06:53.919270 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:06:53.919270 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:53.919270 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 540/1067] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:06:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:53.925068 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f881135-8896-4db8-815f-8ddaace424f4 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:54.023760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f881135-8896-4db8-815f-8ddaace424f4 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:54.051204 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:54.060349 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674056d-3124-4807-be34-532b11bb021f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:54.061032 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674056d-3124-4807-be34-532b11bb021f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:54.061316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674056d-3124-4807-be34-532b11bb021f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:54.069731 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674056d-3124-4807-be34-532b11bb021f None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:54.069731 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674056d-3124-4807-be34-532b11bb021f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:54.069731 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674056d-3124-4807-be34-532b11bb021f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:54.069731 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674056d-3124-4807-be34-532b11bb021f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:54.077525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 528/1068] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:06:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:54.078459 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd186f4-a1ef-4853-818b-736cba5bd00e None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:54.091933 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:54.115191 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f2cab-0d54-4224-99ee-ec552fb99d77 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:54.115485 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f2cab-0d54-4224-99ee-ec552fb99d77 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:54.115769 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f2cab-0d54-4224-99ee-ec552fb99d77 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:54.117278 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 529/1069] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:06:54.122025 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326aeb4f-d721-4ad7-b4a5-eda0fe577b5d None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:54.122313 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326aeb4f-d721-4ad7-b4a5-eda0fe577b5d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:54.122594 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326aeb4f-d721-4ad7-b4a5-eda0fe577b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:54.139661 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-326aeb4f-d721-4ad7-b4a5-eda0fe577b5d None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:54.140839 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-326aeb4f-d721-4ad7-b4a5-eda0fe577b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:54.181853 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd186f4-a1ef-4853-818b-736cba5bd00e None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:54.211945 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 530/1070] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 11:06:54.216354 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c745e4-d53f-47fa-9f2a-84ba94dc44d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:54.217229 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c745e4-d53f-47fa-9f2a-84ba94dc44d1 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:54.217513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c745e4-d53f-47fa-9f2a-84ba94dc44d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:54.217807 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c745e4-d53f-47fa-9f2a-84ba94dc44d1 None admin] PATH_INFO: `/v3/users/90a1bb8e6266420480fa81ed1dc8c8ef` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:54.231954 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c745e4-d53f-47fa-9f2a-84ba94dc44d1 None admin] RBAC: Authorizing `identity:get_user(user_id=90a1bb8e6266420480fa81ed1dc8c8ef)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:54.233484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c745e4-d53f-47fa-9f2a-84ba94dc44d1 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:54.234506 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326aeb4f-d721-4ad7-b4a5-eda0fe577b5d None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:54.235319 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 541/1071] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:06:54 2022] GET /identity/v3/users/90a1bb8e6266420480fa81ed1dc8c8ef => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:54.241232 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c745e4-d53f-47fa-9f2a-84ba94dc44d1 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:54.314799 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:54.341369 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326aeb4f-d721-4ad7-b4a5-eda0fe577b5d None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:54.352221 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c745e4-d53f-47fa-9f2a-84ba94dc44d1 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:54.365211 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:54.379363 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f47bda-fc14-44d5-bfb6-bd9e62e8efe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:54.380099 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f47bda-fc14-44d5-bfb6-bd9e62e8efe8 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:54.380456 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f47bda-fc14-44d5-bfb6-bd9e62e8efe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:54.380801 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f47bda-fc14-44d5-bfb6-bd9e62e8efe8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:54.386698 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5def9ef-0aab-4bfd-9217-7298e00a8462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:54.387344 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5def9ef-0aab-4bfd-9217-7298e00a8462 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:54.387628 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5def9ef-0aab-4bfd-9217-7298e00a8462 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:54.387905 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5def9ef-0aab-4bfd-9217-7298e00a8462 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:54.455854 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f47bda-fc14-44d5-bfb6-bd9e62e8efe8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:54.457873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f47bda-fc14-44d5-bfb6-bd9e62e8efe8 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:54.459240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5def9ef-0aab-4bfd-9217-7298e00a8462 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:54.460683 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5def9ef-0aab-4bfd-9217-7298e00a8462 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:54.527446 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:54.566928 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 542/1073] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:06:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 11:06:54.567383 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 531/1072] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:06:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 11:06:54.568069 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5def9ef-0aab-4bfd-9217-7298e00a8462 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:54.568278 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f47bda-fc14-44d5-bfb6-bd9e62e8efe8 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:54.589475 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:54.675434 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f47bda-fc14-44d5-bfb6-bd9e62e8efe8 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:54.675990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5def9ef-0aab-4bfd-9217-7298e00a8462 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:54.713054 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a4492-5a9b-429b-a6bc-bd9597eeb0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:54.713396 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a746bb0-82bf-4865-97e9-841c1efd03ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:54.713867 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a4492-5a9b-429b-a6bc-bd9597eeb0af None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:54.714154 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a4492-5a9b-429b-a6bc-bd9597eeb0af None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:54.714250 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a746bb0-82bf-4865-97e9-841c1efd03ee None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:54.714432 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a4492-5a9b-429b-a6bc-bd9597eeb0af None admin] PATH_INFO: `/v3/projects/2231dff7883b45619ebbbc7bc9865f92` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:54.714542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a746bb0-82bf-4865-97e9-841c1efd03ee None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:54.714709 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a746bb0-82bf-4865-97e9-841c1efd03ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:54.715614 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a4492-5a9b-429b-a6bc-bd9597eeb0af None admin] RBAC: Authorizing `identity:get_project(project_id=2231dff7883b45619ebbbc7bc9865f92)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:54.717532 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a4492-5a9b-429b-a6bc-bd9597eeb0af None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:54.724564 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 543/1074] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:06:54 2022] GET /identity/v3/projects/2231dff7883b45619ebbbc7bc9865f92 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:54.725412 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a746bb0-82bf-4865-97e9-841c1efd03ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:54.725543 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a4492-5a9b-429b-a6bc-bd9597eeb0af None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:54.726963 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a746bb0-82bf-4865-97e9-841c1efd03ee None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:54.744667 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-3a746bb0-82bf-4865-97e9-841c1efd03ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:54.744667 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:54.744667 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:54.744667 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:54.744667 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:54.744667 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:54.744667 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:54.744667 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:54.744667 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:54.744667 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:54.744667 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:54.744667 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:54.744667 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:54.744667 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:54.744667 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:54.745609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:54.745609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:54.745609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:54.745609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:54.745609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:54.745609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:54.745609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:54.745609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:54.745609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:54.745609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:54.745609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:54.745609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:54.745609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:54.745609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:54.745609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:54.745609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:54.745609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:54.746967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:54.746967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:54.746967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:54.746967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:54.746967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 532/1075] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:54.752409 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a746bb0-82bf-4865-97e9-841c1efd03ee None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:54.776417 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:54.826260 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:54.843043 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a4492-5a9b-429b-a6bc-bd9597eeb0af None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:54.857073 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a746bb0-82bf-4865-97e9-841c1efd03ee None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:54.880873 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a0f2e-9f79-41e4-876d-939bee564ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:54.881567 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a0f2e-9f79-41e4-876d-939bee564ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:54.881891 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a0f2e-9f79-41e4-876d-939bee564ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:54.882178 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a0f2e-9f79-41e4-876d-939bee564ee8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:54.883004 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a0f2e-9f79-41e4-876d-939bee564ee8 None admin] RBAC: Adding query filter params (role.id=736e70deba004b9289c2fed43eb107f7, scope.project.id=2231dff7883b45619ebbbc7bc9865f92, user.id=90a1bb8e6266420480fa81ed1dc8c8ef) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:54.883316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a0f2e-9f79-41e4-876d-939bee564ee8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:54.884741 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a0f2e-9f79-41e4-876d-939bee564ee8 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:54.893870 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 544/1076] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:06:54 2022] GET /identity/v3/role_assignments?user.id=90a1bb8e6266420480fa81ed1dc8c8ef&scope.project.id=2231dff7883b45619ebbbc7bc9865f92&role.id=736e70deba004b9289c2fed43eb107f7 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:54.896115 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3a0b8-06e8-49e9-aaa8-02a64b56b65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:54.896879 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3a0b8-06e8-49e9-aaa8-02a64b56b65d None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:54.897173 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3a0b8-06e8-49e9-aaa8-02a64b56b65d None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:54.897451 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3a0b8-06e8-49e9-aaa8-02a64b56b65d None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:54.898369 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3a0b8-06e8-49e9-aaa8-02a64b56b65d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:54.898682 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3a0b8-06e8-49e9-aaa8-02a64b56b65d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:54.900084 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3a0b8-06e8-49e9-aaa8-02a64b56b65d None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:54.918321 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 533/1077] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:55.546507 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431afe6-f431-477b-a65e-cb9cdff15a9b None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:55.547030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431afe6-f431-477b-a65e-cb9cdff15a9b None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:55.547116 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431afe6-f431-477b-a65e-cb9cdff15a9b None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:55.548493 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 545/1078] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:55.553935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b54fcf-6328-4135-973d-ea83ace71673 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:55.554311 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b54fcf-6328-4135-973d-ea83ace71673 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:55.554502 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b54fcf-6328-4135-973d-ea83ace71673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:55.571504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-50b54fcf-6328-4135-973d-ea83ace71673 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:55.572693 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-50b54fcf-6328-4135-973d-ea83ace71673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:55.638506 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 534/1079] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:06:55.662977 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431afe6-f431-477b-a65e-cb9cdff15a9b None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:55.760627 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:55.765386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431afe6-f431-477b-a65e-cb9cdff15a9b None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:55.799081 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dce2a4-b44e-46df-9bfd-1fcf0f27a893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:55.799951 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dce2a4-b44e-46df-9bfd-1fcf0f27a893 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:55.800233 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dce2a4-b44e-46df-9bfd-1fcf0f27a893 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:55.800507 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dce2a4-b44e-46df-9bfd-1fcf0f27a893 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:55.810964 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dce2a4-b44e-46df-9bfd-1fcf0f27a893 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:06:55.819735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-47dce2a4-b44e-46df-9bfd-1fcf0f27a893 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 11:06:55.819735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:55.819735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:55.819735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:55.819735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:55.819735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:55.819735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:55.819735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:55.819735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:55.819735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:55.819735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:55.819735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:55.819735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:06:55.819735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:06:55.819735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:06:55.819735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:06:55.820752 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:06:55.820752 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:06:55.820752 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:06:55.820752 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:06:55.820752 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:55.820752 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:55.820752 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:55.820752 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:55.820752 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:55.820752 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:55.820752 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:55.820752 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:55.820752 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:55.820752 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:55.820752 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:55.820752 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:55.821619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:55.821619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:55.821619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:55.821619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:55.821619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:06:55.821619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:06:55.821619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:06:55.821619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:06:55.821619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:06:55.821619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:06:55.821619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 11:06:55.821619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:55.821619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 546/1080] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Jul 11 11:06:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:55.826920 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b54fcf-6328-4135-973d-ea83ace71673 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:55.886704 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:55.923492 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b54fcf-6328-4135-973d-ea83ace71673 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:55.957975 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a17b1a-c70c-41ed-b7ad-a881aa9b39e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:55.958638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a17b1a-c70c-41ed-b7ad-a881aa9b39e9 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:55.958923 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a17b1a-c70c-41ed-b7ad-a881aa9b39e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:55.959198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a17b1a-c70c-41ed-b7ad-a881aa9b39e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:55.959942 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a17b1a-c70c-41ed-b7ad-a881aa9b39e9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:55.960251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a17b1a-c70c-41ed-b7ad-a881aa9b39e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:55.961601 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a17b1a-c70c-41ed-b7ad-a881aa9b39e9 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:55.969658 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 535/1081] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Jul 11 11:06:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:55.975089 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dce2a4-b44e-46df-9bfd-1fcf0f27a893 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:56.073979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dce2a4-b44e-46df-9bfd-1fcf0f27a893 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:56.106504 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b48b1-8ddc-4159-8d95-cc9771007a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:56.107288 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b48b1-8ddc-4159-8d95-cc9771007a5b None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:56.107574 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b48b1-8ddc-4159-8d95-cc9771007a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:56.107851 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b48b1-8ddc-4159-8d95-cc9771007a5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:56.119088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b48b1-8ddc-4159-8d95-cc9771007a5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:56.120528 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b48b1-8ddc-4159-8d95-cc9771007a5b None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:56.137601 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-275b48b1-8ddc-4159-8d95-cc9771007a5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:56.137601 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:56.137601 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:56.137601 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:56.137601 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:56.137601 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:56.137601 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:56.137601 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:56.137601 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:56.137601 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:56.137601 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:56.137601 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:56.137601 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:56.137601 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:56.137601 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:56.138827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:56.138827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:56.138827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:56.138827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:56.138827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:56.138827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:56.138827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:56.138827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:56.138827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:56.138827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:56.138827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:56.138827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:56.138827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:56.138827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:56.138827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:56.138827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:56.138827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:56.139735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:56.139735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:56.139735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:56.139735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:56.139735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 547/1082] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:56.144601 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a17b1a-c70c-41ed-b7ad-a881aa9b39e9 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:56.242235 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a17b1a-c70c-41ed-b7ad-a881aa9b39e9 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:56.264018 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:56.274296 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea8592-f9e1-4ae6-b8cc-47ed609e6668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:56.281405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea8592-f9e1-4ae6-b8cc-47ed609e6668 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:56.281405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea8592-f9e1-4ae6-b8cc-47ed609e6668 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:56.281405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea8592-f9e1-4ae6-b8cc-47ed609e6668 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:56.281405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea8592-f9e1-4ae6-b8cc-47ed609e6668 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:56.281405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea8592-f9e1-4ae6-b8cc-47ed609e6668 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:56.281405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea8592-f9e1-4ae6-b8cc-47ed609e6668 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:56.289851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 536/1083] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:56.295385 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b48b1-8ddc-4159-8d95-cc9771007a5b None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:56.311500 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:56.395342 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b48b1-8ddc-4159-8d95-cc9771007a5b None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:56.430411 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540b131-8209-46a1-912b-9eeab84d929b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:56.431542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540b131-8209-46a1-912b-9eeab84d929b None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:56.431831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540b131-8209-46a1-912b-9eeab84d929b None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:56.432108 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540b131-8209-46a1-912b-9eeab84d929b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:56.439542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5540b131-8209-46a1-912b-9eeab84d929b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:56.440988 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5540b131-8209-46a1-912b-9eeab84d929b None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:56.455686 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-5540b131-8209-46a1-912b-9eeab84d929b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 11:06:56.455686 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:56.455686 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:56.455686 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:56.455686 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:56.455686 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:56.455686 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:56.455686 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:56.455686 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:56.455686 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:56.455686 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:56.455686 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:56.455686 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:06:56.455686 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:06:56.455686 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:06:56.455686 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:06:56.456805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:56.456805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:56.456805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:06:56.456805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:56.456805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:06:56.456805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:06:56.456805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:56.456805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:56.456805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:56.456805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:56.456805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:56.456805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:56.456805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:56.456805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:56.456805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:56.456805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:56.456805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:56.456805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:56.457742 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:56.457742 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:56.457742 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:06:56.457742 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:06:56.457742 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:06:56.457742 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:06:56.457742 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:06:56.457742 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:06:56.457742 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 11:06:56.457742 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:56.457742 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 548/1084] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Jul 11 11:06:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:06:56.462874 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea8592-f9e1-4ae6-b8cc-47ed609e6668 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:56.562013 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea8592-f9e1-4ae6-b8cc-47ed609e6668 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:56.597110 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d03fa-9ed1-4656-9502-647be6de6364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:56.597805 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d03fa-9ed1-4656-9502-647be6de6364 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:56.598099 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d03fa-9ed1-4656-9502-647be6de6364 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:56.598380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d03fa-9ed1-4656-9502-647be6de6364 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:56.599226 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d03fa-9ed1-4656-9502-647be6de6364 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:56.599541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d03fa-9ed1-4656-9502-647be6de6364 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:56.600977 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d03fa-9ed1-4656-9502-647be6de6364 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:56.618656 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 537/1085] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Jul 11 11:06:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:06:56.624250 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540b131-8209-46a1-912b-9eeab84d929b None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:56.694743 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:56.724628 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540b131-8209-46a1-912b-9eeab84d929b None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:56.758234 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f9aaf-fe0a-4150-87be-cc3c0d9ca60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:56.758892 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f9aaf-fe0a-4150-87be-cc3c0d9ca60c None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:56.759180 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f9aaf-fe0a-4150-87be-cc3c0d9ca60c None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:56.759463 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f9aaf-fe0a-4150-87be-cc3c0d9ca60c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:56.828594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f9aaf-fe0a-4150-87be-cc3c0d9ca60c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:56.830625 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f9aaf-fe0a-4150-87be-cc3c0d9ca60c None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:56.897059 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:56.907079 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e353605-b864-4d9f-99a5-e11c829e39a5 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:56.907411 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e353605-b864-4d9f-99a5-e11c829e39a5 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:56.907758 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e353605-b864-4d9f-99a5-e11c829e39a5 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:56.909725 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 538/1086] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:06:56.914710 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb551bd9-70a2-43cb-8c82-2255b28de563 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:56.915003 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb551bd9-70a2-43cb-8c82-2255b28de563 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:56.915293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb551bd9-70a2-43cb-8c82-2255b28de563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:56.927919 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 549/1087] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:06:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 11:06:56.932088 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-eb551bd9-70a2-43cb-8c82-2255b28de563 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:56.933283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-eb551bd9-70a2-43cb-8c82-2255b28de563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:56.933735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f9aaf-fe0a-4150-87be-cc3c0d9ca60c None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:56.968756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:56.999291 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 539/1088] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 11:06:57.021522 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb551bd9-70a2-43cb-8c82-2255b28de563 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:57.031114 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f9aaf-fe0a-4150-87be-cc3c0d9ca60c None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:57.065645 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b393664-f7e3-4c40-9add-4018d6c5031b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:57.066464 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b393664-f7e3-4c40-9add-4018d6c5031b None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:57.066751 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b393664-f7e3-4c40-9add-4018d6c5031b None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:57.067032 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b393664-f7e3-4c40-9add-4018d6c5031b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:57.076873 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b393664-f7e3-4c40-9add-4018d6c5031b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:57.078377 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b393664-f7e3-4c40-9add-4018d6c5031b None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:57.096745 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-4b393664-f7e3-4c40-9add-4018d6c5031b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:57.096745 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:57.096745 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:57.096745 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:57.096745 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:57.096745 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:57.096745 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:57.096745 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:57.096745 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:57.096745 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:57.096745 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:57.096745 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:57.096745 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:06:57.096745 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:06:57.096745 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:06:57.097660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:06:57.097660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:57.097660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:57.097660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:57.097660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:57.097660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:57.097660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:57.097660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:57.097660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:57.097660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:57.097660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:57.097660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:57.097660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:57.097660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:57.097660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:57.097660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:57.097660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:57.098705 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:06:57.098705 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:06:57.098705 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:06:57.098705 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:57.098705 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 550/1089] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:06:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:57.103411 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b393664-f7e3-4c40-9add-4018d6c5031b None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:57.119121 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb551bd9-70a2-43cb-8c82-2255b28de563 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:57.127568 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:57.152653 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9b359-9f6c-4a88-a211-1e8ea1c38df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:57.153451 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9b359-9f6c-4a88-a211-1e8ea1c38df8 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:57.153817 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9b359-9f6c-4a88-a211-1e8ea1c38df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:57.154096 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9b359-9f6c-4a88-a211-1e8ea1c38df8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:57.164822 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9b359-9f6c-4a88-a211-1e8ea1c38df8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:06:57.172369 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-71c9b359-9f6c-4a88-a211-1e8ea1c38df8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:06:57.172369 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:57.172369 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:57.172369 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:57.172369 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:57.172369 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:57.172369 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:57.172369 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:57.172369 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:57.172369 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:57.172369 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:57.172369 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:57.172369 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:06:57.172369 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:06:57.172369 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:06:57.172369 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:06:57.173417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:06:57.173417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:06:57.173417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:06:57.173417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:06:57.173417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:57.173417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:57.173417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:57.173417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:57.173417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:57.173417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:57.173417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:57.173417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:57.173417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:57.173417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:57.173417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:57.173417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:57.174540 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:57.174540 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:57.174540 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:57.174540 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:57.174540 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:06:57.174540 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:06:57.174540 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:06:57.174540 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:06:57.174540 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:06:57.174540 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:06:57.174540 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:06:57.174540 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:06:57.174540 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 540/1090] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:06:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:57.179733 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9b359-9f6c-4a88-a211-1e8ea1c38df8 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:57.201445 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b393664-f7e3-4c40-9add-4018d6c5031b None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:57.211472 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:57.235315 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6698c2-9686-4dd9-939f-076ab0bb5eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:57.235906 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6698c2-9686-4dd9-939f-076ab0bb5eba None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:57.236779 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6698c2-9686-4dd9-939f-076ab0bb5eba None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:57.237059 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6698c2-9686-4dd9-939f-076ab0bb5eba None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:57.237969 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6698c2-9686-4dd9-939f-076ab0bb5eba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:57.238287 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6698c2-9686-4dd9-939f-076ab0bb5eba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:57.239651 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6698c2-9686-4dd9-939f-076ab0bb5eba None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:57.250743 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 551/1091] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:06:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:57.256741 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6698c2-9686-4dd9-939f-076ab0bb5eba None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:57.284224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9b359-9f6c-4a88-a211-1e8ea1c38df8 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:57.317645 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472dd739-aac3-402d-965c-ef071f0023b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:57.318341 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472dd739-aac3-402d-965c-ef071f0023b4 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:57.318629 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472dd739-aac3-402d-965c-ef071f0023b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:57.318910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472dd739-aac3-402d-965c-ef071f0023b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:57.319654 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472dd739-aac3-402d-965c-ef071f0023b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:57.319964 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472dd739-aac3-402d-965c-ef071f0023b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:57.321327 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472dd739-aac3-402d-965c-ef071f0023b4 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:57.329309 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 541/1092] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:06:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:57.335652 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472dd739-aac3-402d-965c-ef071f0023b4 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:57.340864 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:57.357976 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6698c2-9686-4dd9-939f-076ab0bb5eba None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:57.391363 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd09ba-61ef-4f75-943d-c043176b6215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:57.392144 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd09ba-61ef-4f75-943d-c043176b6215 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:57.392970 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd09ba-61ef-4f75-943d-c043176b6215 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:57.393326 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd09ba-61ef-4f75-943d-c043176b6215 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:57.399779 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd09ba-61ef-4f75-943d-c043176b6215 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:57.401203 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd09ba-61ef-4f75-943d-c043176b6215 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:57.416025 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-19bd09ba-61ef-4f75-943d-c043176b6215 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:57.416025 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:06:57.416025 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:06:57.416025 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:06:57.416025 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:06:57.416025 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:06:57.416025 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:06:57.416025 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:06:57.416025 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:06:57.416025 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:06:57.416025 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:06:57.416025 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:06:57.416025 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:06:57.416025 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:06:57.416025 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:06:57.417063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:06:57.417063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:06:57.417063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:06:57.417063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:06:57.417063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:06:57.417063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:06:57.417063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:06:57.417063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:06:57.417063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:06:57.417063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:06:57.417063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:06:57.417063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:06:57.417063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:06:57.417063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:06:57.417063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:06:57.417063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:06:57.417063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:06:57.418030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:06:57.418030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:06:57.418030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:06:57.418030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:06:57.418030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:06:57.418030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:06:57.418030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:06:57.418030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:06:57.418030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 552/1093] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:06:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:06:57.422844 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd09ba-61ef-4f75-943d-c043176b6215 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:57.432125 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:57.438497 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472dd739-aac3-402d-965c-ef071f0023b4 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:57.472307 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329614a0-eed3-47fc-aecb-a48b767ae0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:57.473179 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329614a0-eed3-47fc-aecb-a48b767ae0b7 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:57.473462 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329614a0-eed3-47fc-aecb-a48b767ae0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:57.473739 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329614a0-eed3-47fc-aecb-a48b767ae0b7 None admin] PATH_INFO: `/v3/users/90a1bb8e6266420480fa81ed1dc8c8ef` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:57.475127 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329614a0-eed3-47fc-aecb-a48b767ae0b7 None admin] RBAC: Authorizing `identity:get_user(user_id=90a1bb8e6266420480fa81ed1dc8c8ef)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:57.476933 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329614a0-eed3-47fc-aecb-a48b767ae0b7 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:57.478977 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 542/1094] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:06:57 2022] GET /identity/v3/users/90a1bb8e6266420480fa81ed1dc8c8ef => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:57.484597 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329614a0-eed3-47fc-aecb-a48b767ae0b7 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:57.524920 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd09ba-61ef-4f75-943d-c043176b6215 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:57.559136 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b3cd6-c5d4-4894-8da5-851ec38d8168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:57.559791 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b3cd6-c5d4-4894-8da5-851ec38d8168 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:57.560076 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b3cd6-c5d4-4894-8da5-851ec38d8168 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:57.560365 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b3cd6-c5d4-4894-8da5-851ec38d8168 None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:57.561149 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b3cd6-c5d4-4894-8da5-851ec38d8168 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:57.561463 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b3cd6-c5d4-4894-8da5-851ec38d8168 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:57.562929 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b3cd6-c5d4-4894-8da5-851ec38d8168 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:57.574740 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 553/1095] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:06:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:57.581263 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b3cd6-c5d4-4894-8da5-851ec38d8168 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:57.583027 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329614a0-eed3-47fc-aecb-a48b767ae0b7 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:57.584896 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:57.616422 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd426d0-a7f2-4a56-b57c-e938a169b267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:57.617331 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd426d0-a7f2-4a56-b57c-e938a169b267 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:57.617611 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd426d0-a7f2-4a56-b57c-e938a169b267 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:57.617930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd426d0-a7f2-4a56-b57c-e938a169b267 None admin] PATH_INFO: `/v3/projects/2231dff7883b45619ebbbc7bc9865f92` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:57.619094 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd426d0-a7f2-4a56-b57c-e938a169b267 None admin] RBAC: Authorizing `identity:get_project(project_id=2231dff7883b45619ebbbc7bc9865f92)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:57.620512 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd426d0-a7f2-4a56-b57c-e938a169b267 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:57.622241 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 543/1096] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:06:57 2022] GET /identity/v3/projects/2231dff7883b45619ebbbc7bc9865f92 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:57.629051 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd426d0-a7f2-4a56-b57c-e938a169b267 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:06:57.659185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:06:57.679837 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b3cd6-c5d4-4894-8da5-851ec38d8168 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:57.713932 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1445d8-c6ab-457d-b968-2ceb43e2f4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:57.714582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1445d8-c6ab-457d-b968-2ceb43e2f4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:57.714869 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1445d8-c6ab-457d-b968-2ceb43e2f4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:57.715145 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1445d8-c6ab-457d-b968-2ceb43e2f4f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:57.715969 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1445d8-c6ab-457d-b968-2ceb43e2f4f8 None admin] RBAC: Adding query filter params (role.id=4418ec5b68a244968638f90e957b5163, scope.project.id=38ed7416526e473b816330e24acf7a04, user.id=5b9e7594afc346e593ef3e6c579e237b) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:06:57.716280 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1445d8-c6ab-457d-b968-2ceb43e2f4f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:57.717696 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1445d8-c6ab-457d-b968-2ceb43e2f4f8 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:57.723594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 554/1097] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:06:57 2022] GET /identity/v3/role_assignments?user.id=5b9e7594afc346e593ef3e6c579e237b&scope.project.id=38ed7416526e473b816330e24acf7a04&role.id=4418ec5b68a244968638f90e957b5163 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:06:57.730256 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd426d0-a7f2-4a56-b57c-e938a169b267 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:06:57.770172 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4efdf-e7ff-4f92-9cbf-d78b3225311b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:06:57.771387 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4efdf-e7ff-4f92-9cbf-d78b3225311b None admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:57.771953 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4efdf-e7ff-4f92-9cbf-d78b3225311b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:57.772434 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4efdf-e7ff-4f92-9cbf-d78b3225311b None admin] PATH_INFO: `/v3/projects/2231dff7883b45619ebbbc7bc9865f92/users/90a1bb8e6266420480fa81ed1dc8c8ef/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:57.775341 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4efdf-e7ff-4f92-9cbf-d78b3225311b None admin] RBAC: Authorizing `identity:create_grant(project_id=2231dff7883b45619ebbbc7bc9865f92, user_id=90a1bb8e6266420480fa81ed1dc8c8ef, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:06:57.776818 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4efdf-e7ff-4f92-9cbf-d78b3225311b None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:06:57.904514 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 544/1098] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jul 11 11:06:57 2022] PUT /identity/v3/projects/2231dff7883b45619ebbbc7bc9865f92/users/90a1bb8e6266420480fa81ed1dc8c8ef/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:06:59.905267 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33d2c7-2c1a-4fda-bbd3-949153f25fde None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:59.905847 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33d2c7-2c1a-4fda-bbd3-949153f25fde None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:59.905847 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33d2c7-2c1a-4fda-bbd3-949153f25fde None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:59.907221 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 555/1099] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:06:59.912324 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f69b27-e8a3-4aec-801b-d9fddc61a891 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:06:59.912707 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f69b27-e8a3-4aec-801b-d9fddc61a891 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:06:59.912897 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f69b27-e8a3-4aec-801b-d9fddc61a891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:06:59.929275 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-e1f69b27-e8a3-4aec-801b-d9fddc61a891 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:06:59.930504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e1f69b27-e8a3-4aec-801b-d9fddc61a891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:06:59.995096 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 545/1100] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:06:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 11:07:00.020390 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33d2c7-2c1a-4fda-bbd3-949153f25fde None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:00.086305 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:00.119467 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33d2c7-2c1a-4fda-bbd3-949153f25fde None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:00.151435 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69508294-9038-437b-a9f4-7a511102808c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:00.152207 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69508294-9038-437b-a9f4-7a511102808c None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:00.152491 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69508294-9038-437b-a9f4-7a511102808c None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:00.152766 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69508294-9038-437b-a9f4-7a511102808c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:00.162524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69508294-9038-437b-a9f4-7a511102808c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:07:00.170128 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-69508294-9038-437b-a9f4-7a511102808c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:07:00.170128 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:07:00.170128 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:07:00.170128 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:07:00.170128 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:07:00.170128 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:07:00.170128 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:07:00.170128 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:07:00.170128 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:07:00.170128 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:07:00.170128 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:07:00.170128 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:07:00.170128 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:07:00.170128 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:07:00.170128 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:07:00.170128 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:07:00.171268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:07:00.171268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:07:00.171268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:07:00.171268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:07:00.171268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:07:00.171268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:07:00.171268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:07:00.171268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:07:00.171268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:07:00.171268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:07:00.171268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:07:00.171268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:07:00.171268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:07:00.171268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:07:00.171268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:07:00.171268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:07:00.172553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:07:00.172553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:07:00.172553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:07:00.172553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:07:00.172553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:07:00.172553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:07:00.172553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:07:00.172553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:07:00.172553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:07:00.172553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:07:00.172553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:07:00.172553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:07:00.172553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 556/1101] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:07:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:07:00.177773 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f69b27-e8a3-4aec-801b-d9fddc61a891 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:00.198965 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:00.274014 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f69b27-e8a3-4aec-801b-d9fddc61a891 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:00.306483 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794a3fd-2c6f-4197-851e-8d40802f88d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:00.307135 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794a3fd-2c6f-4197-851e-8d40802f88d5 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:00.307423 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794a3fd-2c6f-4197-851e-8d40802f88d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:00.307704 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794a3fd-2c6f-4197-851e-8d40802f88d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:00.308698 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c794a3fd-2c6f-4197-851e-8d40802f88d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:07:00.309010 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c794a3fd-2c6f-4197-851e-8d40802f88d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:00.310400 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c794a3fd-2c6f-4197-851e-8d40802f88d5 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:00.318962 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 546/1102] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:07:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:00.324741 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69508294-9038-437b-a9f4-7a511102808c None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:00.421183 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69508294-9038-437b-a9f4-7a511102808c None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:00.447056 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:00.454599 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90975264-f879-454b-9f20-77bebee8a162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:00.456536 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90975264-f879-454b-9f20-77bebee8a162 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:00.456536 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90975264-f879-454b-9f20-77bebee8a162 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:00.456536 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90975264-f879-454b-9f20-77bebee8a162 None admin] PATH_INFO: `/v3/users/90a1bb8e6266420480fa81ed1dc8c8ef` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:00.457315 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90975264-f879-454b-9f20-77bebee8a162 None admin] RBAC: Authorizing `identity:get_user(user_id=90a1bb8e6266420480fa81ed1dc8c8ef)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:00.458794 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90975264-f879-454b-9f20-77bebee8a162 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:00.460414 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 557/1103] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:07:00 2022] GET /identity/v3/users/90a1bb8e6266420480fa81ed1dc8c8ef => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:00.466191 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794a3fd-2c6f-4197-851e-8d40802f88d5 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:00.546138 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:00.563664 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794a3fd-2c6f-4197-851e-8d40802f88d5 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:00.597246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd3fca-642b-4c63-bf88-766f93fed850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:00.597922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd3fca-642b-4c63-bf88-766f93fed850 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:00.598210 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd3fca-642b-4c63-bf88-766f93fed850 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:00.598489 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd3fca-642b-4c63-bf88-766f93fed850 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:00.663548 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd3fca-642b-4c63-bf88-766f93fed850 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:00.664980 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd3fca-642b-4c63-bf88-766f93fed850 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:00.742282 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:00.760463 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 547/1104] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:07:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 11:07:00.766519 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90975264-f879-454b-9f20-77bebee8a162 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:00.865990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90975264-f879-454b-9f20-77bebee8a162 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:00.898895 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d329820-810d-499e-8bd1-d78a83a3a177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:00.902354 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d329820-810d-499e-8bd1-d78a83a3a177 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:00.902354 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d329820-810d-499e-8bd1-d78a83a3a177 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:00.902354 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d329820-810d-499e-8bd1-d78a83a3a177 None admin] PATH_INFO: `/v3/projects/2231dff7883b45619ebbbc7bc9865f92` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:00.902354 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d329820-810d-499e-8bd1-d78a83a3a177 None admin] RBAC: Authorizing `identity:get_project(project_id=2231dff7883b45619ebbbc7bc9865f92)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:00.902959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d329820-810d-499e-8bd1-d78a83a3a177 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:00.904651 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 558/1105] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:07:00 2022] GET /identity/v3/projects/2231dff7883b45619ebbbc7bc9865f92 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:00.911716 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd3fca-642b-4c63-bf88-766f93fed850 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:01.007233 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd3fca-642b-4c63-bf88-766f93fed850 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:01.040977 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4ce7a-f898-4ba1-b8c8-7325638ef878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:01.041621 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4ce7a-f898-4ba1-b8c8-7325638ef878 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:01.041937 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4ce7a-f898-4ba1-b8c8-7325638ef878 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:01.042221 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4ce7a-f898-4ba1-b8c8-7325638ef878 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:01.043050 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4ce7a-f898-4ba1-b8c8-7325638ef878 None admin] RBAC: Adding query filter params (role.id=736e70deba004b9289c2fed43eb107f7, scope.project.id=2231dff7883b45619ebbbc7bc9865f92, user.id=90a1bb8e6266420480fa81ed1dc8c8ef) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:07:01.043364 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4ce7a-f898-4ba1-b8c8-7325638ef878 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:01.044783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4ce7a-f898-4ba1-b8c8-7325638ef878 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:01.050890 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 548/1106] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:07:00 2022] GET /identity/v3/role_assignments?user.id=90a1bb8e6266420480fa81ed1dc8c8ef&scope.project.id=2231dff7883b45619ebbbc7bc9865f92&role.id=736e70deba004b9289c2fed43eb107f7 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:03.089418 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249c0b7-5f57-4cb0-9c4c-f98ffe51f9c1 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:03.089990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249c0b7-5f57-4cb0-9c4c-f98ffe51f9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:03.089990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249c0b7-5f57-4cb0-9c4c-f98ffe51f9c1 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:03.091373 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 559/1107] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:07:03.097003 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c7fe8-9d61-440b-a61e-3490f81cc5c3 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:03.097415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c7fe8-9d61-440b-a61e-3490f81cc5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:03.097568 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c7fe8-9d61-440b-a61e-3490f81cc5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:03.113936 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-c59c7fe8-9d61-440b-a61e-3490f81cc5c3 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:07:03.115111 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c59c7fe8-9d61-440b-a61e-3490f81cc5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:07:03.155146 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:03.179115 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 549/1108] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:07:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:07:03.203573 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249c0b7-5f57-4cb0-9c4c-f98ffe51f9c1 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:03.265260 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:03.303855 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249c0b7-5f57-4cb0-9c4c-f98ffe51f9c1 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:03.336303 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f20c3a-f8d7-4678-ab29-aecdd637e820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:03.337071 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f20c3a-f8d7-4678-ab29-aecdd637e820 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:03.337352 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f20c3a-f8d7-4678-ab29-aecdd637e820 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:03.337625 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f20c3a-f8d7-4678-ab29-aecdd637e820 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:03.338932 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f20c3a-f8d7-4678-ab29-aecdd637e820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:03.340397 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f20c3a-f8d7-4678-ab29-aecdd637e820 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:03.341970 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 560/1109] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:07:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:03.348178 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c7fe8-9d61-440b-a61e-3490f81cc5c3 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:03.443028 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c7fe8-9d61-440b-a61e-3490f81cc5c3 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:03.475555 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abaebb-e01c-48a5-9150-d9a49e3dd709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:03.476216 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abaebb-e01c-48a5-9150-d9a49e3dd709 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:03.476500 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abaebb-e01c-48a5-9150-d9a49e3dd709 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:03.476776 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abaebb-e01c-48a5-9150-d9a49e3dd709 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:03.477478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84abaebb-e01c-48a5-9150-d9a49e3dd709 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:03.478921 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84abaebb-e01c-48a5-9150-d9a49e3dd709 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:03.589168 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 550/1110] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jul 11 11:07:03 2022] POST /identity/v3/users => generated 286 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:07:05.668803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b2084-e1bd-457b-95cf-68dd487f7b81 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:05.669360 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b2084-e1bd-457b-95cf-68dd487f7b81 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:05.669360 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b2084-e1bd-457b-95cf-68dd487f7b81 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:05.670767 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 561/1111] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:07:05.676059 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6810c03-422d-4a84-8318-18e7c9f8feb1 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:05.676488 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6810c03-422d-4a84-8318-18e7c9f8feb1 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:05.676622 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6810c03-422d-4a84-8318-18e7c9f8feb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:05.693842 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-a6810c03-422d-4a84-8318-18e7c9f8feb1 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:07:05.695013 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a6810c03-422d-4a84-8318-18e7c9f8feb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:07:05.719722 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:05.764305 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 551/1112] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:07:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:07:05.788750 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b2084-e1bd-457b-95cf-68dd487f7b81 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:05.888349 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b2084-e1bd-457b-95cf-68dd487f7b81 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:05.916410 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:05.920976 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3b52d-2e1d-44e7-a3e7-8b4ed5f35394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:05.921776 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3b52d-2e1d-44e7-a3e7-8b4ed5f35394 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:05.922089 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3b52d-2e1d-44e7-a3e7-8b4ed5f35394 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:05.922366 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3b52d-2e1d-44e7-a3e7-8b4ed5f35394 None admin] PATH_INFO: `/v3/roles/da398232f5f14edc908b967ea8653212` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:05.924007 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3b52d-2e1d-44e7-a3e7-8b4ed5f35394 None admin] RBAC: Authorizing `identity:get_role(role_id=da398232f5f14edc908b967ea8653212)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:05.925456 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3b52d-2e1d-44e7-a3e7-8b4ed5f35394 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:05.926851 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 562/1113] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:07:05 2022] GET /identity/v3/roles/da398232f5f14edc908b967ea8653212 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:05.932744 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6810c03-422d-4a84-8318-18e7c9f8feb1 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:06.027888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6810c03-422d-4a84-8318-18e7c9f8feb1 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:06.060435 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289591a-e914-4900-8fd4-a76c4b40af24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:06.061287 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289591a-e914-4900-8fd4-a76c4b40af24 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:06.061566 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289591a-e914-4900-8fd4-a76c4b40af24 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:06.061866 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289591a-e914-4900-8fd4-a76c4b40af24 None admin] PATH_INFO: `/v3/users/c9e5823d6a4f4c469ae425041b66181c` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:06.074864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289591a-e914-4900-8fd4-a76c4b40af24 None admin] RBAC: Authorizing `identity:get_user(user_id=c9e5823d6a4f4c469ae425041b66181c)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:06.076290 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289591a-e914-4900-8fd4-a76c4b40af24 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:06.077953 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 552/1114] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:07:05 2022] GET /identity/v3/users/c9e5823d6a4f4c469ae425041b66181c => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:06.083712 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3b52d-2e1d-44e7-a3e7-8b4ed5f35394 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:06.180469 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3b52d-2e1d-44e7-a3e7-8b4ed5f35394 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:06.213111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9760117-7d72-47f2-8e4c-55b9d505c51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:06.213746 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9760117-7d72-47f2-8e4c-55b9d505c51f None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:06.214059 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9760117-7d72-47f2-8e4c-55b9d505c51f None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:06.214335 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9760117-7d72-47f2-8e4c-55b9d505c51f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:06.275877 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:06.278193 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9760117-7d72-47f2-8e4c-55b9d505c51f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:06.279631 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9760117-7d72-47f2-8e4c-55b9d505c51f None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:06.374132 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 563/1115] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:07:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 11:07:06.380264 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289591a-e914-4900-8fd4-a76c4b40af24 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:06.401430 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:06.476476 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289591a-e914-4900-8fd4-a76c4b40af24 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:06.508671 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab121d-9893-4d25-9096-ed13aa62607f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:06.509510 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab121d-9893-4d25-9096-ed13aa62607f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:06.509815 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab121d-9893-4d25-9096-ed13aa62607f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:06.510095 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab121d-9893-4d25-9096-ed13aa62607f None admin] PATH_INFO: `/v3/projects/2231dff7883b45619ebbbc7bc9865f92` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:06.511254 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab121d-9893-4d25-9096-ed13aa62607f None admin] RBAC: Authorizing `identity:get_project(project_id=2231dff7883b45619ebbbc7bc9865f92)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:06.512666 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab121d-9893-4d25-9096-ed13aa62607f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:06.514365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 553/1116] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:07:06 2022] GET /identity/v3/projects/2231dff7883b45619ebbbc7bc9865f92 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:06.520947 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9760117-7d72-47f2-8e4c-55b9d505c51f None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:06.620717 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:06.623552 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9760117-7d72-47f2-8e4c-55b9d505c51f None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:06.657611 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd91511-c433-4d0a-a827-f6a1bd2bb56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:06.658295 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd91511-c433-4d0a-a827-f6a1bd2bb56e None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:06.658582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd91511-c433-4d0a-a827-f6a1bd2bb56e None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:06.658854 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd91511-c433-4d0a-a827-f6a1bd2bb56e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:06.659680 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd91511-c433-4d0a-a827-f6a1bd2bb56e None admin] RBAC: Adding query filter params (role.id=da398232f5f14edc908b967ea8653212, scope.project.id=2231dff7883b45619ebbbc7bc9865f92, user.id=c9e5823d6a4f4c469ae425041b66181c) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:07:06.659994 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd91511-c433-4d0a-a827-f6a1bd2bb56e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:06.661422 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd91511-c433-4d0a-a827-f6a1bd2bb56e None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:06.666757 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 564/1117] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:07:06 2022] GET /identity/v3/role_assignments?user.id=c9e5823d6a4f4c469ae425041b66181c&scope.project.id=2231dff7883b45619ebbbc7bc9865f92&role.id=da398232f5f14edc908b967ea8653212 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:08.679133 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf97dd-1e43-4dd8-80ae-329ec9062074 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:08.679708 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf97dd-1e43-4dd8-80ae-329ec9062074 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:08.679708 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf97dd-1e43-4dd8-80ae-329ec9062074 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:08.681053 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 554/1118] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:07:08.686436 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671dc9d-1b95-40fa-a6a3-78a19190fb6c None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:08.686858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671dc9d-1b95-40fa-a6a3-78a19190fb6c None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:08.687048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671dc9d-1b95-40fa-a6a3-78a19190fb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:08.704093 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-a671dc9d-1b95-40fa-a6a3-78a19190fb6c None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:07:08.705269 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-a671dc9d-1b95-40fa-a6a3-78a19190fb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:07:08.770951 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 565/1119] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:07:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:07:08.794305 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf97dd-1e43-4dd8-80ae-329ec9062074 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:08.881088 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:08.893477 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf97dd-1e43-4dd8-80ae-329ec9062074 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:08.927134 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112f923-6998-42eb-841d-d90fd300e8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:08.927964 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112f923-6998-42eb-841d-d90fd300e8a1 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:08.928243 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112f923-6998-42eb-841d-d90fd300e8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:08.928518 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112f923-6998-42eb-841d-d90fd300e8a1 None admin] PATH_INFO: `/v3/roles/da398232f5f14edc908b967ea8653212` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:08.930054 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112f923-6998-42eb-841d-d90fd300e8a1 None admin] RBAC: Authorizing `identity:get_role(role_id=da398232f5f14edc908b967ea8653212)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:08.931353 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112f923-6998-42eb-841d-d90fd300e8a1 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:08.932712 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 555/1120] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:07:08 2022] GET /identity/v3/roles/da398232f5f14edc908b967ea8653212 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:08.938797 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671dc9d-1b95-40fa-a6a3-78a19190fb6c None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:09.027412 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:09.034260 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671dc9d-1b95-40fa-a6a3-78a19190fb6c None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:09.068183 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb896bb-3ad1-45a3-afaf-4e6d3d9b894f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:09.069035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb896bb-3ad1-45a3-afaf-4e6d3d9b894f None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:09.069320 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb896bb-3ad1-45a3-afaf-4e6d3d9b894f None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:09.069597 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb896bb-3ad1-45a3-afaf-4e6d3d9b894f None admin] PATH_INFO: `/v3/users/c9e5823d6a4f4c469ae425041b66181c` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:09.070793 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb896bb-3ad1-45a3-afaf-4e6d3d9b894f None admin] RBAC: Authorizing `identity:get_user(user_id=c9e5823d6a4f4c469ae425041b66181c)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:09.072211 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb896bb-3ad1-45a3-afaf-4e6d3d9b894f None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:09.073855 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 566/1121] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:07:08 2022] GET /identity/v3/users/c9e5823d6a4f4c469ae425041b66181c => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:09.080043 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112f923-6998-42eb-841d-d90fd300e8a1 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:09.174539 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112f923-6998-42eb-841d-d90fd300e8a1 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:09.207216 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f12074-bec1-491b-bdab-dbf66ca5498a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:09.207989 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f12074-bec1-491b-bdab-dbf66ca5498a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:09.208269 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f12074-bec1-491b-bdab-dbf66ca5498a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:09.208543 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f12074-bec1-491b-bdab-dbf66ca5498a None admin] PATH_INFO: `/v3/projects/2231dff7883b45619ebbbc7bc9865f92` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:09.209693 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f12074-bec1-491b-bdab-dbf66ca5498a None admin] RBAC: Authorizing `identity:get_project(project_id=2231dff7883b45619ebbbc7bc9865f92)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:09.211125 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f12074-bec1-491b-bdab-dbf66ca5498a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:09.212784 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 556/1122] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:07:09 2022] GET /identity/v3/projects/2231dff7883b45619ebbbc7bc9865f92 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:09.218638 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb896bb-3ad1-45a3-afaf-4e6d3d9b894f None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:09.315821 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb896bb-3ad1-45a3-afaf-4e6d3d9b894f None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:09.348852 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1dd8e-29ef-44bc-ae45-578629bbf37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:09.349731 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1dd8e-29ef-44bc-ae45-578629bbf37b None admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:09.350047 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1dd8e-29ef-44bc-ae45-578629bbf37b None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:09.350323 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1dd8e-29ef-44bc-ae45-578629bbf37b None admin] PATH_INFO: `/v3/projects/2231dff7883b45619ebbbc7bc9865f92/users/c9e5823d6a4f4c469ae425041b66181c/roles/da398232f5f14edc908b967ea8653212` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:09.352490 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df1dd8e-29ef-44bc-ae45-578629bbf37b None admin] RBAC: Authorizing `identity:create_grant(project_id=2231dff7883b45619ebbbc7bc9865f92, user_id=c9e5823d6a4f4c469ae425041b66181c, role_id=da398232f5f14edc908b967ea8653212)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:09.353959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df1dd8e-29ef-44bc-ae45-578629bbf37b None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:09.423364 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 567/1123] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jul 11 11:07:09 2022] PUT /identity/v3/projects/2231dff7883b45619ebbbc7bc9865f92/users/c9e5823d6a4f4c469ae425041b66181c/roles/da398232f5f14edc908b967ea8653212 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:07:11.410131 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac711d7e-4b91-4304-b858-19363052b1d9 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:11.410681 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac711d7e-4b91-4304-b858-19363052b1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:11.410681 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac711d7e-4b91-4304-b858-19363052b1d9 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:11.412072 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 557/1124] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:07:11.417405 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1679ee-dbaa-4650-9279-62a0cfdb9eb0 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:11.417808 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1679ee-dbaa-4650-9279-62a0cfdb9eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:11.418003 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1679ee-dbaa-4650-9279-62a0cfdb9eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:11.434935 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-db1679ee-dbaa-4650-9279-62a0cfdb9eb0 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:07:11.436108 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-db1679ee-dbaa-4650-9279-62a0cfdb9eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:07:11.452511 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:11.502524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 568/1125] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:07:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:07:11.525298 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac711d7e-4b91-4304-b858-19363052b1d9 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:11.550473 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:11.625712 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac711d7e-4b91-4304-b858-19363052b1d9 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:11.659419 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f01305-3aef-48af-9f43-f504a39871aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:11.660301 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f01305-3aef-48af-9f43-f504a39871aa None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:11.660541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f01305-3aef-48af-9f43-f504a39871aa None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:11.660821 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f01305-3aef-48af-9f43-f504a39871aa None admin] PATH_INFO: `/v3/roles/da398232f5f14edc908b967ea8653212` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:11.662321 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f01305-3aef-48af-9f43-f504a39871aa None admin] RBAC: Authorizing `identity:get_role(role_id=da398232f5f14edc908b967ea8653212)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:11.663668 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f01305-3aef-48af-9f43-f504a39871aa None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:11.665037 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 558/1126] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:07:11 2022] GET /identity/v3/roles/da398232f5f14edc908b967ea8653212 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:11.670850 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1679ee-dbaa-4650-9279-62a0cfdb9eb0 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:11.769934 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1679ee-dbaa-4650-9279-62a0cfdb9eb0 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:11.802148 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95750056-94b2-4f37-85ed-9c16467d4d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:11.803002 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95750056-94b2-4f37-85ed-9c16467d4d16 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:11.803286 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95750056-94b2-4f37-85ed-9c16467d4d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:11.803563 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95750056-94b2-4f37-85ed-9c16467d4d16 None admin] PATH_INFO: `/v3/users/c9e5823d6a4f4c469ae425041b66181c` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:11.804724 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95750056-94b2-4f37-85ed-9c16467d4d16 None admin] RBAC: Authorizing `identity:get_user(user_id=c9e5823d6a4f4c469ae425041b66181c)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:11.806179 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95750056-94b2-4f37-85ed-9c16467d4d16 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:11.807798 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 569/1127] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:07:11 2022] GET /identity/v3/users/c9e5823d6a4f4c469ae425041b66181c => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:11.813714 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f01305-3aef-48af-9f43-f504a39871aa None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:11.902175 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:11.910871 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f01305-3aef-48af-9f43-f504a39871aa None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:11.944300 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ddfd1-3ed7-4e8d-bd39-794d04a48255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:11.944939 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ddfd1-3ed7-4e8d-bd39-794d04a48255 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:11.945224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ddfd1-3ed7-4e8d-bd39-794d04a48255 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:11.945504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ddfd1-3ed7-4e8d-bd39-794d04a48255 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:12.010013 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ddfd1-3ed7-4e8d-bd39-794d04a48255 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:12.011436 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ddfd1-3ed7-4e8d-bd39-794d04a48255 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:12.097012 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:12.105753 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 559/1128] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:07:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 11:07:12.111765 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95750056-94b2-4f37-85ed-9c16467d4d16 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:12.132850 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:12.209658 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95750056-94b2-4f37-85ed-9c16467d4d16 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:12.242653 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e980c-1430-438b-8f34-8956d459a4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:12.243489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e980c-1430-438b-8f34-8956d459a4c3 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:12.243770 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e980c-1430-438b-8f34-8956d459a4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:12.244040 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e980c-1430-438b-8f34-8956d459a4c3 None admin] PATH_INFO: `/v3/projects/2231dff7883b45619ebbbc7bc9865f92` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:12.245189 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e980c-1430-438b-8f34-8956d459a4c3 None admin] RBAC: Authorizing `identity:get_project(project_id=2231dff7883b45619ebbbc7bc9865f92)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:12.246629 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e980c-1430-438b-8f34-8956d459a4c3 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:12.248312 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 570/1129] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:07:12 2022] GET /identity/v3/projects/2231dff7883b45619ebbbc7bc9865f92 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:07:12.254440 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ddfd1-3ed7-4e8d-bd39-794d04a48255 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:12.350211 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ddfd1-3ed7-4e8d-bd39-794d04a48255 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:12.382300 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d85f03-f3d4-4c71-9c8e-69c451ba913e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:12.382940 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d85f03-f3d4-4c71-9c8e-69c451ba913e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:12.383222 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d85f03-f3d4-4c71-9c8e-69c451ba913e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:12.383501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d85f03-f3d4-4c71-9c8e-69c451ba913e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:12.384316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d85f03-f3d4-4c71-9c8e-69c451ba913e None admin] RBAC: Adding query filter params (role.id=da398232f5f14edc908b967ea8653212, scope.project.id=2231dff7883b45619ebbbc7bc9865f92, user.id=c9e5823d6a4f4c469ae425041b66181c) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:07:12.384626 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d85f03-f3d4-4c71-9c8e-69c451ba913e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:12.386170 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d85f03-f3d4-4c71-9c8e-69c451ba913e None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:12.391723 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 560/1130] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:07:12 2022] GET /identity/v3/role_assignments?user.id=c9e5823d6a4f4c469ae425041b66181c&scope.project.id=2231dff7883b45619ebbbc7bc9865f92&role.id=da398232f5f14edc908b967ea8653212 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:14.401754 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d7356-a22d-4a91-b5c9-cc57d86ba707 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:14.402310 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d7356-a22d-4a91-b5c9-cc57d86ba707 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:14.402310 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d7356-a22d-4a91-b5c9-cc57d86ba707 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:14.403711 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 571/1131] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:07:14.408802 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6060b3-ece1-4533-af57-08be6d839f03 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:14.409182 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6060b3-ece1-4533-af57-08be6d839f03 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:14.409362 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6060b3-ece1-4533-af57-08be6d839f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:14.426210 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-aa6060b3-ece1-4533-af57-08be6d839f03 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:07:14.427376 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-aa6060b3-ece1-4533-af57-08be6d839f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:07:14.476035 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:14.492144 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 561/1132] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:07:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:07:14.515937 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d7356-a22d-4a91-b5c9-cc57d86ba707 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:14.601302 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:14.614019 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d7356-a22d-4a91-b5c9-cc57d86ba707 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:14.647485 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6e93c-bb5f-4afc-8c2d-907659325ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:14.648258 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6e93c-bb5f-4afc-8c2d-907659325ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:14.648540 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6e93c-bb5f-4afc-8c2d-907659325ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:14.648815 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6e93c-bb5f-4afc-8c2d-907659325ec4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:14.649987 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6e93c-bb5f-4afc-8c2d-907659325ec4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:14.651404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6e93c-bb5f-4afc-8c2d-907659325ec4 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:14.653039 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 572/1133] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:07:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:14.659650 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6060b3-ece1-4533-af57-08be6d839f03 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:14.758426 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6060b3-ece1-4533-af57-08be6d839f03 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:14.793504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff24b5-e807-4946-b320-0fc850de5b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:14.794206 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff24b5-e807-4946-b320-0fc850de5b48 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:14.794494 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff24b5-e807-4946-b320-0fc850de5b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:14.794771 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff24b5-e807-4946-b320-0fc850de5b48 None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:14.795476 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff24b5-e807-4946-b320-0fc850de5b48 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:14.796898 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff24b5-e807-4946-b320-0fc850de5b48 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:14.956208 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 562/1134] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Jul 11 11:07:14 2022] POST /identity/v3/projects => generated 311 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:07:16.983123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875165f-8e51-4b0e-8d65-9ef55d8de2c9 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:16.983660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875165f-8e51-4b0e-8d65-9ef55d8de2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:16.983660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875165f-8e51-4b0e-8d65-9ef55d8de2c9 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:16.985032 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 573/1135] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:07:16.990251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017e533-033b-4ce4-af07-c10eda6a8f1d None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:16.990665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017e533-033b-4ce4-af07-c10eda6a8f1d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:16.990815 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017e533-033b-4ce4-af07-c10eda6a8f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:17.007499 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-3017e533-033b-4ce4-af07-c10eda6a8f1d None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:07:17.008665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3017e533-033b-4ce4-af07-c10eda6a8f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:07:17.037089 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:17.073517 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 563/1136] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:07:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:07:17.098602 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875165f-8e51-4b0e-8d65-9ef55d8de2c9 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:17.196313 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875165f-8e51-4b0e-8d65-9ef55d8de2c9 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:17.229613 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c3518-228a-446b-a59a-7cbf73522207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:17.230410 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c3518-228a-446b-a59a-7cbf73522207 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:17.230697 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c3518-228a-446b-a59a-7cbf73522207 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:17.230977 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c3518-228a-446b-a59a-7cbf73522207 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:17.232134 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c3518-228a-446b-a59a-7cbf73522207 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:17.233555 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c3518-228a-446b-a59a-7cbf73522207 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:17.235175 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 574/1137] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:07:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:17.241520 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017e533-033b-4ce4-af07-c10eda6a8f1d None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:17.335750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017e533-033b-4ce4-af07-c10eda6a8f1d None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:17.368134 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e6db9-b8a1-4290-b401-f463caddd0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:17.368796 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e6db9-b8a1-4290-b401-f463caddd0ef None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:17.369080 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e6db9-b8a1-4290-b401-f463caddd0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:17.369357 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e6db9-b8a1-4290-b401-f463caddd0ef None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:17.370100 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e6db9-b8a1-4290-b401-f463caddd0ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:17.371528 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e6db9-b8a1-4290-b401-f463caddd0ef None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:17.456645 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 564/1138] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jul 11 11:07:17 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:07:19.518752 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77853957-2011-4140-bbd1-fb218f8bde9f None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:19.519283 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77853957-2011-4140-bbd1-fb218f8bde9f None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:19.519283 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77853957-2011-4140-bbd1-fb218f8bde9f None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:19.520665 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 575/1139] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:07:19.525844 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d9cfc-a54e-40ea-8f38-142c32bb12ac None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:19.526226 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d9cfc-a54e-40ea-8f38-142c32bb12ac None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:19.526405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d9cfc-a54e-40ea-8f38-142c32bb12ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:19.543290 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-148d9cfc-a54e-40ea-8f38-142c32bb12ac None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:07:19.544466 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-148d9cfc-a54e-40ea-8f38-142c32bb12ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:07:19.562064 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:19.610058 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 565/1140] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:07:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:07:19.633605 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77853957-2011-4140-bbd1-fb218f8bde9f None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:19.658725 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:19.731743 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77853957-2011-4140-bbd1-fb218f8bde9f None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:19.765354 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94605f86-c220-4569-9721-c1fd728bff42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:19.766173 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94605f86-c220-4569-9721-c1fd728bff42 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:19.766458 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94605f86-c220-4569-9721-c1fd728bff42 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:19.766841 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94605f86-c220-4569-9721-c1fd728bff42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:19.777121 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94605f86-c220-4569-9721-c1fd728bff42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:07:19.784660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-94605f86-c220-4569-9721-c1fd728bff42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:07:19.784660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:07:19.784660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:07:19.784660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:07:19.784660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:07:19.784660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:07:19.784660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:07:19.784660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:07:19.784660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:07:19.784660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:07:19.784660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:07:19.784660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:07:19.784660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:07:19.784660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:07:19.784660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:07:19.784660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:07:19.786513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:07:19.786513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:07:19.786513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:07:19.786513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:07:19.786513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:07:19.786513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:07:19.786513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:07:19.786513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:07:19.786513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:07:19.786513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:07:19.786513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:07:19.786513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:07:19.786513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:07:19.786513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:07:19.786513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:07:19.786513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:07:19.787541 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:07:19.787541 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:07:19.787541 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:07:19.787541 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:07:19.787541 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:07:19.787541 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:07:19.787541 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:07:19.787541 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:07:19.787541 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:07:19.787541 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:07:19.787541 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:07:19.787541 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:07:19.788426 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 576/1141] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:07:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:07:19.791771 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d9cfc-a54e-40ea-8f38-142c32bb12ac None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:19.887367 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d9cfc-a54e-40ea-8f38-142c32bb12ac None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:19.919085 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3ecf2-172a-4190-971e-eb9c67d47fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:19.919740 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3ecf2-172a-4190-971e-eb9c67d47fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:19.920021 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3ecf2-172a-4190-971e-eb9c67d47fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:19.920293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3ecf2-172a-4190-971e-eb9c67d47fb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:19.921028 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3ecf2-172a-4190-971e-eb9c67d47fb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:07:19.921336 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3ecf2-172a-4190-971e-eb9c67d47fb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:19.922707 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3ecf2-172a-4190-971e-eb9c67d47fb3 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:19.931088 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 566/1142] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:07:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:19.937021 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94605f86-c220-4569-9721-c1fd728bff42 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:20.018640 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:20.033737 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94605f86-c220-4569-9721-c1fd728bff42 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:20.066794 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ed185-0aa7-4735-97ad-f5903cfd8c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:20.067640 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ed185-0aa7-4735-97ad-f5903cfd8c81 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:20.067924 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ed185-0aa7-4735-97ad-f5903cfd8c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:20.068199 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ed185-0aa7-4735-97ad-f5903cfd8c81 None admin] PATH_INFO: `/v3/users/f9ed9f2ec90146118aeba147a8c66f21` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:20.081348 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ed185-0aa7-4735-97ad-f5903cfd8c81 None admin] RBAC: Authorizing `identity:get_user(user_id=f9ed9f2ec90146118aeba147a8c66f21)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:20.082802 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ed185-0aa7-4735-97ad-f5903cfd8c81 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:20.084424 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 577/1143] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:07:19 2022] GET /identity/v3/users/f9ed9f2ec90146118aeba147a8c66f21 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:20.090102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3ecf2-172a-4190-971e-eb9c67d47fb3 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:20.107991 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:20.186657 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3ecf2-172a-4190-971e-eb9c67d47fb3 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:20.219090 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd320cbb-5c03-454d-9287-1cb9ff222b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:20.219726 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd320cbb-5c03-454d-9287-1cb9ff222b9d None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:20.220034 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd320cbb-5c03-454d-9287-1cb9ff222b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:20.220313 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd320cbb-5c03-454d-9287-1cb9ff222b9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:20.283961 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd320cbb-5c03-454d-9287-1cb9ff222b9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:20.285330 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd320cbb-5c03-454d-9287-1cb9ff222b9d None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:20.301975 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:20.381105 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 567/1144] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:07:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 11:07:20.386898 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ed185-0aa7-4735-97ad-f5903cfd8c81 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:20.484145 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ed185-0aa7-4735-97ad-f5903cfd8c81 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:20.517283 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265292e-29d9-4714-aa4a-9ecd2bc48eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:20.518146 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265292e-29d9-4714-aa4a-9ecd2bc48eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:20.518434 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265292e-29d9-4714-aa4a-9ecd2bc48eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:20.518713 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265292e-29d9-4714-aa4a-9ecd2bc48eb2 None admin] PATH_INFO: `/v3/projects/59c178e47e8544efb9bf4f80724f8c4f` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:20.519887 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265292e-29d9-4714-aa4a-9ecd2bc48eb2 None admin] RBAC: Authorizing `identity:get_project(project_id=59c178e47e8544efb9bf4f80724f8c4f)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:20.521311 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265292e-29d9-4714-aa4a-9ecd2bc48eb2 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:20.523038 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 578/1145] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:07:20 2022] GET /identity/v3/projects/59c178e47e8544efb9bf4f80724f8c4f => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:20.528869 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd320cbb-5c03-454d-9287-1cb9ff222b9d None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:20.625143 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd320cbb-5c03-454d-9287-1cb9ff222b9d None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:20.640798 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:20.659377 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6436197-f743-4578-a7a5-018b74c4b14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:20.660033 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6436197-f743-4578-a7a5-018b74c4b14d None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:20.660323 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6436197-f743-4578-a7a5-018b74c4b14d None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:20.660602 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6436197-f743-4578-a7a5-018b74c4b14d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:20.661427 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6436197-f743-4578-a7a5-018b74c4b14d None admin] RBAC: Adding query filter params (role.id=736e70deba004b9289c2fed43eb107f7, scope.project.id=59c178e47e8544efb9bf4f80724f8c4f, user.id=f9ed9f2ec90146118aeba147a8c66f21) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:07:20.661742 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6436197-f743-4578-a7a5-018b74c4b14d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:20.663199 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6436197-f743-4578-a7a5-018b74c4b14d None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:20.668705 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 568/1146] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:07:20 2022] GET /identity/v3/role_assignments?user.id=f9ed9f2ec90146118aeba147a8c66f21&scope.project.id=59c178e47e8544efb9bf4f80724f8c4f&role.id=736e70deba004b9289c2fed43eb107f7 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:07:22.645264 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339c83d-1d13-4910-80d4-97bae1aca214 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:22.645826 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339c83d-1d13-4910-80d4-97bae1aca214 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:22.645920 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339c83d-1d13-4910-80d4-97bae1aca214 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:22.647252 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 579/1147] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:07:22.652627 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997a379-a7ba-4daa-acbe-da2083ea8459 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:22.653061 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997a379-a7ba-4daa-acbe-da2083ea8459 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:22.653196 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997a379-a7ba-4daa-acbe-da2083ea8459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:22.669815 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-3997a379-a7ba-4daa-acbe-da2083ea8459 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:07:22.671004 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3997a379-a7ba-4daa-acbe-da2083ea8459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:07:22.734746 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 569/1148] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:07:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:07:22.758808 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339c83d-1d13-4910-80d4-97bae1aca214 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:22.771342 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:22.856329 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339c83d-1d13-4910-80d4-97bae1aca214 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:22.889742 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c6e66-225e-4546-9d37-0176eb40850e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:22.890561 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c6e66-225e-4546-9d37-0176eb40850e None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:22.890851 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c6e66-225e-4546-9d37-0176eb40850e None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:22.891132 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c6e66-225e-4546-9d37-0176eb40850e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:22.901220 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c6e66-225e-4546-9d37-0176eb40850e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:07:22.908796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-f32c6e66-225e-4546-9d37-0176eb40850e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:07:22.908796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:07:22.908796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:07:22.908796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:07:22.908796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:07:22.908796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:07:22.908796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:07:22.908796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:07:22.908796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:07:22.908796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:07:22.908796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:07:22.908796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:07:22.908796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:07:22.908796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:07:22.908796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:07:22.908796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:07:22.909915 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:07:22.909915 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:07:22.909915 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:07:22.909915 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:07:22.909915 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:07:22.909915 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:07:22.909915 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:07:22.909915 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:07:22.909915 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:07:22.909915 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:07:22.909915 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:07:22.909915 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:07:22.909915 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:07:22.909915 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:07:22.909915 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:07:22.909915 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:07:22.910939 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:07:22.910939 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:07:22.910939 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:07:22.910939 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:07:22.910939 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:07:22.910939 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:07:22.910939 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:07:22.910939 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:07:22.910939 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:07:22.910939 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:07:22.910939 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:07:22.910939 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:07:22.910939 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 580/1149] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:07:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:07:22.916138 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997a379-a7ba-4daa-acbe-da2083ea8459 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:23.014987 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997a379-a7ba-4daa-acbe-da2083ea8459 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:23.025211 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:23.048672 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c4ba7-3ee6-4bef-bcd8-1fc4cfc91d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:23.049339 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c4ba7-3ee6-4bef-bcd8-1fc4cfc91d06 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:23.049621 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c4ba7-3ee6-4bef-bcd8-1fc4cfc91d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:23.049935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c4ba7-3ee6-4bef-bcd8-1fc4cfc91d06 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:23.050684 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c4ba7-3ee6-4bef-bcd8-1fc4cfc91d06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:07:23.050996 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c4ba7-3ee6-4bef-bcd8-1fc4cfc91d06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:23.052358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c4ba7-3ee6-4bef-bcd8-1fc4cfc91d06 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:23.060652 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 570/1150] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:07:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:23.066282 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c6e66-225e-4546-9d37-0176eb40850e None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:23.133255 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:23.162873 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c6e66-225e-4546-9d37-0176eb40850e None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:23.195197 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8182b-9bc4-4689-9aae-0dd2785c3ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:23.196046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8182b-9bc4-4689-9aae-0dd2785c3ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:23.196329 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8182b-9bc4-4689-9aae-0dd2785c3ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:23.196603 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8182b-9bc4-4689-9aae-0dd2785c3ab8 None admin] PATH_INFO: `/v3/users/f9ed9f2ec90146118aeba147a8c66f21` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:23.197756 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8182b-9bc4-4689-9aae-0dd2785c3ab8 None admin] RBAC: Authorizing `identity:get_user(user_id=f9ed9f2ec90146118aeba147a8c66f21)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:23.199199 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8182b-9bc4-4689-9aae-0dd2785c3ab8 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:23.200792 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 581/1151] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:07:23 2022] GET /identity/v3/users/f9ed9f2ec90146118aeba147a8c66f21 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:23.206820 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c4ba7-3ee6-4bef-bcd8-1fc4cfc91d06 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:23.304048 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c4ba7-3ee6-4bef-bcd8-1fc4cfc91d06 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:23.338551 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b8227-4184-4955-b4f1-9d4e019f51ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:23.339410 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b8227-4184-4955-b4f1-9d4e019f51ea None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:23.339695 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b8227-4184-4955-b4f1-9d4e019f51ea None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:23.339974 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b8227-4184-4955-b4f1-9d4e019f51ea None admin] PATH_INFO: `/v3/projects/59c178e47e8544efb9bf4f80724f8c4f` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:23.341147 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b8227-4184-4955-b4f1-9d4e019f51ea None admin] RBAC: Authorizing `identity:get_project(project_id=59c178e47e8544efb9bf4f80724f8c4f)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:23.342598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b8227-4184-4955-b4f1-9d4e019f51ea None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:23.344307 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 571/1152] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:07:23 2022] GET /identity/v3/projects/59c178e47e8544efb9bf4f80724f8c4f => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:23.351185 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8182b-9bc4-4689-9aae-0dd2785c3ab8 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:23.446315 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8182b-9bc4-4689-9aae-0dd2785c3ab8 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:23.478697 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828e12a-ab79-4e2d-a3a9-b71dcf096b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:23.479562 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828e12a-ab79-4e2d-a3a9-b71dcf096b20 None admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:23.479843 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828e12a-ab79-4e2d-a3a9-b71dcf096b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:23.480115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828e12a-ab79-4e2d-a3a9-b71dcf096b20 None admin] PATH_INFO: `/v3/projects/59c178e47e8544efb9bf4f80724f8c4f/users/f9ed9f2ec90146118aeba147a8c66f21/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:23.482091 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828e12a-ab79-4e2d-a3a9-b71dcf096b20 None admin] RBAC: Authorizing `identity:create_grant(project_id=59c178e47e8544efb9bf4f80724f8c4f, user_id=f9ed9f2ec90146118aeba147a8c66f21, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:23.483516 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828e12a-ab79-4e2d-a3a9-b71dcf096b20 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:23.604828 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:23.610197 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 582/1153] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jul 11 11:07:23 2022] PUT /identity/v3/projects/59c178e47e8544efb9bf4f80724f8c4f/users/f9ed9f2ec90146118aeba147a8c66f21/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:07:25.582912 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df673727-091f-4c9d-8dd3-4092341138b9 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:25.583434 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df673727-091f-4c9d-8dd3-4092341138b9 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:25.583524 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df673727-091f-4c9d-8dd3-4092341138b9 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:25.584858 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 572/1154] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:07:25.590059 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9babc-6f94-42ce-8a37-5366d47059fa None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:25.590479 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9babc-6f94-42ce-8a37-5366d47059fa None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:25.590619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9babc-6f94-42ce-8a37-5366d47059fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:25.606842 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-dce9babc-6f94-42ce-8a37-5366d47059fa None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:07:25.608007 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-dce9babc-6f94-42ce-8a37-5366d47059fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:07:25.671857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 583/1155] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:07:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:07:25.696375 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df673727-091f-4c9d-8dd3-4092341138b9 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:25.738193 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:25.797065 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df673727-091f-4c9d-8dd3-4092341138b9 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:25.830555 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b43e75-d972-41ac-8552-eb57f531ce31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:25.831329 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b43e75-d972-41ac-8552-eb57f531ce31 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:25.831613 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b43e75-d972-41ac-8552-eb57f531ce31 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:25.831889 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b43e75-d972-41ac-8552-eb57f531ce31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:25.842113 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b43e75-d972-41ac-8552-eb57f531ce31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:07:25.849786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-b4b43e75-d972-41ac-8552-eb57f531ce31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:07:25.849786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:07:25.849786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:07:25.849786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:07:25.849786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:07:25.849786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:07:25.849786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:07:25.849786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:07:25.849786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:07:25.849786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:07:25.849786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:07:25.849786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:07:25.849786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:07:25.849786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:07:25.849786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:07:25.849786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:07:25.850873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:07:25.850873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:07:25.850873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:07:25.850873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:07:25.850873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:07:25.850873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:07:25.850873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:07:25.850873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:07:25.850873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:07:25.850873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:07:25.850873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:07:25.850873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:07:25.850873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:07:25.850873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:07:25.850873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:07:25.850873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:07:25.852129 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:07:25.852129 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:07:25.852129 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:07:25.852129 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:07:25.852129 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:07:25.852129 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:07:25.852129 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:07:25.852129 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:07:25.852129 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:07:25.852129 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:07:25.852129 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:07:25.852129 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:07:25.852129 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 573/1156] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:07:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:07:25.856940 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9babc-6f94-42ce-8a37-5366d47059fa None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:25.952960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9babc-6f94-42ce-8a37-5366d47059fa None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:25.978478 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:25.986555 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf694f-2b31-4dc2-9991-4ad0d04291ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:25.989824 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf694f-2b31-4dc2-9991-4ad0d04291ca None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:25.989824 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf694f-2b31-4dc2-9991-4ad0d04291ca None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:25.989824 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf694f-2b31-4dc2-9991-4ad0d04291ca None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:25.989824 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf694f-2b31-4dc2-9991-4ad0d04291ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:07:25.989824 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf694f-2b31-4dc2-9991-4ad0d04291ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:25.990362 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf694f-2b31-4dc2-9991-4ad0d04291ca None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:25.997826 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 584/1157] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:07:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:26.003479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b43e75-d972-41ac-8552-eb57f531ce31 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:26.096527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:26.099158 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b43e75-d972-41ac-8552-eb57f531ce31 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:26.133319 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea36f97-a94d-4bc4-b8a8-3b85cfb41e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:26.134228 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea36f97-a94d-4bc4-b8a8-3b85cfb41e0a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:26.134513 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea36f97-a94d-4bc4-b8a8-3b85cfb41e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:26.134788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea36f97-a94d-4bc4-b8a8-3b85cfb41e0a None admin] PATH_INFO: `/v3/users/f9ed9f2ec90146118aeba147a8c66f21` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:26.135971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea36f97-a94d-4bc4-b8a8-3b85cfb41e0a None admin] RBAC: Authorizing `identity:get_user(user_id=f9ed9f2ec90146118aeba147a8c66f21)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:26.137385 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea36f97-a94d-4bc4-b8a8-3b85cfb41e0a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:26.139043 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 574/1158] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:07:26 2022] GET /identity/v3/users/f9ed9f2ec90146118aeba147a8c66f21 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:26.144876 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf694f-2b31-4dc2-9991-4ad0d04291ca None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:26.242759 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf694f-2b31-4dc2-9991-4ad0d04291ca None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:26.274200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543c91d-1fe7-4dca-b1e0-bec3a0164639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:26.274887 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543c91d-1fe7-4dca-b1e0-bec3a0164639 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:26.275171 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543c91d-1fe7-4dca-b1e0-bec3a0164639 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:26.275467 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543c91d-1fe7-4dca-b1e0-bec3a0164639 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:26.330179 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:26.339978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543c91d-1fe7-4dca-b1e0-bec3a0164639 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:26.341406 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543c91d-1fe7-4dca-b1e0-bec3a0164639 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:26.435592 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 585/1159] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:07:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 11:07:26.441265 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea36f97-a94d-4bc4-b8a8-3b85cfb41e0a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:26.537366 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea36f97-a94d-4bc4-b8a8-3b85cfb41e0a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:26.569126 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b934b0-577b-4fde-893a-af5b9522903a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:26.569999 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b934b0-577b-4fde-893a-af5b9522903a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:26.570281 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b934b0-577b-4fde-893a-af5b9522903a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:26.570554 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b934b0-577b-4fde-893a-af5b9522903a None admin] PATH_INFO: `/v3/projects/59c178e47e8544efb9bf4f80724f8c4f` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:26.571701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b934b0-577b-4fde-893a-af5b9522903a None admin] RBAC: Authorizing `identity:get_project(project_id=59c178e47e8544efb9bf4f80724f8c4f)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:26.573113 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b934b0-577b-4fde-893a-af5b9522903a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:26.574802 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 575/1160] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:07:26 2022] GET /identity/v3/projects/59c178e47e8544efb9bf4f80724f8c4f => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:26.581187 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543c91d-1fe7-4dca-b1e0-bec3a0164639 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:26.671024 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:26.680578 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543c91d-1fe7-4dca-b1e0-bec3a0164639 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:26.714593 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56e920-1509-4d01-aa9f-b4ac70988892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:26.715177 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56e920-1509-4d01-aa9f-b4ac70988892 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:26.715463 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56e920-1509-4d01-aa9f-b4ac70988892 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:26.715742 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56e920-1509-4d01-aa9f-b4ac70988892 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:26.716568 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56e920-1509-4d01-aa9f-b4ac70988892 None admin] RBAC: Adding query filter params (role.id=736e70deba004b9289c2fed43eb107f7, scope.project.id=59c178e47e8544efb9bf4f80724f8c4f, user.id=f9ed9f2ec90146118aeba147a8c66f21) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:07:26.716953 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56e920-1509-4d01-aa9f-b4ac70988892 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:26.718716 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56e920-1509-4d01-aa9f-b4ac70988892 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:26.724878 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 586/1161] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:07:26 2022] GET /identity/v3/role_assignments?user.id=f9ed9f2ec90146118aeba147a8c66f21&scope.project.id=59c178e47e8544efb9bf4f80724f8c4f&role.id=736e70deba004b9289c2fed43eb107f7 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:28.733226 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54748be4-fd30-4fde-ae5b-008251184e95 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:28.733890 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54748be4-fd30-4fde-ae5b-008251184e95 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:28.733890 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54748be4-fd30-4fde-ae5b-008251184e95 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:28.735671 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 576/1162] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:07:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:07:28.740921 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f8823-b834-4425-8933-4d8743d037ab None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:28.741317 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f8823-b834-4425-8933-4d8743d037ab None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:28.741475 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f8823-b834-4425-8933-4d8743d037ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:28.758450 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-8b4f8823-b834-4425-8933-4d8743d037ab None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:07:28.759637 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-8b4f8823-b834-4425-8933-4d8743d037ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:07:28.825050 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 587/1163] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:07:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:07:28.847458 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54748be4-fd30-4fde-ae5b-008251184e95 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:28.883470 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:28.946307 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54748be4-fd30-4fde-ae5b-008251184e95 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:28.978691 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff99d4b0-4192-4128-b5fe-37b95f4185ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:28.979322 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99d4b0-4192-4128-b5fe-37b95f4185ca None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:28.979605 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99d4b0-4192-4128-b5fe-37b95f4185ca None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:28.979880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99d4b0-4192-4128-b5fe-37b95f4185ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:29.044792 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff99d4b0-4192-4128-b5fe-37b95f4185ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:29.046247 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff99d4b0-4192-4128-b5fe-37b95f4185ca None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:29.077816 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:29.138898 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 577/1164] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:07:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 11:07:29.144894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f8823-b834-4425-8933-4d8743d037ab None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:29.225269 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:29.241009 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f8823-b834-4425-8933-4d8743d037ab None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:29.273633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90fe0e0-4988-457b-a31c-40b45889ba4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:29.274597 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fe0e0-4988-457b-a31c-40b45889ba4f None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:29.274883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fe0e0-4988-457b-a31c-40b45889ba4f None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:29.275161 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fe0e0-4988-457b-a31c-40b45889ba4f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:29.281646 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90fe0e0-4988-457b-a31c-40b45889ba4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:29.283776 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90fe0e0-4988-457b-a31c-40b45889ba4f None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:29.297607 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-a90fe0e0-4988-457b-a31c-40b45889ba4f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 11 11:07:29.297607 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:07:29.297607 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 11 11:07:29.297607 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 11 11:07:29.297607 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:07:29.297607 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:07:29.297607 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:07:29.297607 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:07:29.297607 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 11 11:07:29.297607 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:07:29.297607 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:07:29.297607 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:07:29.297607 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:07:29.297607 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:07:29.297607 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:07:29.297607 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:07:29.297607 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:07:29.299434 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:07:29.299434 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:07:29.299434 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:07:29.299434 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:07:29.299434 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:07:29.299434 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:07:29.299434 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:07:29.299434 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:07:29.299434 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:07:29.299434 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:07:29.299434 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:07:29.299434 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:07:29.299434 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:07:29.299434 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:07:29.299434 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:07:29.299434 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:07:29.300606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:07:29.300606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:07:29.300606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:07:29.300606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:07:29.300606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:07:29.300606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:07:29.300606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:07:29.300606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:07:29.300606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:07:29.300606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:07:29.300606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 11 11:07:29.300606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:07:29.300606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 11 11:07:29.300606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:07:29.300606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 588/1165] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Jul 11 11:07:29 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:07:29.305344 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff99d4b0-4192-4128-b5fe-37b95f4185ca None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:29.399802 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff99d4b0-4192-4128-b5fe-37b95f4185ca None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:29.432474 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6b79d-f68e-482c-9541-2c4c9afe426e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:29.433118 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6b79d-f68e-482c-9541-2c4c9afe426e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:29.433400 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6b79d-f68e-482c-9541-2c4c9afe426e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:29.433973 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6b79d-f68e-482c-9541-2c4c9afe426e None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:29.434677 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6b79d-f68e-482c-9541-2c4c9afe426e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:07:29.434991 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6b79d-f68e-482c-9541-2c4c9afe426e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:29.436327 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6b79d-f68e-482c-9541-2c4c9afe426e None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:29.438600 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:29.443667 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 578/1166] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Jul 11 11:07:29 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:07:31.436604 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f62db7-6fbc-43c2-8d2e-4f036601cd15 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:31.437158 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f62db7-6fbc-43c2-8d2e-4f036601cd15 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:31.437264 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f62db7-6fbc-43c2-8d2e-4f036601cd15 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:31.439115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 589/1167] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:07:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:07:31.444330 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcbc7b-6137-4d16-afcf-a2addcb1bf9e None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:31.444754 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcbc7b-6137-4d16-afcf-a2addcb1bf9e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:31.444894 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcbc7b-6137-4d16-afcf-a2addcb1bf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:31.461935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-49dcbc7b-6137-4d16-afcf-a2addcb1bf9e None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:07:31.463128 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-49dcbc7b-6137-4d16-afcf-a2addcb1bf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:07:31.527279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 579/1168] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:07:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:07:31.550223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f62db7-6fbc-43c2-8d2e-4f036601cd15 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:31.654649 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f62db7-6fbc-43c2-8d2e-4f036601cd15 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:31.687378 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a2d1f-f0e1-4a3a-85f8-72a24adb9788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:31.687962 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a2d1f-f0e1-4a3a-85f8-72a24adb9788 None admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:31.688864 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a2d1f-f0e1-4a3a-85f8-72a24adb9788 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:31.689146 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a2d1f-f0e1-4a3a-85f8-72a24adb9788 None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:31.689914 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a2d1f-f0e1-4a3a-85f8-72a24adb9788 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:31.691271 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a2d1f-f0e1-4a3a-85f8-72a24adb9788 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:31.778076 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 590/1169] 10.222.0.23 () {60 vars in 1138 bytes} [Mon Jul 11 11:07:31 2022] POST /identity/v3/domains => generated 267 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:07:33.827364 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c4bcb-5114-4770-9e25-ad4d07f6888d None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:33.827877 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c4bcb-5114-4770-9e25-ad4d07f6888d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:33.827976 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c4bcb-5114-4770-9e25-ad4d07f6888d None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:33.829427 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 580/1170] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:07:33.834477 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b19029-4e0a-417e-8d42-9d0d761af9e6 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:33.834886 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b19029-4e0a-417e-8d42-9d0d761af9e6 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:33.835039 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b19029-4e0a-417e-8d42-9d0d761af9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:33.840940 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:33.851690 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-b9b19029-4e0a-417e-8d42-9d0d761af9e6 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:07:33.853084 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-b9b19029-4e0a-417e-8d42-9d0d761af9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:07:33.918435 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 591/1171] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:07:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:07:33.942921 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c4bcb-5114-4770-9e25-ad4d07f6888d None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:34.040504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c4bcb-5114-4770-9e25-ad4d07f6888d None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:34.068335 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:34.073528 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd09d62-c511-43e4-b9cd-9282e26bdf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:34.074396 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd09d62-c511-43e4-b9cd-9282e26bdf0c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:34.074679 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd09d62-c511-43e4-b9cd-9282e26bdf0c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:34.074955 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd09d62-c511-43e4-b9cd-9282e26bdf0c None admin] PATH_INFO: `/v3/domains/1dd9f890913346379d113037ad79506c` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:34.084967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd09d62-c511-43e4-b9cd-9282e26bdf0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=1dd9f890913346379d113037ad79506c)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:34.086416 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd09d62-c511-43e4-b9cd-9282e26bdf0c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:34.088072 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 581/1172] 10.222.0.23 () {56 vars in 1183 bytes} [Mon Jul 11 11:07:33 2022] GET /identity/v3/domains/1dd9f890913346379d113037ad79506c => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:34.094005 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b19029-4e0a-417e-8d42-9d0d761af9e6 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:34.191461 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b19029-4e0a-417e-8d42-9d0d761af9e6 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:34.225191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2ab06-4aab-45b5-88f1-8e747cc42fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:34.225865 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2ab06-4aab-45b5-88f1-8e747cc42fae None admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:34.226156 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2ab06-4aab-45b5-88f1-8e747cc42fae None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:34.226434 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2ab06-4aab-45b5-88f1-8e747cc42fae None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:34.227173 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2ab06-4aab-45b5-88f1-8e747cc42fae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:34.228606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2ab06-4aab-45b5-88f1-8e747cc42fae None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:34.231777 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:34.326447 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 592/1173] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Jul 11 11:07:34 2022] POST /identity/v3/projects => generated 361 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:07:36.374378 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba410438-0d5e-4381-b6d1-5309176e0698 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:36.374907 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba410438-0d5e-4381-b6d1-5309176e0698 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:36.374907 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba410438-0d5e-4381-b6d1-5309176e0698 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:36.376464 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 582/1174] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:07:36.382013 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ce5f5-33a1-44f7-aec0-83b30ab677cb None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:36.382388 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ce5f5-33a1-44f7-aec0-83b30ab677cb None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:36.382577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ce5f5-33a1-44f7-aec0-83b30ab677cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:36.398822 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-d71ce5f5-33a1-44f7-aec0-83b30ab677cb None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:07:36.399986 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-d71ce5f5-33a1-44f7-aec0-83b30ab677cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:07:36.464300 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 593/1175] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:07:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:07:36.489246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba410438-0d5e-4381-b6d1-5309176e0698 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:36.586193 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba410438-0d5e-4381-b6d1-5309176e0698 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:36.618366 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4cf96-33e2-460d-b0bb-24f6f7157e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:36.619208 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4cf96-33e2-460d-b0bb-24f6f7157e93 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:36.619489 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4cf96-33e2-460d-b0bb-24f6f7157e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:36.619764 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4cf96-33e2-460d-b0bb-24f6f7157e93 None admin] PATH_INFO: `/v3/domains/1dd9f890913346379d113037ad79506c` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:36.620912 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4cf96-33e2-460d-b0bb-24f6f7157e93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1dd9f890913346379d113037ad79506c)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:36.622350 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4cf96-33e2-460d-b0bb-24f6f7157e93 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:36.623937 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 583/1176] 10.222.0.23 () {56 vars in 1183 bytes} [Mon Jul 11 11:07:36 2022] GET /identity/v3/domains/1dd9f890913346379d113037ad79506c => generated 267 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:36.629741 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ce5f5-33a1-44f7-aec0-83b30ab677cb None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:36.727534 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ce5f5-33a1-44f7-aec0-83b30ab677cb None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:36.743659 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:36.761944 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebda446-3448-4144-8a9b-2bac54f6e1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:36.761944 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebda446-3448-4144-8a9b-2bac54f6e1f3 None admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:36.761944 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebda446-3448-4144-8a9b-2bac54f6e1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:36.762966 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebda446-3448-4144-8a9b-2bac54f6e1f3 None admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:36.762966 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebda446-3448-4144-8a9b-2bac54f6e1f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:36.764293 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebda446-3448-4144-8a9b-2bac54f6e1f3 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:36.855248 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 594/1177] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jul 11 11:07:36 2022] POST /identity/v3/users => generated 311 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:07:38.900445 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edaba5-fc53-491d-8112-b030398335eb None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:38.901002 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edaba5-fc53-491d-8112-b030398335eb None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:38.901002 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edaba5-fc53-491d-8112-b030398335eb None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:38.902386 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 584/1178] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:07:38.907446 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c63dee-67bd-4530-9d1f-a8b74d1dbd17 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:38.907838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c63dee-67bd-4530-9d1f-a8b74d1dbd17 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:38.908019 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c63dee-67bd-4530-9d1f-a8b74d1dbd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:38.924310 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-a9c63dee-67bd-4530-9d1f-a8b74d1dbd17 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:07:38.925485 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-a9c63dee-67bd-4530-9d1f-a8b74d1dbd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:07:39.004157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 595/1179] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:07:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:07:39.029752 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24edaba5-fc53-491d-8112-b030398335eb None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:39.091452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:39.135272 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24edaba5-fc53-491d-8112-b030398335eb None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:39.168232 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fbac1-6e98-4c10-909a-3c54e0d2dd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:39.169267 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fbac1-6e98-4c10-909a-3c54e0d2dd15 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:39.169565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fbac1-6e98-4c10-909a-3c54e0d2dd15 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:39.169894 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fbac1-6e98-4c10-909a-3c54e0d2dd15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:39.180802 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02fbac1-6e98-4c10-909a-3c54e0d2dd15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:07:39.189405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-b02fbac1-6e98-4c10-909a-3c54e0d2dd15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:07:39.189405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:07:39.189405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:07:39.189405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:07:39.189405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:07:39.189405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:07:39.189405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:07:39.189405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:07:39.189405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:07:39.189405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:07:39.189405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:07:39.189405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:07:39.189405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:07:39.189405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:07:39.189405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:07:39.189405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:07:39.190661 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:07:39.190661 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:07:39.190661 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:07:39.190661 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:07:39.190661 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:07:39.190661 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:07:39.190661 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:07:39.190661 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:07:39.190661 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:07:39.190661 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:07:39.190661 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:07:39.190661 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:07:39.190661 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:07:39.190661 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:07:39.190661 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:07:39.190661 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:07:39.192356 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:07:39.192356 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:07:39.192356 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:07:39.192356 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:07:39.192356 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:07:39.192356 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:07:39.192356 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:07:39.192356 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:07:39.192356 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:07:39.192356 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:07:39.192356 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:07:39.192356 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:07:39.192356 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 585/1180] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:07:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:07:39.198053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c63dee-67bd-4530-9d1f-a8b74d1dbd17 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:39.307590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c63dee-67bd-4530-9d1f-a8b74d1dbd17 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:39.309363 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:39.342391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255f0f2-37a2-4fb0-a8e2-92044190157e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:39.343076 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255f0f2-37a2-4fb0-a8e2-92044190157e None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:39.343572 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255f0f2-37a2-4fb0-a8e2-92044190157e None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:39.343857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255f0f2-37a2-4fb0-a8e2-92044190157e None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:39.344952 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255f0f2-37a2-4fb0-a8e2-92044190157e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:07:39.345495 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255f0f2-37a2-4fb0-a8e2-92044190157e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:39.347400 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255f0f2-37a2-4fb0-a8e2-92044190157e None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:39.357746 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 596/1181] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:07:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:39.364092 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fbac1-6e98-4c10-909a-3c54e0d2dd15 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:39.482863 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fbac1-6e98-4c10-909a-3c54e0d2dd15 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:39.502415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:39.520569 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc29e87-a052-4d3f-98eb-e348584645b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:39.521649 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc29e87-a052-4d3f-98eb-e348584645b9 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:39.521964 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc29e87-a052-4d3f-98eb-e348584645b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:39.522440 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc29e87-a052-4d3f-98eb-e348584645b9 None admin] PATH_INFO: `/v3/users/c269a347cb0f42c99e3188a744a7f3d0` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:39.538335 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc29e87-a052-4d3f-98eb-e348584645b9 None admin] RBAC: Authorizing `identity:get_user(user_id=c269a347cb0f42c99e3188a744a7f3d0)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:39.539851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc29e87-a052-4d3f-98eb-e348584645b9 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:39.541560 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 586/1182] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:07:39 2022] GET /identity/v3/users/c269a347cb0f42c99e3188a744a7f3d0 => generated 311 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:39.548025 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255f0f2-37a2-4fb0-a8e2-92044190157e None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:39.654303 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255f0f2-37a2-4fb0-a8e2-92044190157e None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:39.688385 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ec9f2-8677-460c-a4f8-779d71bc47e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:39.689029 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ec9f2-8677-460c-a4f8-779d71bc47e7 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:39.689317 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ec9f2-8677-460c-a4f8-779d71bc47e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:39.689599 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ec9f2-8677-460c-a4f8-779d71bc47e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:39.718520 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:39.756047 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ec9f2-8677-460c-a4f8-779d71bc47e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:39.757492 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ec9f2-8677-460c-a4f8-779d71bc47e7 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:39.856445 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 597/1183] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:07:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 11:07:39.862339 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc29e87-a052-4d3f-98eb-e348584645b9 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:39.959496 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc29e87-a052-4d3f-98eb-e348584645b9 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:39.993006 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc59b8c-b933-4a6a-8260-d04c86481165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:39.993882 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc59b8c-b933-4a6a-8260-d04c86481165 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:39.994177 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc59b8c-b933-4a6a-8260-d04c86481165 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:39.994458 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc59b8c-b933-4a6a-8260-d04c86481165 None admin] PATH_INFO: `/v3/projects/7a5bf198f9ed44818f0d811769a83bed` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:39.995629 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc59b8c-b933-4a6a-8260-d04c86481165 None admin] RBAC: Authorizing `identity:get_project(project_id=7a5bf198f9ed44818f0d811769a83bed)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:39.997041 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc59b8c-b933-4a6a-8260-d04c86481165 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:39.998778 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 587/1184] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:07:39 2022] GET /identity/v3/projects/7a5bf198f9ed44818f0d811769a83bed => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:40.004872 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ec9f2-8677-460c-a4f8-779d71bc47e7 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:40.064974 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:40.101744 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ec9f2-8677-460c-a4f8-779d71bc47e7 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:40.133882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e547d28-9cf1-4546-af61-5f4f7d63ede4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:40.134526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e547d28-9cf1-4546-af61-5f4f7d63ede4 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:40.134813 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e547d28-9cf1-4546-af61-5f4f7d63ede4 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:40.135092 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e547d28-9cf1-4546-af61-5f4f7d63ede4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:40.135913 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e547d28-9cf1-4546-af61-5f4f7d63ede4 None admin] RBAC: Adding query filter params (role.id=736e70deba004b9289c2fed43eb107f7, scope.project.id=7a5bf198f9ed44818f0d811769a83bed, user.id=c269a347cb0f42c99e3188a744a7f3d0) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:07:40.136225 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e547d28-9cf1-4546-af61-5f4f7d63ede4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:40.137645 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e547d28-9cf1-4546-af61-5f4f7d63ede4 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:40.143591 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 598/1185] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:07:40 2022] GET /identity/v3/role_assignments?user.id=c269a347cb0f42c99e3188a744a7f3d0&scope.project.id=7a5bf198f9ed44818f0d811769a83bed&role.id=736e70deba004b9289c2fed43eb107f7 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:42.113082 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0efd02-14e9-4536-80b3-e14dd9aa8643 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:42.113627 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0efd02-14e9-4536-80b3-e14dd9aa8643 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:42.113627 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0efd02-14e9-4536-80b3-e14dd9aa8643 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:42.115036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 588/1186] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:07:42.120356 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7c0be-3c26-45ee-8247-2d8e064b820a None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:42.120763 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7c0be-3c26-45ee-8247-2d8e064b820a None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:42.120913 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7c0be-3c26-45ee-8247-2d8e064b820a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:42.137186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-7be7c0be-3c26-45ee-8247-2d8e064b820a None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:07:42.138395 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-7be7c0be-3c26-45ee-8247-2d8e064b820a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:07:42.202784 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 599/1187] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:07:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:07:42.226195 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0efd02-14e9-4536-80b3-e14dd9aa8643 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:42.271389 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:42.324534 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0efd02-14e9-4536-80b3-e14dd9aa8643 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:42.358187 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3146b-3f7d-49f0-9caf-2aa85a433fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:42.358961 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3146b-3f7d-49f0-9caf-2aa85a433fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:42.359248 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3146b-3f7d-49f0-9caf-2aa85a433fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:42.359550 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3146b-3f7d-49f0-9caf-2aa85a433fe5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:42.370086 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb3146b-3f7d-49f0-9caf-2aa85a433fe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:07:42.378313 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-0cb3146b-3f7d-49f0-9caf-2aa85a433fe5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:07:42.378313 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:07:42.378313 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:07:42.378313 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:07:42.378313 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:07:42.378313 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:07:42.378313 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:07:42.378313 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:07:42.378313 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:07:42.378313 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:07:42.378313 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:07:42.378313 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:07:42.378313 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:07:42.378313 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:07:42.378313 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:07:42.378313 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:07:42.379386 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:07:42.379386 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:07:42.379386 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:07:42.379386 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:07:42.379386 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:07:42.379386 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:07:42.379386 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:07:42.379386 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:07:42.379386 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:07:42.379386 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:07:42.379386 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:07:42.379386 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:07:42.379386 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:07:42.379386 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:07:42.379386 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:07:42.379386 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:07:42.380253 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:07:42.380253 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:07:42.380253 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:07:42.380253 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:07:42.380253 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:07:42.380253 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:07:42.380253 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:07:42.380253 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:07:42.380253 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:07:42.380253 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:07:42.380253 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:07:42.380253 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:07:42.380253 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 589/1188] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:07:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:07:42.385494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7c0be-3c26-45ee-8247-2d8e064b820a None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:42.443661 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:42.486418 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7c0be-3c26-45ee-8247-2d8e064b820a None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:42.519223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca730a1e-9b29-4701-91ff-c873a672def2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:42.519886 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca730a1e-9b29-4701-91ff-c873a672def2 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:42.520175 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca730a1e-9b29-4701-91ff-c873a672def2 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:42.520454 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca730a1e-9b29-4701-91ff-c873a672def2 None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:42.521200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca730a1e-9b29-4701-91ff-c873a672def2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:07:42.521510 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca730a1e-9b29-4701-91ff-c873a672def2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:42.522912 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca730a1e-9b29-4701-91ff-c873a672def2 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:42.531173 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 600/1189] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:07:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:42.537502 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3146b-3f7d-49f0-9caf-2aa85a433fe5 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:42.634289 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3146b-3f7d-49f0-9caf-2aa85a433fe5 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:42.636458 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:42.666317 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6f686-24a6-4110-9671-f550317f6625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:42.667178 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6f686-24a6-4110-9671-f550317f6625 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:42.667666 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6f686-24a6-4110-9671-f550317f6625 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:42.668171 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6f686-24a6-4110-9671-f550317f6625 None admin] PATH_INFO: `/v3/users/c269a347cb0f42c99e3188a744a7f3d0` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:42.669698 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6f686-24a6-4110-9671-f550317f6625 None admin] RBAC: Authorizing `identity:get_user(user_id=c269a347cb0f42c99e3188a744a7f3d0)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:42.671144 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6f686-24a6-4110-9671-f550317f6625 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:42.672818 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 590/1190] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:07:42 2022] GET /identity/v3/users/c269a347cb0f42c99e3188a744a7f3d0 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:42.679364 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca730a1e-9b29-4701-91ff-c873a672def2 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:42.776389 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca730a1e-9b29-4701-91ff-c873a672def2 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:42.798108 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:42.811910 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536408e-1cdd-4ed1-b995-b9e405ea588f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:42.812769 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536408e-1cdd-4ed1-b995-b9e405ea588f None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:42.813665 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536408e-1cdd-4ed1-b995-b9e405ea588f None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:42.813974 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536408e-1cdd-4ed1-b995-b9e405ea588f None admin] PATH_INFO: `/v3/projects/7a5bf198f9ed44818f0d811769a83bed` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:42.815148 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536408e-1cdd-4ed1-b995-b9e405ea588f None admin] RBAC: Authorizing `identity:get_project(project_id=7a5bf198f9ed44818f0d811769a83bed)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:42.816584 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536408e-1cdd-4ed1-b995-b9e405ea588f None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:42.818328 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 601/1191] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:07:42 2022] GET /identity/v3/projects/7a5bf198f9ed44818f0d811769a83bed => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:42.824403 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6f686-24a6-4110-9671-f550317f6625 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:42.921166 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6f686-24a6-4110-9671-f550317f6625 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:42.954885 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c8076-dde6-4edd-b222-612960ea195a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:42.955764 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c8076-dde6-4edd-b222-612960ea195a None admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:42.956053 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c8076-dde6-4edd-b222-612960ea195a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:42.956335 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c8076-dde6-4edd-b222-612960ea195a None admin] PATH_INFO: `/v3/projects/7a5bf198f9ed44818f0d811769a83bed/users/c269a347cb0f42c99e3188a744a7f3d0/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:42.958311 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c8076-dde6-4edd-b222-612960ea195a None admin] RBAC: Authorizing `identity:create_grant(project_id=7a5bf198f9ed44818f0d811769a83bed, user_id=c269a347cb0f42c99e3188a744a7f3d0, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:42.959727 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c8076-dde6-4edd-b222-612960ea195a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:43.016342 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 591/1192] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jul 11 11:07:42 2022] PUT /identity/v3/projects/7a5bf198f9ed44818f0d811769a83bed/users/c269a347cb0f42c99e3188a744a7f3d0/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:07:45.005554 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701b244-c56a-4191-98f0-9f259de4d5e6 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:45.006143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701b244-c56a-4191-98f0-9f259de4d5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:45.006143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701b244-c56a-4191-98f0-9f259de4d5e6 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:45.007507 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 602/1193] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:07:45.012764 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ad93b-8242-450e-b4e2-168a3fe9f7d9 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:45.013168 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ad93b-8242-450e-b4e2-168a3fe9f7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:45.013270 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ad93b-8242-450e-b4e2-168a3fe9f7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:45.030175 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-0e6ad93b-8242-450e-b4e2-168a3fe9f7d9 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:07:45.031353 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-0e6ad93b-8242-450e-b4e2-168a3fe9f7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:07:45.056475 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:45.096599 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 592/1194] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:07:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 11:07:45.120296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701b244-c56a-4191-98f0-9f259de4d5e6 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:45.218865 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701b244-c56a-4191-98f0-9f259de4d5e6 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:45.252480 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c547d-f970-4825-accd-6ac6bd9af031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:45.253248 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c547d-f970-4825-accd-6ac6bd9af031 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:45.253532 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c547d-f970-4825-accd-6ac6bd9af031 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:45.253832 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c547d-f970-4825-accd-6ac6bd9af031 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:45.263502 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c547d-f970-4825-accd-6ac6bd9af031 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:07:45.271092 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-7f2c547d-f970-4825-accd-6ac6bd9af031 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:07:45.271092 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:07:45.271092 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:07:45.271092 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:07:45.271092 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:07:45.271092 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:07:45.271092 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:07:45.271092 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:07:45.271092 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:07:45.271092 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:07:45.271092 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:07:45.271092 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:07:45.271092 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:07:45.271092 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:07:45.271092 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:07:45.271092 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:07:45.272171 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:07:45.272171 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:07:45.272171 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:07:45.272171 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:07:45.272171 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:07:45.272171 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:07:45.272171 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:07:45.272171 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:07:45.272171 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:07:45.272171 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:07:45.272171 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:07:45.272171 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:07:45.272171 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:07:45.272171 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:07:45.272171 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:07:45.272171 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:07:45.273090 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:07:45.273090 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:07:45.273090 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:07:45.273090 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:07:45.273090 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:07:45.273090 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:07:45.273090 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:07:45.273090 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:07:45.273090 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:07:45.273090 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:07:45.273090 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:07:45.273090 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:07:45.273090 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 603/1195] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:07:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:07:45.278102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ad93b-8242-450e-b4e2-168a3fe9f7d9 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:45.372831 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ad93b-8242-450e-b4e2-168a3fe9f7d9 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:45.405578 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb035c8b-832f-4735-8fa5-00f8879090b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:45.406262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb035c8b-832f-4735-8fa5-00f8879090b6 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:45.406607 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb035c8b-832f-4735-8fa5-00f8879090b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:45.406962 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb035c8b-832f-4735-8fa5-00f8879090b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:45.407707 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb035c8b-832f-4735-8fa5-00f8879090b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:07:45.408016 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb035c8b-832f-4735-8fa5-00f8879090b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:45.409374 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb035c8b-832f-4735-8fa5-00f8879090b6 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:45.417124 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 593/1196] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:07:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:45.423383 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c547d-f970-4825-accd-6ac6bd9af031 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:45.471412 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:45.520996 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c547d-f970-4825-accd-6ac6bd9af031 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:45.553460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493de83-3455-4f19-b258-d493b57835df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:45.554335 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493de83-3455-4f19-b258-d493b57835df None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:45.554618 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493de83-3455-4f19-b258-d493b57835df None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:45.554889 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493de83-3455-4f19-b258-d493b57835df None admin] PATH_INFO: `/v3/users/c269a347cb0f42c99e3188a744a7f3d0` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:45.556053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493de83-3455-4f19-b258-d493b57835df None admin] RBAC: Authorizing `identity:get_user(user_id=c269a347cb0f42c99e3188a744a7f3d0)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:45.557469 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493de83-3455-4f19-b258-d493b57835df None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:45.559362 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 604/1197] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jul 11 11:07:45 2022] GET /identity/v3/users/c269a347cb0f42c99e3188a744a7f3d0 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:45.565087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb035c8b-832f-4735-8fa5-00f8879090b6 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:45.589728 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:45.661908 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb035c8b-832f-4735-8fa5-00f8879090b6 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:45.694545 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ddbf9-3a96-4073-93cc-4835d9d66866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:45.695240 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ddbf9-3a96-4073-93cc-4835d9d66866 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:45.695529 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ddbf9-3a96-4073-93cc-4835d9d66866 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:45.695810 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ddbf9-3a96-4073-93cc-4835d9d66866 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:45.760508 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ddbf9-3a96-4073-93cc-4835d9d66866 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:45.762502 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ddbf9-3a96-4073-93cc-4835d9d66866 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:45.786914 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:45.859300 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 594/1198] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:07:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 11:07:45.865164 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493de83-3455-4f19-b258-d493b57835df None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:45.961961 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493de83-3455-4f19-b258-d493b57835df None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:45.977874 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:45.994739 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e6131-f1ea-4aa6-97ab-de4ddf1ca301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:45.995587 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e6131-f1ea-4aa6-97ab-de4ddf1ca301 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:45.995873 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e6131-f1ea-4aa6-97ab-de4ddf1ca301 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:45.996150 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e6131-f1ea-4aa6-97ab-de4ddf1ca301 None admin] PATH_INFO: `/v3/projects/7a5bf198f9ed44818f0d811769a83bed` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:45.997327 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e6131-f1ea-4aa6-97ab-de4ddf1ca301 None admin] RBAC: Authorizing `identity:get_project(project_id=7a5bf198f9ed44818f0d811769a83bed)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:45.998804 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e6131-f1ea-4aa6-97ab-de4ddf1ca301 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:46.000535 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 605/1199] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jul 11 11:07:45 2022] GET /identity/v3/projects/7a5bf198f9ed44818f0d811769a83bed => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:46.006467 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ddbf9-3a96-4073-93cc-4835d9d66866 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:07:46.103094 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ddbf9-3a96-4073-93cc-4835d9d66866 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:07:46.131340 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:46.142943 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506d518-6f17-47ec-91ee-9316dd4a475b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:07:46.143599 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506d518-6f17-47ec-91ee-9316dd4a475b None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:07:46.143881 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506d518-6f17-47ec-91ee-9316dd4a475b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:07:46.148094 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506d518-6f17-47ec-91ee-9316dd4a475b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:07:46.148094 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506d518-6f17-47ec-91ee-9316dd4a475b None admin] RBAC: Adding query filter params (role.id=736e70deba004b9289c2fed43eb107f7, scope.project.id=7a5bf198f9ed44818f0d811769a83bed, user.id=c269a347cb0f42c99e3188a744a7f3d0) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:07:46.148094 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506d518-6f17-47ec-91ee-9316dd4a475b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:07:46.148094 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506d518-6f17-47ec-91ee-9316dd4a475b None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:07:46.152685 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 595/1200] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:07:46 2022] GET /identity/v3/role_assignments?user.id=c269a347cb0f42c99e3188a744a7f3d0&scope.project.id=7a5bf198f9ed44818f0d811769a83bed&role.id=736e70deba004b9289c2fed43eb107f7 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:07:56.016188 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=8 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:07:56.164989 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=6 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:03.228567 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083d6f9-2fa2-4310-a7d0-186adfc1d153 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:03.229150 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083d6f9-2fa2-4310-a7d0-186adfc1d153 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:03.229150 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083d6f9-2fa2-4310-a7d0-186adfc1d153 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:03.230558 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 606/1201] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:09:03.235580 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44f067-024a-40f1-94dd-6c894bd115f8 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:03.239747 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44f067-024a-40f1-94dd-6c894bd115f8 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:03.239747 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44f067-024a-40f1-94dd-6c894bd115f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:03.253632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-1e44f067-024a-40f1-94dd-6c894bd115f8 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:09:03.254832 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1e44f067-024a-40f1-94dd-6c894bd115f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:09:03.319420 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 596/1202] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:09:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:09:03.343133 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083d6f9-2fa2-4310-a7d0-186adfc1d153 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:03.444842 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083d6f9-2fa2-4310-a7d0-186adfc1d153 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:03.478221 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f445ef-dd68-4ea5-be57-f20c65f26e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:03.479055 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f445ef-dd68-4ea5-be57-f20c65f26e88 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:03.479293 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f445ef-dd68-4ea5-be57-f20c65f26e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:03.479571 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f445ef-dd68-4ea5-be57-f20c65f26e88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:03.490112 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f445ef-dd68-4ea5-be57-f20c65f26e88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:03.491546 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f445ef-dd68-4ea5-be57-f20c65f26e88 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:03.508524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-04f445ef-dd68-4ea5-be57-f20c65f26e88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:09:03.508524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:03.508524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:03.508524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:03.508524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:03.508524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:03.508524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:03.508524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:03.508524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:03.508524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:03.508524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:03.508524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:03.508524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:09:03.508524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:09:03.508524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:09:03.509637 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:09:03.509637 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:03.509637 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:03.509637 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:03.509637 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:03.509637 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:03.509637 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:03.509637 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:03.509637 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:03.509637 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:03.509637 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:03.509637 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:03.509637 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:03.509637 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:03.509637 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:03.509637 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:03.509637 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:03.510845 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:09:03.510845 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:09:03.510845 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:09:03.510845 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:09:03.510845 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 607/1203] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:09:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:09:03.515691 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44f067-024a-40f1-94dd-6c894bd115f8 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:03.612199 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44f067-024a-40f1-94dd-6c894bd115f8 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:03.640161 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:03.645860 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7718d-82b8-493e-8a59-6227218541b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:03.646610 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7718d-82b8-493e-8a59-6227218541b1 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:03.646895 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7718d-82b8-493e-8a59-6227218541b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:03.647169 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7718d-82b8-493e-8a59-6227218541b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:03.647882 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c7718d-82b8-493e-8a59-6227218541b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:03.648189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c7718d-82b8-493e-8a59-6227218541b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:03.649536 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c7718d-82b8-493e-8a59-6227218541b1 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:03.661002 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 597/1204] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:03.666931 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f445ef-dd68-4ea5-be57-f20c65f26e88 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:03.718947 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:03.766472 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f445ef-dd68-4ea5-be57-f20c65f26e88 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:03.799735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d119287-a13e-41c6-aac7-c319d3541ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:03.809805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d119287-a13e-41c6-aac7-c319d3541ad2 None admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:03.809805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d119287-a13e-41c6-aac7-c319d3541ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:03.809805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d119287-a13e-41c6-aac7-c319d3541ad2 None admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:03.809805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d119287-a13e-41c6-aac7-c319d3541ad2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:03.809805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d119287-a13e-41c6-aac7-c319d3541ad2 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:04.014471 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 608/1205] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jul 11 11:09:03 2022] POST /identity/v3/users => generated 251 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:09:06.060501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa652a9-358c-4f4a-8401-bc0b36bf300c None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:06.061046 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa652a9-358c-4f4a-8401-bc0b36bf300c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:06.061046 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa652a9-358c-4f4a-8401-bc0b36bf300c None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:06.062467 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 598/1206] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:09:06.067650 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1700485-912d-409a-9840-51a8f48e5a97 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:06.068082 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1700485-912d-409a-9840-51a8f48e5a97 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:06.068213 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1700485-912d-409a-9840-51a8f48e5a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:06.085894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-f1700485-912d-409a-9840-51a8f48e5a97 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:09:06.087127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-f1700485-912d-409a-9840-51a8f48e5a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:09:06.153152 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 609/1207] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:09:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 11:09:06.177009 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa652a9-358c-4f4a-8401-bc0b36bf300c None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:06.278046 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa652a9-358c-4f4a-8401-bc0b36bf300c None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:06.311010 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e7ced-d451-4358-832b-1e0d3576fcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:06.311741 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e7ced-d451-4358-832b-1e0d3576fcc2 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:06.312022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e7ced-d451-4358-832b-1e0d3576fcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:06.312299 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e7ced-d451-4358-832b-1e0d3576fcc2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:06.323166 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e7ced-d451-4358-832b-1e0d3576fcc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:09:06.331398 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-c15e7ced-d451-4358-832b-1e0d3576fcc2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:09:06.331398 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:06.331398 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:06.331398 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:06.331398 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:06.331398 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:06.331398 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:06.331398 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:06.331398 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:06.331398 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:06.331398 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:06.331398 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:06.331398 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:09:06.331398 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:09:06.331398 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:09:06.331398 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:09:06.332582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:09:06.332582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:09:06.332582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:09:06.332582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:09:06.332582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:06.332582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:06.332582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:06.332582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:06.332582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:06.332582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:06.332582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:06.332582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:06.332582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:06.332582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:06.332582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:06.332582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:06.333810 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:06.333810 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:06.333810 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:06.333810 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:06.333810 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:09:06.333810 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:09:06.333810 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:09:06.333810 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:09:06.333810 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:09:06.333810 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:09:06.333810 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:09:06.333810 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:09:06.333810 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 599/1208] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jul 11 11:09:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:09:06.343485 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1700485-912d-409a-9840-51a8f48e5a97 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:06.376541 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:06.434681 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1700485-912d-409a-9840-51a8f48e5a97 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:06.469210 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270a7aa-1231-4496-acc4-b0e2e9244839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:06.470167 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270a7aa-1231-4496-acc4-b0e2e9244839 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:06.470167 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270a7aa-1231-4496-acc4-b0e2e9244839 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:06.470519 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270a7aa-1231-4496-acc4-b0e2e9244839 None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:06.471258 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270a7aa-1231-4496-acc4-b0e2e9244839 None admin] RBAC: Adding query filter params (name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:06.471567 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270a7aa-1231-4496-acc4-b0e2e9244839 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:06.472921 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270a7aa-1231-4496-acc4-b0e2e9244839 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:06.480638 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 610/1209] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jul 11 11:09:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:06.486316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e7ced-d451-4358-832b-1e0d3576fcc2 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:06.535185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:06.582722 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e7ced-d451-4358-832b-1e0d3576fcc2 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:06.615157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18bd0fb-7be7-47e7-8907-54aba2def150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:06.618026 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18bd0fb-7be7-47e7-8907-54aba2def150 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:06.618026 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18bd0fb-7be7-47e7-8907-54aba2def150 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:06.618026 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18bd0fb-7be7-47e7-8907-54aba2def150 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:06.626251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18bd0fb-7be7-47e7-8907-54aba2def150 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:06.628278 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18bd0fb-7be7-47e7-8907-54aba2def150 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:06.646852 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-d18bd0fb-7be7-47e7-8907-54aba2def150 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:09:06.646852 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:06.646852 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:06.646852 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:06.646852 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:06.646852 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:06.646852 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:06.646852 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:06.646852 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:06.646852 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:06.646852 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:06.646852 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:06.646852 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:09:06.646852 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:09:06.646852 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:09:06.647970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:09:06.647970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:06.647970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:06.647970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:06.647970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:06.647970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:06.647970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:06.647970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:06.647970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:06.647970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:06.647970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:06.647970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:06.647970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:06.647970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:06.647970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:06.647970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:06.647970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:06.649081 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:09:06.649081 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:09:06.649081 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:09:06.649081 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:09:06.649081 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 600/1210] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:09:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:09:06.653813 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270a7aa-1231-4496-acc4-b0e2e9244839 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:06.748203 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:06.751054 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270a7aa-1231-4496-acc4-b0e2e9244839 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:06.784104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196326e6-6b1e-4d2d-9f85-04ec8cd50099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:06.784754 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196326e6-6b1e-4d2d-9f85-04ec8cd50099 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:06.785037 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196326e6-6b1e-4d2d-9f85-04ec8cd50099 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:06.785310 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196326e6-6b1e-4d2d-9f85-04ec8cd50099 None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:06.786055 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196326e6-6b1e-4d2d-9f85-04ec8cd50099 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:06.786363 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196326e6-6b1e-4d2d-9f85-04ec8cd50099 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:06.787723 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196326e6-6b1e-4d2d-9f85-04ec8cd50099 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:06.799319 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 611/1211] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:06.804969 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18bd0fb-7be7-47e7-8907-54aba2def150 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:06.903206 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18bd0fb-7be7-47e7-8907-54aba2def150 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:06.904637 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:06.937255 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b44f3-37c4-40f9-b320-8ccb377a9d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:06.938080 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b44f3-37c4-40f9-b320-8ccb377a9d2f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:06.938367 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b44f3-37c4-40f9-b320-8ccb377a9d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:06.938642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b44f3-37c4-40f9-b320-8ccb377a9d2f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:06.946075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b44f3-37c4-40f9-b320-8ccb377a9d2f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:06.947496 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b44f3-37c4-40f9-b320-8ccb377a9d2f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:06.961843 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-542b44f3-37c4-40f9-b320-8ccb377a9d2f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 11:09:06.961843 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:06.961843 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:06.961843 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:06.961843 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:06.961843 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:06.961843 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:06.961843 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:06.961843 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:06.961843 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:06.961843 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:06.961843 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:06.961843 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:09:06.961843 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:09:06.961843 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:09:06.961843 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:09:06.963029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:06.963029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:06.963029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:09:06.963029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:09:06.963029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:09:06.963029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:09:06.963029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:06.963029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:06.963029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:06.963029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:06.963029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:06.963029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:06.963029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:06.963029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:06.963029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:06.963029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:06.963029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:06.963029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:06.964133 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:06.964133 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:06.964133 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:09:06.964133 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:09:06.964133 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:09:06.964133 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:09:06.964133 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:09:06.964133 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:09:06.964133 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 11:09:06.964133 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:09:06.964133 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 601/1212] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:09:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:09:06.968745 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196326e6-6b1e-4d2d-9f85-04ec8cd50099 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:07.068810 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196326e6-6b1e-4d2d-9f85-04ec8cd50099 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:07.103494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908004d-aa3c-4fbf-82c7-16a4efcf7755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:07.104168 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908004d-aa3c-4fbf-82c7-16a4efcf7755 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:07.104449 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908004d-aa3c-4fbf-82c7-16a4efcf7755 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:07.104724 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908004d-aa3c-4fbf-82c7-16a4efcf7755 None admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:07.105555 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908004d-aa3c-4fbf-82c7-16a4efcf7755 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:07.105895 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908004d-aa3c-4fbf-82c7-16a4efcf7755 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:07.107354 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908004d-aa3c-4fbf-82c7-16a4efcf7755 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:07.124618 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 612/1213] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Jul 11 11:09:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:07.130797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b44f3-37c4-40f9-b320-8ccb377a9d2f None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:07.228052 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b44f3-37c4-40f9-b320-8ccb377a9d2f None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:07.262497 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac01fc5-24a2-4590-95c8-44a1449c8911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:07.263144 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac01fc5-24a2-4590-95c8-44a1449c8911 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:07.263427 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac01fc5-24a2-4590-95c8-44a1449c8911 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:07.263719 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac01fc5-24a2-4590-95c8-44a1449c8911 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:07.292526 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:07.328574 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac01fc5-24a2-4590-95c8-44a1449c8911 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:07.330042 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac01fc5-24a2-4590-95c8-44a1449c8911 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:07.432351 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 602/1214] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:09:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 11:09:07.438383 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908004d-aa3c-4fbf-82c7-16a4efcf7755 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:07.457285 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:07.534772 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908004d-aa3c-4fbf-82c7-16a4efcf7755 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:07.569076 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d7df2-3a41-458a-a6b4-b9ba9ba70280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:07.569890 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d7df2-3a41-458a-a6b4-b9ba9ba70280 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:07.570175 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d7df2-3a41-458a-a6b4-b9ba9ba70280 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:07.570449 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d7df2-3a41-458a-a6b4-b9ba9ba70280 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:07.580630 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d7df2-3a41-458a-a6b4-b9ba9ba70280 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:07.582509 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d7df2-3a41-458a-a6b4-b9ba9ba70280 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:07.600806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-d39d7df2-3a41-458a-a6b4-b9ba9ba70280 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:09:07.600806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:07.600806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:07.600806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:07.600806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:07.600806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:07.600806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:07.600806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:07.600806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:07.600806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:07.600806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:07.600806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:07.600806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:09:07.600806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:09:07.600806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:09:07.601894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:09:07.601894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:07.601894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:07.601894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:07.601894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:07.601894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:07.601894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:07.601894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:07.601894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:07.601894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:07.601894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:07.601894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:07.601894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:07.601894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:07.601894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:07.601894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:07.601894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:07.602861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:09:07.602861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:09:07.602861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:09:07.602861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:09:07.602861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 613/1215] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:09:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:09:07.607645 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac01fc5-24a2-4590-95c8-44a1449c8911 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:07.668057 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:07.705615 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac01fc5-24a2-4590-95c8-44a1449c8911 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:07.738987 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc67260-a892-4b1c-88c6-fd3087c42677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:07.739663 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc67260-a892-4b1c-88c6-fd3087c42677 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:07.739951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc67260-a892-4b1c-88c6-fd3087c42677 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:07.740230 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc67260-a892-4b1c-88c6-fd3087c42677 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:07.740945 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc67260-a892-4b1c-88c6-fd3087c42677 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:07.741256 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc67260-a892-4b1c-88c6-fd3087c42677 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:07.742661 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc67260-a892-4b1c-88c6-fd3087c42677 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:07.754218 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 603/1216] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:09:07.760141 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d7df2-3a41-458a-a6b4-b9ba9ba70280 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:07.829469 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:07.858793 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d7df2-3a41-458a-a6b4-b9ba9ba70280 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:07.891054 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57c2d1-9c05-4ce5-9d28-fbceaba24b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:07.891829 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57c2d1-9c05-4ce5-9d28-fbceaba24b22 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:07.892110 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57c2d1-9c05-4ce5-9d28-fbceaba24b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:07.892382 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57c2d1-9c05-4ce5-9d28-fbceaba24b22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:07.898747 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57c2d1-9c05-4ce5-9d28-fbceaba24b22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:07.900171 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57c2d1-9c05-4ce5-9d28-fbceaba24b22 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:07.913876 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-da57c2d1-9c05-4ce5-9d28-fbceaba24b22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:09:07.913876 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:07.913876 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:07.913876 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:07.913876 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:07.913876 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:07.913876 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:07.913876 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:07.913876 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:07.913876 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:07.913876 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:07.913876 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:07.913876 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:09:07.913876 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:09:07.913876 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:09:07.914970 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:09:07.914970 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:07.914970 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:07.914970 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:07.914970 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:07.914970 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:07.914970 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:07.914970 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:07.914970 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:07.914970 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:07.914970 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:07.914970 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:07.914970 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:07.914970 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:07.914970 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:07.914970 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:07.914970 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:07.916115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:09:07.916115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:09:07.916115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:09:07.916115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:09:07.916115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:09:07.916115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:09:07.916115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:09:07.916115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:09:07.916115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 614/1217] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:09:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:09:07.921301 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc67260-a892-4b1c-88c6-fd3087c42677 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:08.020618 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc67260-a892-4b1c-88c6-fd3087c42677 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:08.041782 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:08.052655 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc4e42-f241-471c-8d34-3ac2825f20ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:08.053299 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc4e42-f241-471c-8d34-3ac2825f20ab None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:08.053581 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc4e42-f241-471c-8d34-3ac2825f20ab None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:08.053892 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc4e42-f241-471c-8d34-3ac2825f20ab None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:08.054668 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc4e42-f241-471c-8d34-3ac2825f20ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:08.054976 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc4e42-f241-471c-8d34-3ac2825f20ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:08.056398 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc4e42-f241-471c-8d34-3ac2825f20ab None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:08.069231 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 604/1218] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:09:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:08.075470 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57c2d1-9c05-4ce5-9d28-fbceaba24b22 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:08.173655 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57c2d1-9c05-4ce5-9d28-fbceaba24b22 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:08.201733 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:08.207995 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9fa05-07be-475e-be9e-da81aae0f82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:08.208636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9fa05-07be-475e-be9e-da81aae0f82c None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:08.208920 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9fa05-07be-475e-be9e-da81aae0f82c None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:08.209191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9fa05-07be-475e-be9e-da81aae0f82c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:08.210046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9fa05-07be-475e-be9e-da81aae0f82c None admin] RBAC: Adding query filter params (role.id=9b682db1e9a5486884a74f5c01953fe7, scope.project.id=38ed7416526e473b816330e24acf7a04, user.id=12b7c9264495433985185332778dbc8c) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:08.210356 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9fa05-07be-475e-be9e-da81aae0f82c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:08.211773 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9fa05-07be-475e-be9e-da81aae0f82c None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:08.217154 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 615/1219] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:09:08 2022] GET /identity/v3/role_assignments?user.id=12b7c9264495433985185332778dbc8c&scope.project.id=38ed7416526e473b816330e24acf7a04&role.id=9b682db1e9a5486884a74f5c01953fe7 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:10.211492 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d2dc9-9be9-476e-bdb9-25c5d6c60781 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:10.212026 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d2dc9-9be9-476e-bdb9-25c5d6c60781 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:10.212119 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d2dc9-9be9-476e-bdb9-25c5d6c60781 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:10.213499 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 605/1220] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:09:10.219183 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ba851-961f-4af2-8061-8febbca9a540 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:10.219595 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ba851-961f-4af2-8061-8febbca9a540 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:10.219750 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ba851-961f-4af2-8061-8febbca9a540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:10.237926 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-954ba851-961f-4af2-8061-8febbca9a540 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:09:10.239102 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-954ba851-961f-4af2-8061-8febbca9a540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:09:10.324940 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 616/1221] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:09:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:09:10.352420 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d2dc9-9be9-476e-bdb9-25c5d6c60781 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:10.454287 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d2dc9-9be9-476e-bdb9-25c5d6c60781 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:10.499307 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564dc8ad-51c7-49a4-ae8d-b58a6b1d094c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:10.502275 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dc8ad-51c7-49a4-ae8d-b58a6b1d094c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:10.502396 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dc8ad-51c7-49a4-ae8d-b58a6b1d094c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:10.502594 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dc8ad-51c7-49a4-ae8d-b58a6b1d094c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:10.515479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564dc8ad-51c7-49a4-ae8d-b58a6b1d094c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:09:10.523812 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-564dc8ad-51c7-49a4-ae8d-b58a6b1d094c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:09:10.523812 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:10.523812 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:10.523812 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:10.523812 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:10.523812 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:10.523812 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:10.523812 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:10.523812 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:10.523812 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:10.523812 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:10.523812 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:10.523812 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:09:10.523812 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:09:10.523812 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:09:10.523812 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:09:10.524781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:09:10.524781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:09:10.524781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:09:10.524781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:09:10.524781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:10.524781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:10.524781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:10.524781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:10.524781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:10.524781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:10.524781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:10.524781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:10.524781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:10.524781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:10.524781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:10.524781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:10.525678 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:10.525678 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:10.525678 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:10.525678 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:10.525678 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:09:10.525678 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:09:10.525678 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:09:10.525678 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:09:10.525678 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:09:10.525678 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:09:10.525678 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:09:10.525678 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:09:10.525678 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 606/1222] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jul 11 11:09:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:09:10.531397 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ba851-961f-4af2-8061-8febbca9a540 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:10.656961 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ba851-961f-4af2-8061-8febbca9a540 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:10.684168 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:10.695330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0145d-b002-4617-8a2d-829b0f01183e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:10.696102 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0145d-b002-4617-8a2d-829b0f01183e None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:10.696432 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0145d-b002-4617-8a2d-829b0f01183e None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:10.696714 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0145d-b002-4617-8a2d-829b0f01183e None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:10.697473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec0145d-b002-4617-8a2d-829b0f01183e None admin] RBAC: Adding query filter params (name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:10.697882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec0145d-b002-4617-8a2d-829b0f01183e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:10.699254 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec0145d-b002-4617-8a2d-829b0f01183e None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:10.708124 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 617/1223] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jul 11 11:09:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:10.713859 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564dc8ad-51c7-49a4-ae8d-b58a6b1d094c None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:10.767386 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:10.820843 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564dc8ad-51c7-49a4-ae8d-b58a6b1d094c None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:10.853035 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d22167-98a7-406d-bd33-6c8cb930583e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:10.853843 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d22167-98a7-406d-bd33-6c8cb930583e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:10.854128 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d22167-98a7-406d-bd33-6c8cb930583e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:10.854401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d22167-98a7-406d-bd33-6c8cb930583e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:10.865354 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d22167-98a7-406d-bd33-6c8cb930583e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:10.866812 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d22167-98a7-406d-bd33-6c8cb930583e None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:10.884459 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-49d22167-98a7-406d-bd33-6c8cb930583e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:09:10.884459 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:10.884459 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:10.884459 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:10.884459 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:10.884459 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:10.884459 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:10.884459 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:10.884459 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:10.884459 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:10.884459 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:10.884459 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:10.884459 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:09:10.884459 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:09:10.884459 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:09:10.887449 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:09:10.887449 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:10.887449 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:10.887449 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:10.887449 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:10.887449 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:10.887449 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:10.887449 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:10.887449 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:10.887449 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:10.887449 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:10.887449 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:10.887449 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:10.887449 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:10.887449 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:10.887449 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:10.887449 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:10.888371 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:09:10.888371 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:09:10.888371 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:09:10.888371 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:09:10.888371 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 607/1224] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:09:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:09:10.891496 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0145d-b002-4617-8a2d-829b0f01183e None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:10.992915 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0145d-b002-4617-8a2d-829b0f01183e None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:11.025023 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83c1a4-0370-4bf5-bae3-1c3628840ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:11.025622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83c1a4-0370-4bf5-bae3-1c3628840ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:11.025945 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83c1a4-0370-4bf5-bae3-1c3628840ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:11.026221 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83c1a4-0370-4bf5-bae3-1c3628840ce4 None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:11.026946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83c1a4-0370-4bf5-bae3-1c3628840ce4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:11.027244 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83c1a4-0370-4bf5-bae3-1c3628840ce4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:11.028644 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83c1a4-0370-4bf5-bae3-1c3628840ce4 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:11.040609 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 618/1225] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:11.046747 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d22167-98a7-406d-bd33-6c8cb930583e None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:11.140290 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:11.147042 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d22167-98a7-406d-bd33-6c8cb930583e None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:11.182382 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efa0f7-b80d-4441-951c-ddd90f176595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:11.183353 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efa0f7-b80d-4441-951c-ddd90f176595 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:11.183949 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efa0f7-b80d-4441-951c-ddd90f176595 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:11.184248 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efa0f7-b80d-4441-951c-ddd90f176595 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:11.192765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efa0f7-b80d-4441-951c-ddd90f176595 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:11.194235 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efa0f7-b80d-4441-951c-ddd90f176595 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:11.210775 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-95efa0f7-b80d-4441-951c-ddd90f176595 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 11:09:11.210775 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:11.210775 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:11.210775 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:11.210775 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:11.210775 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:11.210775 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:11.210775 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:11.210775 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:11.210775 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:11.210775 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:11.210775 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:11.210775 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:09:11.210775 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:09:11.210775 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:09:11.210775 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:09:11.214433 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:11.214433 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:11.214433 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:09:11.214433 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:09:11.214433 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:09:11.214433 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:09:11.214433 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:11.214433 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:11.214433 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:11.214433 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:11.214433 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:11.214433 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:11.214433 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:11.214433 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:11.214433 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:11.214433 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:11.214433 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:11.214433 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:11.215463 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:11.215463 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:11.215463 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:09:11.215463 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:09:11.215463 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:09:11.215463 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:09:11.215463 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:09:11.215463 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:09:11.215463 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 11:09:11.215463 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:09:11.215463 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 608/1226] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:09:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:09:11.218257 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83c1a4-0370-4bf5-bae3-1c3628840ce4 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:11.265266 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:11.318551 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83c1a4-0370-4bf5-bae3-1c3628840ce4 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:11.350282 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a250f0-6286-4c68-aa5d-2084122740e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:11.350955 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a250f0-6286-4c68-aa5d-2084122740e5 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:11.351244 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a250f0-6286-4c68-aa5d-2084122740e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:11.351522 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a250f0-6286-4c68-aa5d-2084122740e5 None admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:11.352357 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a250f0-6286-4c68-aa5d-2084122740e5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:11.352671 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a250f0-6286-4c68-aa5d-2084122740e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:11.354135 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a250f0-6286-4c68-aa5d-2084122740e5 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:11.371585 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 619/1227] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Jul 11 11:09:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:11.378316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efa0f7-b80d-4441-951c-ddd90f176595 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:11.478500 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efa0f7-b80d-4441-951c-ddd90f176595 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:11.512183 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1058b-4ba2-4656-a742-af334bd9a187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:11.512976 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1058b-4ba2-4656-a742-af334bd9a187 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:11.513259 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1058b-4ba2-4656-a742-af334bd9a187 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:11.513534 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1058b-4ba2-4656-a742-af334bd9a187 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:11.524734 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1058b-4ba2-4656-a742-af334bd9a187 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:11.526213 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1058b-4ba2-4656-a742-af334bd9a187 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:11.543358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-0ba1058b-4ba2-4656-a742-af334bd9a187 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:09:11.543358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:11.543358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:11.543358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:11.543358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:11.543358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:11.543358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:11.543358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:11.543358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:11.543358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:11.543358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:11.543358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:11.543358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:09:11.543358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:09:11.543358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:09:11.544521 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:09:11.544521 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:11.544521 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:11.544521 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:11.544521 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:11.544521 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:11.544521 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:11.544521 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:11.544521 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:11.544521 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:11.544521 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:11.544521 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:11.544521 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:11.544521 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:11.544521 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:11.544521 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:11.544521 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:11.545544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:09:11.545544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:09:11.545544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:09:11.545544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:09:11.545544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 609/1228] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:09:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:09:11.550827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a250f0-6286-4c68-aa5d-2084122740e5 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:11.655494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a250f0-6286-4c68-aa5d-2084122740e5 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:11.658261 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:11.691055 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc3574-fe48-4ffc-ba55-aa6af7a36558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:11.691724 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc3574-fe48-4ffc-ba55-aa6af7a36558 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:11.692008 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc3574-fe48-4ffc-ba55-aa6af7a36558 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:11.692285 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc3574-fe48-4ffc-ba55-aa6af7a36558 None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:11.693009 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc3574-fe48-4ffc-ba55-aa6af7a36558 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:11.693314 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc3574-fe48-4ffc-ba55-aa6af7a36558 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:11.694717 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc3574-fe48-4ffc-ba55-aa6af7a36558 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:11.706485 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 620/1229] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:11.712339 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1058b-4ba2-4656-a742-af334bd9a187 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:11.722471 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:11.814187 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1058b-4ba2-4656-a742-af334bd9a187 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:11.847393 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656006d2-2a95-44b5-971e-9fc7cc4d6f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:11.848185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656006d2-2a95-44b5-971e-9fc7cc4d6f2c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:11.848467 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656006d2-2a95-44b5-971e-9fc7cc4d6f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:11.848738 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656006d2-2a95-44b5-971e-9fc7cc4d6f2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:11.858679 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656006d2-2a95-44b5-971e-9fc7cc4d6f2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:11.860118 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656006d2-2a95-44b5-971e-9fc7cc4d6f2c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:11.874807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-656006d2-2a95-44b5-971e-9fc7cc4d6f2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:09:11.874807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:11.874807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:11.874807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:11.874807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:11.874807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:11.874807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:11.874807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:11.874807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:11.874807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:11.874807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:11.874807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:11.874807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:09:11.874807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:09:11.874807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:09:11.875875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:09:11.875875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:11.875875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:11.875875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:11.875875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:11.875875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:11.875875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:11.875875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:11.875875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:11.875875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:11.875875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:11.875875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:11.875875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:11.875875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:11.875875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:11.875875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:11.875875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:11.877155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:09:11.877155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:09:11.877155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:09:11.877155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:09:11.877155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:09:11.877155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:09:11.877155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:09:11.877155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:09:11.877155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 610/1230] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:09:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:09:11.882121 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc3574-fe48-4ffc-ba55-aa6af7a36558 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:11.980183 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc3574-fe48-4ffc-ba55-aa6af7a36558 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:12.012318 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd8470-c888-478a-bfdb-e22bb9f50656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:12.012966 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd8470-c888-478a-bfdb-e22bb9f50656 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:12.013249 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd8470-c888-478a-bfdb-e22bb9f50656 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:12.013543 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd8470-c888-478a-bfdb-e22bb9f50656 None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:12.014370 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd8470-c888-478a-bfdb-e22bb9f50656 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:12.014685 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd8470-c888-478a-bfdb-e22bb9f50656 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:12.016092 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd8470-c888-478a-bfdb-e22bb9f50656 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:12.028163 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 621/1231] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:09:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:12.034736 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656006d2-2a95-44b5-971e-9fc7cc4d6f2c None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:12.099217 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:12.131539 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656006d2-2a95-44b5-971e-9fc7cc4d6f2c None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:12.164567 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f446ef-9ba1-4b7a-88b2-496d797bde49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:12.165440 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f446ef-9ba1-4b7a-88b2-496d797bde49 None admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:12.165719 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f446ef-9ba1-4b7a-88b2-496d797bde49 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:12.166023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f446ef-9ba1-4b7a-88b2-496d797bde49 None admin] PATH_INFO: `/v3/projects/38ed7416526e473b816330e24acf7a04/users/12b7c9264495433985185332778dbc8c/roles/9b682db1e9a5486884a74f5c01953fe7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:12.180280 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f446ef-9ba1-4b7a-88b2-496d797bde49 None admin] RBAC: Authorizing `identity:create_grant(project_id=38ed7416526e473b816330e24acf7a04, user_id=12b7c9264495433985185332778dbc8c, role_id=9b682db1e9a5486884a74f5c01953fe7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:12.181871 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f446ef-9ba1-4b7a-88b2-496d797bde49 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:12.346121 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 611/1232] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jul 11 11:09:12 2022] PUT /identity/v3/projects/38ed7416526e473b816330e24acf7a04/users/12b7c9264495433985185332778dbc8c/roles/9b682db1e9a5486884a74f5c01953fe7 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:09:14.350331 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02ae32-ac82-4aec-af83-e8d863584993 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:14.350857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02ae32-ac82-4aec-af83-e8d863584993 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:14.350950 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02ae32-ac82-4aec-af83-e8d863584993 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:14.352256 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 622/1233] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:09:14.357543 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e34380-1fbf-44b7-aa8f-d668f7603fe3 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:14.357952 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e34380-1fbf-44b7-aa8f-d668f7603fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:14.358139 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e34380-1fbf-44b7-aa8f-d668f7603fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:14.374171 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-f4e34380-1fbf-44b7-aa8f-d668f7603fe3 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:09:14.385603 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f4e34380-1fbf-44b7-aa8f-d668f7603fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:09:14.440657 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 612/1234] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:09:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:09:14.464134 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02ae32-ac82-4aec-af83-e8d863584993 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:14.489133 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:14.565051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02ae32-ac82-4aec-af83-e8d863584993 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:14.598334 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd4405-d1bd-4750-8240-331e943c2c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:14.599115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd4405-d1bd-4750-8240-331e943c2c0e None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:14.599397 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd4405-d1bd-4750-8240-331e943c2c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:14.599671 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd4405-d1bd-4750-8240-331e943c2c0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:14.609604 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd4405-d1bd-4750-8240-331e943c2c0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:09:14.617297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-adbd4405-d1bd-4750-8240-331e943c2c0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:09:14.617297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:14.617297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:14.617297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:14.617297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:14.617297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:14.617297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:14.617297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:14.617297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:14.617297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:14.617297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:14.617297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:14.617297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:09:14.617297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:09:14.617297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:09:14.617297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:09:14.621735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:09:14.621735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:09:14.621735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:09:14.621735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:09:14.621735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:14.621735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:14.621735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:14.621735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:14.621735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:14.621735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:14.621735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:14.621735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:14.621735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:14.621735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:14.621735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:14.621735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:14.622883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:14.622883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:14.622883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:14.622883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:14.622883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:09:14.622883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:09:14.622883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:09:14.622883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:09:14.622883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:09:14.622883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:09:14.622883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:09:14.622883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:09:14.622883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 623/1235] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jul 11 11:09:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:09:14.624794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e34380-1fbf-44b7-aa8f-d668f7603fe3 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:14.669982 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:14.721104 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e34380-1fbf-44b7-aa8f-d668f7603fe3 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:14.754023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9edc3a-7f22-4bb0-ac1e-2da629cf41d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:14.754695 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9edc3a-7f22-4bb0-ac1e-2da629cf41d1 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:14.754978 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9edc3a-7f22-4bb0-ac1e-2da629cf41d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:14.755252 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9edc3a-7f22-4bb0-ac1e-2da629cf41d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:14.756023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9edc3a-7f22-4bb0-ac1e-2da629cf41d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:14.756332 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9edc3a-7f22-4bb0-ac1e-2da629cf41d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:14.757717 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9edc3a-7f22-4bb0-ac1e-2da629cf41d1 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:14.766218 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 613/1236] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jul 11 11:09:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:14.772641 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd4405-d1bd-4750-8240-331e943c2c0e None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:14.855122 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:14.871095 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd4405-d1bd-4750-8240-331e943c2c0e None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:14.904273 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b823aa-98d8-45d5-8ac2-10f38b71c73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:14.905083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b823aa-98d8-45d5-8ac2-10f38b71c73e None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:14.905371 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b823aa-98d8-45d5-8ac2-10f38b71c73e None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:14.905666 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b823aa-98d8-45d5-8ac2-10f38b71c73e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:14.916245 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b823aa-98d8-45d5-8ac2-10f38b71c73e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:14.917695 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b823aa-98d8-45d5-8ac2-10f38b71c73e None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:14.936564 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-f2b823aa-98d8-45d5-8ac2-10f38b71c73e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:09:14.936564 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:14.936564 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:14.936564 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:14.936564 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:14.936564 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:14.936564 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:14.936564 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:14.936564 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:14.936564 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:14.936564 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:14.936564 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:14.936564 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:09:14.936564 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:09:14.936564 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:09:14.937718 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:09:14.937718 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:14.937718 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:14.937718 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:14.937718 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:14.937718 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:14.937718 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:14.937718 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:14.937718 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:14.937718 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:14.937718 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:14.937718 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:14.937718 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:14.937718 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:14.937718 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:14.937718 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:14.937718 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:14.938666 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:09:14.938666 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:09:14.938666 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:09:14.938666 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:09:14.938666 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 624/1237] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:09:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:09:14.943770 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9edc3a-7f22-4bb0-ac1e-2da629cf41d1 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:15.043451 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9edc3a-7f22-4bb0-ac1e-2da629cf41d1 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:15.053181 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:15.077039 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee9644-a916-4e68-8f86-5e2fb6dc9639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:15.077697 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee9644-a916-4e68-8f86-5e2fb6dc9639 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:15.078017 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee9644-a916-4e68-8f86-5e2fb6dc9639 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:15.078296 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee9644-a916-4e68-8f86-5e2fb6dc9639 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:15.079000 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee9644-a916-4e68-8f86-5e2fb6dc9639 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:15.079307 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee9644-a916-4e68-8f86-5e2fb6dc9639 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:15.081235 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee9644-a916-4e68-8f86-5e2fb6dc9639 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:15.092268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 614/1238] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:15.098629 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b823aa-98d8-45d5-8ac2-10f38b71c73e None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:15.196438 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b823aa-98d8-45d5-8ac2-10f38b71c73e None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:15.230323 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0fb493-6a7c-4d88-ac07-6f181b75b628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:15.231117 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fb493-6a7c-4d88-ac07-6f181b75b628 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:15.231404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fb493-6a7c-4d88-ac07-6f181b75b628 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:15.231681 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fb493-6a7c-4d88-ac07-6f181b75b628 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:15.234368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:15.239510 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0fb493-6a7c-4d88-ac07-6f181b75b628 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:15.240956 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0fb493-6a7c-4d88-ac07-6f181b75b628 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:15.255980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-1b0fb493-6a7c-4d88-ac07-6f181b75b628 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 11:09:15.255980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:15.255980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:15.255980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:15.255980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:15.255980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:15.255980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:15.255980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:15.255980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:15.255980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:15.255980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:15.255980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:15.255980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:09:15.255980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:09:15.255980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:09:15.255980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:09:15.262119 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:15.262119 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:15.262119 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:09:15.262119 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:09:15.262119 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:09:15.262119 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:09:15.262119 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:15.262119 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:15.262119 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:15.262119 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:15.262119 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:15.262119 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:15.262119 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:15.262119 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:15.262119 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:15.262119 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:15.262119 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:15.262119 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:15.263481 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:15.263481 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:15.263481 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:09:15.263481 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:09:15.263481 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:09:15.263481 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:09:15.263481 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:09:15.263481 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:09:15.263481 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 11:09:15.263481 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:09:15.263481 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 625/1239] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:09:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:09:15.264233 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee9644-a916-4e68-8f86-5e2fb6dc9639 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:15.361380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee9644-a916-4e68-8f86-5e2fb6dc9639 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:15.393511 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2bac2-8c9d-46c1-a43f-b575b2a2c6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:15.394194 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2bac2-8c9d-46c1-a43f-b575b2a2c6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:15.394480 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2bac2-8c9d-46c1-a43f-b575b2a2c6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:15.394758 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2bac2-8c9d-46c1-a43f-b575b2a2c6f8 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:15.395635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2bac2-8c9d-46c1-a43f-b575b2a2c6f8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:15.395946 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2bac2-8c9d-46c1-a43f-b575b2a2c6f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:15.397356 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2bac2-8c9d-46c1-a43f-b575b2a2c6f8 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:15.414648 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 615/1240] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Jul 11 11:09:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:15.420355 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0fb493-6a7c-4d88-ac07-6f181b75b628 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:15.519044 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0fb493-6a7c-4d88-ac07-6f181b75b628 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:15.553333 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eac1da-0a69-4284-9c87-9e943b846778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:15.554000 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eac1da-0a69-4284-9c87-9e943b846778 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:15.554288 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eac1da-0a69-4284-9c87-9e943b846778 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:15.554592 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eac1da-0a69-4284-9c87-9e943b846778 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:15.613676 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:15.619995 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eac1da-0a69-4284-9c87-9e943b846778 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:15.621433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eac1da-0a69-4284-9c87-9e943b846778 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:15.717580 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 626/1241] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:09:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 11:09:15.724128 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2bac2-8c9d-46c1-a43f-b575b2a2c6f8 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:15.750708 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:15.820844 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2bac2-8c9d-46c1-a43f-b575b2a2c6f8 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:15.855232 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41423c-caac-40dc-87d1-6af8d1e1c931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:15.856025 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41423c-caac-40dc-87d1-6af8d1e1c931 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:15.856310 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41423c-caac-40dc-87d1-6af8d1e1c931 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:15.856589 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41423c-caac-40dc-87d1-6af8d1e1c931 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:15.866867 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41423c-caac-40dc-87d1-6af8d1e1c931 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:15.868298 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41423c-caac-40dc-87d1-6af8d1e1c931 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:15.885180 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-fb41423c-caac-40dc-87d1-6af8d1e1c931 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:09:15.885180 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:15.885180 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:15.885180 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:15.885180 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:15.885180 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:15.885180 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:15.885180 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:15.885180 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:15.885180 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:15.885180 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:15.885180 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:15.885180 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:09:15.885180 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:09:15.885180 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:09:15.886266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:09:15.886266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:15.886266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:15.886266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:15.886266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:15.886266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:15.886266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:15.886266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:15.886266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:15.886266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:15.886266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:15.886266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:15.886266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:15.886266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:15.886266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:15.886266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:15.886266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:15.887479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:09:15.887479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:09:15.887479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:09:15.887479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:09:15.887479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 616/1242] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:09:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:09:15.892963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eac1da-0a69-4284-9c87-9e943b846778 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:15.985161 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:15.990986 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eac1da-0a69-4284-9c87-9e943b846778 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:16.024247 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08f0ca-a6e5-46a3-adc1-0d0af0361c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:16.024893 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08f0ca-a6e5-46a3-adc1-0d0af0361c39 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:16.025176 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08f0ca-a6e5-46a3-adc1-0d0af0361c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:16.025450 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08f0ca-a6e5-46a3-adc1-0d0af0361c39 None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:16.026185 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08f0ca-a6e5-46a3-adc1-0d0af0361c39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:16.026544 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08f0ca-a6e5-46a3-adc1-0d0af0361c39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:16.027956 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08f0ca-a6e5-46a3-adc1-0d0af0361c39 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:16.039440 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 627/1243] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:16.045011 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41423c-caac-40dc-87d1-6af8d1e1c931 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:16.122879 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:16.144696 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41423c-caac-40dc-87d1-6af8d1e1c931 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:16.177405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd8797-8c4d-4ab2-a228-8bc6e7b5fec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:16.178238 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd8797-8c4d-4ab2-a228-8bc6e7b5fec7 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:16.178521 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd8797-8c4d-4ab2-a228-8bc6e7b5fec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:16.178797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd8797-8c4d-4ab2-a228-8bc6e7b5fec7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:16.185449 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd8797-8c4d-4ab2-a228-8bc6e7b5fec7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:16.186909 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd8797-8c4d-4ab2-a228-8bc6e7b5fec7 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:16.201635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-86bd8797-8c4d-4ab2-a228-8bc6e7b5fec7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:09:16.201635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:16.201635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:16.201635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:16.201635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:16.201635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:16.201635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:16.201635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:16.201635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:16.201635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:16.201635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:16.201635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:16.201635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:09:16.201635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:09:16.201635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:09:16.202716 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:09:16.202716 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:16.202716 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:16.202716 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:16.202716 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:16.202716 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:16.202716 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:16.202716 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:16.202716 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:16.202716 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:16.202716 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:16.202716 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:16.202716 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:16.202716 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:16.202716 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:16.202716 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:16.202716 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:16.203702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:09:16.203702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:09:16.203702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:09:16.203702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:09:16.203702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:09:16.203702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:09:16.203702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:09:16.203702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:09:16.203702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 617/1244] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:09:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:09:16.209420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08f0ca-a6e5-46a3-adc1-0d0af0361c39 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:16.308975 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08f0ca-a6e5-46a3-adc1-0d0af0361c39 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:16.342044 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490bb338-2d9e-4579-93ca-d52af69f5707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:16.342697 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490bb338-2d9e-4579-93ca-d52af69f5707 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:16.342985 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490bb338-2d9e-4579-93ca-d52af69f5707 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:16.343263 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490bb338-2d9e-4579-93ca-d52af69f5707 None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:16.344067 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490bb338-2d9e-4579-93ca-d52af69f5707 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:16.344375 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490bb338-2d9e-4579-93ca-d52af69f5707 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:16.346050 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490bb338-2d9e-4579-93ca-d52af69f5707 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:16.357962 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 628/1245] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:09:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:16.364089 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd8797-8c4d-4ab2-a228-8bc6e7b5fec7 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:16.463045 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd8797-8c4d-4ab2-a228-8bc6e7b5fec7 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:16.495668 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be556daa-4308-436e-b379-4f6f1c0ef363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:16.496314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be556daa-4308-436e-b379-4f6f1c0ef363 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:16.496599 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be556daa-4308-436e-b379-4f6f1c0ef363 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:16.496876 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be556daa-4308-436e-b379-4f6f1c0ef363 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:16.497698 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be556daa-4308-436e-b379-4f6f1c0ef363 None admin] RBAC: Adding query filter params (role.id=9b682db1e9a5486884a74f5c01953fe7, scope.project.id=38ed7416526e473b816330e24acf7a04, user.id=12b7c9264495433985185332778dbc8c) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:16.498041 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be556daa-4308-436e-b379-4f6f1c0ef363 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:16.499450 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be556daa-4308-436e-b379-4f6f1c0ef363 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:16.505814 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 618/1246] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:09:16 2022] GET /identity/v3/role_assignments?user.id=12b7c9264495433985185332778dbc8c&scope.project.id=38ed7416526e473b816330e24acf7a04&role.id=9b682db1e9a5486884a74f5c01953fe7 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:18.571100 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d011a9-9dbe-49ed-a5a0-8030efb23f5f None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:18.571657 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d011a9-9dbe-49ed-a5a0-8030efb23f5f None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:18.571657 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d011a9-9dbe-49ed-a5a0-8030efb23f5f None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:18.573048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 629/1247] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:09:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:09:18.578306 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e7f7e-36fa-49b1-a882-36f1ee0e1f01 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:18.578732 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e7f7e-36fa-49b1-a882-36f1ee0e1f01 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:18.578870 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e7f7e-36fa-49b1-a882-36f1ee0e1f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:18.584579 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:18.597094 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-873e7f7e-36fa-49b1-a882-36f1ee0e1f01 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:09:18.598299 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-873e7f7e-36fa-49b1-a882-36f1ee0e1f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:09:18.662440 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 619/1248] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:09:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:09:18.685935 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d011a9-9dbe-49ed-a5a0-8030efb23f5f None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:18.705176 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:18.788901 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d011a9-9dbe-49ed-a5a0-8030efb23f5f None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:18.823983 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3dacd2-1362-4bec-8935-ec65b0c1f26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:18.824700 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dacd2-1362-4bec-8935-ec65b0c1f26b None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:18.824984 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dacd2-1362-4bec-8935-ec65b0c1f26b None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:18.825257 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dacd2-1362-4bec-8935-ec65b0c1f26b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:18.835229 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3dacd2-1362-4bec-8935-ec65b0c1f26b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:09:18.842882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-dd3dacd2-1362-4bec-8935-ec65b0c1f26b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:09:18.842882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:18.842882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:18.842882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:18.842882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:18.842882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:18.842882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:18.842882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:18.842882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:18.842882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:18.842882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:18.842882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:18.842882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:09:18.842882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:09:18.842882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:09:18.842882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:09:18.851450 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:09:18.851450 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:09:18.851450 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:09:18.851450 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:09:18.851450 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:18.851450 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:18.851450 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:18.851450 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:18.851450 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:18.851450 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:18.851450 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:18.851450 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:18.851450 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:18.851450 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:18.851450 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:18.851450 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:18.852404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:18.852404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:18.852404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:18.852404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:18.852404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:09:18.852404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:09:18.852404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:09:18.852404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:09:18.852404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:09:18.852404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:09:18.852404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:09:18.852404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:09:18.852404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 630/1249] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:09:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:09:18.853184 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e7f7e-36fa-49b1-a882-36f1ee0e1f01 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:18.947216 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e7f7e-36fa-49b1-a882-36f1ee0e1f01 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:18.975443 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:18.980266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4eb1d5-c034-4366-89be-14fc96fdcbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:18.980925 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4eb1d5-c034-4366-89be-14fc96fdcbf4 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:18.981213 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4eb1d5-c034-4366-89be-14fc96fdcbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:18.981492 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4eb1d5-c034-4366-89be-14fc96fdcbf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:18.982275 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4eb1d5-c034-4366-89be-14fc96fdcbf4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:18.982585 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4eb1d5-c034-4366-89be-14fc96fdcbf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:18.984504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4eb1d5-c034-4366-89be-14fc96fdcbf4 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:18.992689 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 620/1250] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:09:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:18.998469 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3dacd2-1362-4bec-8935-ec65b0c1f26b None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:19.074840 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:19.097371 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3dacd2-1362-4bec-8935-ec65b0c1f26b None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:19.130934 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd40511-f465-4b59-bc18-71e058ed96c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:19.131714 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd40511-f465-4b59-bc18-71e058ed96c9 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:19.131999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd40511-f465-4b59-bc18-71e058ed96c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:19.132276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd40511-f465-4b59-bc18-71e058ed96c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:19.142622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd40511-f465-4b59-bc18-71e058ed96c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:19.144048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd40511-f465-4b59-bc18-71e058ed96c9 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:19.161526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-dbd40511-f465-4b59-bc18-71e058ed96c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:09:19.161526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:19.161526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:19.161526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:19.161526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:19.161526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:19.161526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:19.161526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:19.161526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:19.161526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:19.161526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:19.161526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:19.161526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:09:19.161526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:09:19.161526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:09:19.162606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:09:19.162606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:19.162606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:19.162606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:19.162606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:19.162606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:19.162606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:19.162606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:19.162606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:19.162606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:19.162606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:19.162606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:19.162606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:19.162606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:19.162606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:19.162606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:19.162606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:19.163839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:09:19.163839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:09:19.163839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:09:19.163839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:09:19.163839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 631/1251] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:09:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:09:19.168449 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4eb1d5-c034-4366-89be-14fc96fdcbf4 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:19.269486 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4eb1d5-c034-4366-89be-14fc96fdcbf4 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:19.303136 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015d9f1-56d1-4a70-a6c4-5ac47c2cf692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:19.303799 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015d9f1-56d1-4a70-a6c4-5ac47c2cf692 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:19.304084 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015d9f1-56d1-4a70-a6c4-5ac47c2cf692 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:19.304364 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015d9f1-56d1-4a70-a6c4-5ac47c2cf692 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:19.305082 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b015d9f1-56d1-4a70-a6c4-5ac47c2cf692 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:19.305391 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b015d9f1-56d1-4a70-a6c4-5ac47c2cf692 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:19.306774 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b015d9f1-56d1-4a70-a6c4-5ac47c2cf692 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:19.318322 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 621/1252] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:19.324061 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd40511-f465-4b59-bc18-71e058ed96c9 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:19.420267 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd40511-f465-4b59-bc18-71e058ed96c9 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:19.446072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:19.453536 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d77a54-f261-4b3a-8149-6b1287241fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:19.454868 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d77a54-f261-4b3a-8149-6b1287241fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:19.455154 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d77a54-f261-4b3a-8149-6b1287241fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:19.455476 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d77a54-f261-4b3a-8149-6b1287241fb2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:19.462660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d77a54-f261-4b3a-8149-6b1287241fb2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:19.464109 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d77a54-f261-4b3a-8149-6b1287241fb2 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:19.479017 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-67d77a54-f261-4b3a-8149-6b1287241fb2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 11:09:19.479017 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:19.479017 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:19.479017 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:19.479017 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:19.479017 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:19.479017 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:19.479017 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:19.479017 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:19.479017 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:19.479017 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:19.479017 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:19.479017 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:09:19.479017 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:09:19.479017 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:09:19.479017 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:09:19.487857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:19.487857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:19.487857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:09:19.487857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:09:19.487857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:09:19.487857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:09:19.487857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:19.487857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:19.487857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:19.487857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:19.487857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:19.487857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:19.487857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:19.487857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:19.487857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:19.487857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:19.487857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:19.487857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:19.489022 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:19.489022 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:19.489022 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:09:19.489022 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:09:19.489022 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:09:19.489022 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:09:19.489022 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:09:19.489022 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:09:19.489022 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 11:09:19.489022 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:09:19.489022 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 632/1253] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:09:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:09:19.489741 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015d9f1-56d1-4a70-a6c4-5ac47c2cf692 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:19.541472 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:19.585689 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015d9f1-56d1-4a70-a6c4-5ac47c2cf692 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:19.619845 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf352f-1a9d-4617-8d4f-88e3e2fead59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:19.620536 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf352f-1a9d-4617-8d4f-88e3e2fead59 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:19.620821 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf352f-1a9d-4617-8d4f-88e3e2fead59 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:19.621101 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf352f-1a9d-4617-8d4f-88e3e2fead59 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:19.621965 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf352f-1a9d-4617-8d4f-88e3e2fead59 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:19.622283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf352f-1a9d-4617-8d4f-88e3e2fead59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:19.623725 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf352f-1a9d-4617-8d4f-88e3e2fead59 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:19.640337 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 622/1254] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Jul 11 11:09:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:19.646747 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d77a54-f261-4b3a-8149-6b1287241fb2 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:19.747315 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d77a54-f261-4b3a-8149-6b1287241fb2 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:19.781742 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c9b76-0e9f-47b1-9679-d6ddcdc9ebe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:19.782425 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c9b76-0e9f-47b1-9679-d6ddcdc9ebe7 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:19.782707 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c9b76-0e9f-47b1-9679-d6ddcdc9ebe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:19.783008 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c9b76-0e9f-47b1-9679-d6ddcdc9ebe7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:19.838163 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:19.850592 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c9b76-0e9f-47b1-9679-d6ddcdc9ebe7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:19.852068 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c9b76-0e9f-47b1-9679-d6ddcdc9ebe7 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:19.947430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 633/1255] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:09:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 11:09:19.953389 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf352f-1a9d-4617-8d4f-88e3e2fead59 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:20.050746 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf352f-1a9d-4617-8d4f-88e3e2fead59 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:20.063744 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:20.083874 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3728b1-01c9-4eac-9c29-b4bd5268d69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:20.084658 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3728b1-01c9-4eac-9c29-b4bd5268d69d None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:20.084939 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3728b1-01c9-4eac-9c29-b4bd5268d69d None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:20.085213 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3728b1-01c9-4eac-9c29-b4bd5268d69d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:20.094923 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3728b1-01c9-4eac-9c29-b4bd5268d69d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:20.097091 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3728b1-01c9-4eac-9c29-b4bd5268d69d None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:20.115851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-4f3728b1-01c9-4eac-9c29-b4bd5268d69d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:09:20.115851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:20.115851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:20.115851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:20.115851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:20.115851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:20.115851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:20.115851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:20.115851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:20.115851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:20.115851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:20.115851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:20.115851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:09:20.115851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:09:20.115851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:09:20.116893 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:09:20.116893 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:20.116893 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:20.116893 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:20.116893 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:20.116893 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:20.116893 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:20.116893 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:20.116893 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:20.116893 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:20.116893 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:20.116893 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:20.116893 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:20.116893 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:20.116893 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:20.116893 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:20.116893 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:20.118049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:09:20.118049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:09:20.118049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:09:20.118049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:09:20.118049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 623/1256] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:09:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:09:20.122806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c9b76-0e9f-47b1-9679-d6ddcdc9ebe7 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:20.209033 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:20.221136 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c9b76-0e9f-47b1-9679-d6ddcdc9ebe7 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:20.254137 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceafdd2-0604-4c5a-b3cd-a8193e8a9303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:20.254777 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceafdd2-0604-4c5a-b3cd-a8193e8a9303 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:20.255060 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceafdd2-0604-4c5a-b3cd-a8193e8a9303 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:20.255336 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceafdd2-0604-4c5a-b3cd-a8193e8a9303 None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:20.256046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceafdd2-0604-4c5a-b3cd-a8193e8a9303 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:20.256363 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceafdd2-0604-4c5a-b3cd-a8193e8a9303 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:20.257857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceafdd2-0604-4c5a-b3cd-a8193e8a9303 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:20.269205 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 634/1257] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:20.274867 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3728b1-01c9-4eac-9c29-b4bd5268d69d None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:20.374057 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3728b1-01c9-4eac-9c29-b4bd5268d69d None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:20.408334 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d3f81-706e-43cf-a60a-6b75ef52e9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:20.409124 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d3f81-706e-43cf-a60a-6b75ef52e9fd None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:20.409414 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d3f81-706e-43cf-a60a-6b75ef52e9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:20.409693 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d3f81-706e-43cf-a60a-6b75ef52e9fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:20.416277 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d3f81-706e-43cf-a60a-6b75ef52e9fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:20.417751 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d3f81-706e-43cf-a60a-6b75ef52e9fd None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:20.431880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-e40d3f81-706e-43cf-a60a-6b75ef52e9fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:09:20.431880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:20.431880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:20.431880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:20.431880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:20.431880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:20.431880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:20.431880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:20.431880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:20.431880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:20.431880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:20.431880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:20.431880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:09:20.431880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:09:20.431880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:09:20.432951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:09:20.432951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:20.432951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:20.432951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:20.432951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:20.432951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:20.432951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:20.432951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:20.432951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:20.432951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:20.432951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:20.432951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:20.432951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:20.432951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:20.432951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:20.432951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:20.432951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:20.434422 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:09:20.434422 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:09:20.434422 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:09:20.434422 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:09:20.434422 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:09:20.434422 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:09:20.434422 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:09:20.434422 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:09:20.434422 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 624/1258] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:09:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:09:20.439964 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceafdd2-0604-4c5a-b3cd-a8193e8a9303 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:20.536293 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceafdd2-0604-4c5a-b3cd-a8193e8a9303 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:20.569106 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1fba4-2965-49d3-b66c-4399aebafd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:20.569748 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1fba4-2965-49d3-b66c-4399aebafd54 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:20.570060 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1fba4-2965-49d3-b66c-4399aebafd54 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:20.570335 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1fba4-2965-49d3-b66c-4399aebafd54 None admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:20.571113 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1fba4-2965-49d3-b66c-4399aebafd54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:20.571426 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1fba4-2965-49d3-b66c-4399aebafd54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:20.572852 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1fba4-2965-49d3-b66c-4399aebafd54 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:20.586003 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 635/1259] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:09:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:20.592097 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d3f81-706e-43cf-a60a-6b75ef52e9fd None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:20.619068 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:20.691582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d3f81-706e-43cf-a60a-6b75ef52e9fd None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:20.724820 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450be089-c780-473a-98c5-9d89b80eb4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:20.725471 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450be089-c780-473a-98c5-9d89b80eb4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:20.725756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450be089-c780-473a-98c5-9d89b80eb4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:20.726068 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450be089-c780-473a-98c5-9d89b80eb4b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:20.726969 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450be089-c780-473a-98c5-9d89b80eb4b4 None admin] RBAC: Adding query filter params (role.id=736e70deba004b9289c2fed43eb107f7, scope.project.id=38ed7416526e473b816330e24acf7a04, user.id=12b7c9264495433985185332778dbc8c) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:20.727288 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450be089-c780-473a-98c5-9d89b80eb4b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:20.728708 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450be089-c780-473a-98c5-9d89b80eb4b4 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:20.734118 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 625/1260] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:09:20 2022] GET /identity/v3/role_assignments?user.id=12b7c9264495433985185332778dbc8c&scope.project.id=38ed7416526e473b816330e24acf7a04&role.id=736e70deba004b9289c2fed43eb107f7 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:22.725146 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92289c7e-7d40-4b65-b948-71bef4d58c55 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:22.725675 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92289c7e-7d40-4b65-b948-71bef4d58c55 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:22.725675 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92289c7e-7d40-4b65-b948-71bef4d58c55 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:22.727134 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 636/1261] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:09:22.732340 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab3d29-a09b-46a2-a1a6-92a3a24c7517 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:22.732745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab3d29-a09b-46a2-a1a6-92a3a24c7517 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:22.732903 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab3d29-a09b-46a2-a1a6-92a3a24c7517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:22.749779 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-9dab3d29-a09b-46a2-a1a6-92a3a24c7517 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:09:22.750952 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9dab3d29-a09b-46a2-a1a6-92a3a24c7517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:09:22.818095 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 626/1262] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:09:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:09:22.840298 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92289c7e-7d40-4b65-b948-71bef4d58c55 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:22.851898 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:22.942939 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92289c7e-7d40-4b65-b948-71bef4d58c55 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:22.976642 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333a649-a34d-4db1-a78e-4cc057028b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:22.977384 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333a649-a34d-4db1-a78e-4cc057028b6f None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:22.977671 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333a649-a34d-4db1-a78e-4cc057028b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:22.978137 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333a649-a34d-4db1-a78e-4cc057028b6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:22.988891 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333a649-a34d-4db1-a78e-4cc057028b6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:09:22.996880 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-8333a649-a34d-4db1-a78e-4cc057028b6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:09:22.996880 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:22.996880 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:22.996880 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:22.996880 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:22.996880 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:22.996880 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:22.996880 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:22.996880 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:22.996880 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:22.996880 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:22.996880 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:22.996880 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:09:22.996880 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:09:22.996880 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:09:22.996880 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:09:22.997979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:09:22.997979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:09:22.997979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:09:22.997979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:09:22.997979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:22.997979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:22.997979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:22.997979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:22.997979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:22.997979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:22.997979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:22.997979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:22.997979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:22.997979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:22.997979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:22.997979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:22.999030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:22.999030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:22.999030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:22.999030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:22.999030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:09:22.999030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:09:22.999030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:09:22.999030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:09:22.999030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:09:22.999030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:09:22.999030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:09:22.999030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:09:22.999030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 637/1263] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:09:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:09:23.004688 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab3d29-a09b-46a2-a1a6-92a3a24c7517 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:23.022670 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:23.101542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab3d29-a09b-46a2-a1a6-92a3a24c7517 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:23.134832 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6043a66-20ce-461e-8cc6-3dca2ae6ffac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:23.135488 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6043a66-20ce-461e-8cc6-3dca2ae6ffac None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:23.135770 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6043a66-20ce-461e-8cc6-3dca2ae6ffac None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:23.136042 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6043a66-20ce-461e-8cc6-3dca2ae6ffac None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:23.136777 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6043a66-20ce-461e-8cc6-3dca2ae6ffac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:23.137083 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6043a66-20ce-461e-8cc6-3dca2ae6ffac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:23.138458 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6043a66-20ce-461e-8cc6-3dca2ae6ffac None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:23.146350 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 627/1264] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:09:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:23.152184 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333a649-a34d-4db1-a78e-4cc057028b6f None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:23.221506 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:23.256084 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333a649-a34d-4db1-a78e-4cc057028b6f None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:23.288832 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4f562-c76e-4b2f-8ec1-07386bcccd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:23.289618 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4f562-c76e-4b2f-8ec1-07386bcccd83 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:23.289937 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4f562-c76e-4b2f-8ec1-07386bcccd83 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:23.290219 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4f562-c76e-4b2f-8ec1-07386bcccd83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:23.301626 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4f562-c76e-4b2f-8ec1-07386bcccd83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:23.303147 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4f562-c76e-4b2f-8ec1-07386bcccd83 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:23.320848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-77d4f562-c76e-4b2f-8ec1-07386bcccd83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:09:23.320848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:23.320848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:23.320848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:23.320848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:23.320848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:23.320848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:23.320848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:23.320848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:23.320848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:23.320848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:23.320848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:23.320848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:09:23.320848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:09:23.320848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:09:23.322565 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:09:23.322565 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:23.322565 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:23.322565 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:23.322565 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:23.322565 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:23.322565 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:23.322565 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:23.322565 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:23.322565 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:23.322565 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:23.322565 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:23.322565 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:23.322565 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:23.322565 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:23.322565 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:23.322565 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:23.323824 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:09:23.323824 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:09:23.323824 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:09:23.323824 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:09:23.323824 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 638/1265] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:09:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:09:23.327823 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6043a66-20ce-461e-8cc6-3dca2ae6ffac None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:23.406379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:23.425440 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6043a66-20ce-461e-8cc6-3dca2ae6ffac None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:23.458327 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47acbf6-a405-4d47-8477-7ccb116afd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:23.458978 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47acbf6-a405-4d47-8477-7ccb116afd63 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:23.459265 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47acbf6-a405-4d47-8477-7ccb116afd63 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:23.459542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47acbf6-a405-4d47-8477-7ccb116afd63 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:23.460254 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47acbf6-a405-4d47-8477-7ccb116afd63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:23.460563 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47acbf6-a405-4d47-8477-7ccb116afd63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:23.461939 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47acbf6-a405-4d47-8477-7ccb116afd63 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:23.473735 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 628/1266] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:09:23.479857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4f562-c76e-4b2f-8ec1-07386bcccd83 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:23.582042 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4f562-c76e-4b2f-8ec1-07386bcccd83 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:23.602454 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:23.616312 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e7f78-cdfc-4ae0-8261-39c3af465d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:23.617106 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e7f78-cdfc-4ae0-8261-39c3af465d53 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:23.617388 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e7f78-cdfc-4ae0-8261-39c3af465d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:23.617659 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e7f78-cdfc-4ae0-8261-39c3af465d53 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:23.625189 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e7f78-cdfc-4ae0-8261-39c3af465d53 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:23.626839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e7f78-cdfc-4ae0-8261-39c3af465d53 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:23.640803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-145e7f78-cdfc-4ae0-8261-39c3af465d53 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 11:09:23.640803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:23.640803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:23.640803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:23.640803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:23.640803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:23.640803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:23.640803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:23.640803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:23.640803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:23.640803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:23.640803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:23.640803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:09:23.640803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:09:23.640803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:09:23.640803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:09:23.647813 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:23.647813 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:23.647813 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:09:23.647813 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:09:23.647813 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:09:23.647813 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:09:23.647813 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:23.647813 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:23.647813 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:23.647813 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:23.647813 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:23.647813 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:23.647813 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:23.647813 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:23.647813 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:23.647813 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:23.647813 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:23.647813 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:23.648997 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:23.648997 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:23.648997 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:09:23.648997 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:09:23.648997 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:09:23.648997 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:09:23.648997 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:09:23.648997 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:09:23.648997 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 11:09:23.648997 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:09:23.648997 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 639/1267] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:09:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:09:23.649789 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47acbf6-a405-4d47-8477-7ccb116afd63 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:23.746326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47acbf6-a405-4d47-8477-7ccb116afd63 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:23.780111 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b70ca2-5730-4f16-97c1-1c4b13229c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:23.780799 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b70ca2-5730-4f16-97c1-1c4b13229c33 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:23.781107 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b70ca2-5730-4f16-97c1-1c4b13229c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:23.781381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b70ca2-5730-4f16-97c1-1c4b13229c33 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:23.782246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b70ca2-5730-4f16-97c1-1c4b13229c33 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:23.786012 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b70ca2-5730-4f16-97c1-1c4b13229c33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:23.786012 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b70ca2-5730-4f16-97c1-1c4b13229c33 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:23.792998 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:23.802035 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 629/1268] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Jul 11 11:09:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:23.807724 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e7f78-cdfc-4ae0-8261-39c3af465d53 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:23.910296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e7f78-cdfc-4ae0-8261-39c3af465d53 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:23.943263 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06320ac1-3bb8-4a3f-8225-79f77c075442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:23.944149 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06320ac1-3bb8-4a3f-8225-79f77c075442 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:23.944429 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06320ac1-3bb8-4a3f-8225-79f77c075442 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:23.944701 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06320ac1-3bb8-4a3f-8225-79f77c075442 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:23.955660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06320ac1-3bb8-4a3f-8225-79f77c075442 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:23.957077 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06320ac1-3bb8-4a3f-8225-79f77c075442 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:23.973437 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-06320ac1-3bb8-4a3f-8225-79f77c075442 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:09:23.973437 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:23.973437 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:23.973437 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:23.973437 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:23.973437 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:23.973437 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:23.973437 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:23.973437 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:23.973437 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:23.973437 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:23.973437 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:23.973437 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:09:23.973437 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:09:23.973437 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:09:23.974494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:09:23.974494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:23.974494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:23.974494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:23.974494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:23.974494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:23.974494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:23.974494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:23.974494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:23.974494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:23.974494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:23.974494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:23.974494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:23.974494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:23.974494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:23.974494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:23.974494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:23.975862 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:09:23.975862 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:09:23.975862 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:09:23.975862 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:09:23.975862 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 640/1269] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:09:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:09:23.980364 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b70ca2-5730-4f16-97c1-1c4b13229c33 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:24.076805 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b70ca2-5730-4f16-97c1-1c4b13229c33 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:24.109304 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b110e-8f57-419b-84f5-8716b967fd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:24.109982 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b110e-8f57-419b-84f5-8716b967fd21 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:24.110268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b110e-8f57-419b-84f5-8716b967fd21 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:24.111074 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b110e-8f57-419b-84f5-8716b967fd21 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:24.111896 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b110e-8f57-419b-84f5-8716b967fd21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:24.112202 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b110e-8f57-419b-84f5-8716b967fd21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:24.113545 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b110e-8f57-419b-84f5-8716b967fd21 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:24.124457 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 630/1270] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:24.130656 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06320ac1-3bb8-4a3f-8225-79f77c075442 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:24.161976 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:24.228345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06320ac1-3bb8-4a3f-8225-79f77c075442 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:24.263116 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb70308-df1a-4d2d-8c96-fd214a78bedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:24.263914 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb70308-df1a-4d2d-8c96-fd214a78bedb None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:24.264205 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb70308-df1a-4d2d-8c96-fd214a78bedb None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:24.264486 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb70308-df1a-4d2d-8c96-fd214a78bedb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:24.272214 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb70308-df1a-4d2d-8c96-fd214a78bedb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:24.273649 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb70308-df1a-4d2d-8c96-fd214a78bedb None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:24.287629 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-bfb70308-df1a-4d2d-8c96-fd214a78bedb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:09:24.287629 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:24.287629 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:24.287629 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:24.287629 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:24.287629 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:24.287629 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:24.287629 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:24.287629 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:24.287629 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:24.287629 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:24.287629 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:24.287629 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:09:24.287629 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:09:24.287629 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:09:24.288721 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:09:24.288721 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:24.288721 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:24.288721 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:24.288721 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:24.288721 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:24.288721 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:24.288721 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:24.288721 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:24.288721 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:24.288721 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:24.288721 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:24.288721 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:24.288721 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:24.288721 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:24.288721 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:24.288721 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:24.289727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:09:24.289727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:09:24.289727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:09:24.289727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:09:24.289727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:09:24.289727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:09:24.289727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:09:24.289727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:09:24.289727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 641/1271] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:09:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:09:24.294811 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b110e-8f57-419b-84f5-8716b967fd21 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:24.352239 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:24.392334 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b110e-8f57-419b-84f5-8716b967fd21 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:24.426148 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dc3fe-81dd-43af-8d36-8d3551171f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:24.426751 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dc3fe-81dd-43af-8d36-8d3551171f08 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:24.427038 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dc3fe-81dd-43af-8d36-8d3551171f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:24.427318 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dc3fe-81dd-43af-8d36-8d3551171f08 None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:24.428131 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580dc3fe-81dd-43af-8d36-8d3551171f08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:24.428443 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580dc3fe-81dd-43af-8d36-8d3551171f08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:24.429943 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580dc3fe-81dd-43af-8d36-8d3551171f08 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:24.441968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 631/1272] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:09:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:24.447939 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb70308-df1a-4d2d-8c96-fd214a78bedb None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:24.537431 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:24.545890 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb70308-df1a-4d2d-8c96-fd214a78bedb None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:24.580687 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27377527-3aae-4b35-96b4-e7e5a3b8ca9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:24.581601 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27377527-3aae-4b35-96b4-e7e5a3b8ca9b None admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:24.581919 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27377527-3aae-4b35-96b4-e7e5a3b8ca9b None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:24.582197 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27377527-3aae-4b35-96b4-e7e5a3b8ca9b None admin] PATH_INFO: `/v3/projects/38ed7416526e473b816330e24acf7a04/users/12b7c9264495433985185332778dbc8c/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:24.584112 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27377527-3aae-4b35-96b4-e7e5a3b8ca9b None admin] RBAC: Authorizing `identity:create_grant(project_id=38ed7416526e473b816330e24acf7a04, user_id=12b7c9264495433985185332778dbc8c, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:24.585527 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27377527-3aae-4b35-96b4-e7e5a3b8ca9b None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:24.676863 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 642/1273] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jul 11 11:09:24 2022] PUT /identity/v3/projects/38ed7416526e473b816330e24acf7a04/users/12b7c9264495433985185332778dbc8c/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:09:26.676869 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0dbff-37da-429f-b5c9-5495a28ef39a None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:26.677397 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0dbff-37da-429f-b5c9-5495a28ef39a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:26.677397 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0dbff-37da-429f-b5c9-5495a28ef39a None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:26.678865 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 632/1274] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:09:26.684083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee8c62-c1b5-483e-ba04-f50ffa8a195b None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:26.684478 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee8c62-c1b5-483e-ba04-f50ffa8a195b None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:26.684647 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee8c62-c1b5-483e-ba04-f50ffa8a195b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:26.700991 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-c5ee8c62-c1b5-483e-ba04-f50ffa8a195b None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:09:26.711140 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-c5ee8c62-c1b5-483e-ba04-f50ffa8a195b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:09:26.767738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 643/1275] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:09:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:09:26.791012 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0dbff-37da-429f-b5c9-5495a28ef39a None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:26.890250 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0dbff-37da-429f-b5c9-5495a28ef39a None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:26.907138 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:26.924633 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02f10d-89b3-45ff-a8d1-f9a872a0a1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:26.925417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02f10d-89b3-45ff-a8d1-f9a872a0a1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:26.925705 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02f10d-89b3-45ff-a8d1-f9a872a0a1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:26.926006 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02f10d-89b3-45ff-a8d1-f9a872a0a1a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:26.936035 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02f10d-89b3-45ff-a8d1-f9a872a0a1a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:09:26.943634 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-dc02f10d-89b3-45ff-a8d1-f9a872a0a1a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:09:26.943634 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:26.943634 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:26.943634 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:26.943634 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:26.943634 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:26.943634 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:26.943634 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:26.943634 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:26.943634 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:26.943634 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:26.943634 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:26.943634 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:09:26.943634 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:09:26.943634 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:09:26.943634 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:09:26.949708 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:09:26.949708 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:09:26.949708 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:09:26.949708 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:09:26.949708 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:26.949708 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:26.949708 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:26.949708 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:26.949708 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:26.949708 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:26.949708 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:26.949708 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:26.949708 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:26.949708 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:26.949708 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:26.949708 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:26.950792 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:26.950792 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:26.950792 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:26.950792 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:26.950792 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:09:26.950792 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:09:26.950792 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:09:26.950792 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:09:26.950792 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:09:26.950792 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:09:26.950792 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:09:26.950792 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:09:26.950792 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 633/1276] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jul 11 11:09:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:09:26.951626 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee8c62-c1b5-483e-ba04-f50ffa8a195b None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:27.032310 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:27.051075 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee8c62-c1b5-483e-ba04-f50ffa8a195b None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:27.086916 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d72109-bf51-4ec7-9820-5ee1b10e9ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:27.087585 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d72109-bf51-4ec7-9820-5ee1b10e9ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:27.087869 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d72109-bf51-4ec7-9820-5ee1b10e9ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:27.088146 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d72109-bf51-4ec7-9820-5ee1b10e9ad9 None admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:27.088898 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d72109-bf51-4ec7-9820-5ee1b10e9ad9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:27.089210 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d72109-bf51-4ec7-9820-5ee1b10e9ad9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:27.090613 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d72109-bf51-4ec7-9820-5ee1b10e9ad9 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:27.099775 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 644/1277] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jul 11 11:09:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:27.105749 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02f10d-89b3-45ff-a8d1-f9a872a0a1a0 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:27.208929 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02f10d-89b3-45ff-a8d1-f9a872a0a1a0 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:27.243103 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528d41e-9492-46ae-89b3-8289bc37fe1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:27.243891 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528d41e-9492-46ae-89b3-8289bc37fe1c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:27.244178 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528d41e-9492-46ae-89b3-8289bc37fe1c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:27.244460 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528d41e-9492-46ae-89b3-8289bc37fe1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:27.256653 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528d41e-9492-46ae-89b3-8289bc37fe1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:27.260072 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528d41e-9492-46ae-89b3-8289bc37fe1c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:27.279378 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-a528d41e-9492-46ae-89b3-8289bc37fe1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:09:27.279378 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:27.279378 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:27.279378 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:27.279378 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:27.279378 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:27.279378 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:27.279378 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:27.279378 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:27.279378 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:27.279378 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:27.279378 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:27.279378 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:09:27.279378 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:09:27.279378 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:09:27.280527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:09:27.280527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:27.280527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:27.280527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:27.280527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:27.280527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:27.280527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:27.280527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:27.280527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:27.280527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:27.280527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:27.280527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:27.280527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:27.280527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:27.280527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:27.280527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:27.280527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:27.281646 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:09:27.281646 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:09:27.281646 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:09:27.281646 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:09:27.281646 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 634/1278] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:09:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:09:27.286571 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d72109-bf51-4ec7-9820-5ee1b10e9ad9 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:27.385352 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d72109-bf51-4ec7-9820-5ee1b10e9ad9 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:27.418681 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50cf25-fa90-4510-9e4e-e34fca2f28e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:27.419327 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50cf25-fa90-4510-9e4e-e34fca2f28e3 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:27.419613 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50cf25-fa90-4510-9e4e-e34fca2f28e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:27.419888 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50cf25-fa90-4510-9e4e-e34fca2f28e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:27.420601 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50cf25-fa90-4510-9e4e-e34fca2f28e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:27.420910 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50cf25-fa90-4510-9e4e-e34fca2f28e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:27.422307 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50cf25-fa90-4510-9e4e-e34fca2f28e3 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:27.434540 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 645/1279] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:09:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:27.440677 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528d41e-9492-46ae-89b3-8289bc37fe1c None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:27.471152 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:27.538191 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528d41e-9492-46ae-89b3-8289bc37fe1c None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:27.572128 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea62b30-f2c4-468b-834e-5f77e9bfcf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:27.572931 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea62b30-f2c4-468b-834e-5f77e9bfcf43 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:27.573215 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea62b30-f2c4-468b-834e-5f77e9bfcf43 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:27.573491 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea62b30-f2c4-468b-834e-5f77e9bfcf43 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:27.581241 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea62b30-f2c4-468b-834e-5f77e9bfcf43 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:27.582715 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea62b30-f2c4-468b-834e-5f77e9bfcf43 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:27.605642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-bea62b30-f2c4-468b-834e-5f77e9bfcf43 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 11:09:27.605642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:27.605642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:27.605642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:27.605642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:27.605642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:27.605642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:27.605642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:27.605642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:27.605642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:27.605642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:27.605642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:27.605642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:09:27.605642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:09:27.605642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:09:27.605642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:09:27.606847 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:27.606847 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:27.606847 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:09:27.606847 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:09:27.606847 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:09:27.606847 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:09:27.606847 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:27.606847 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:27.606847 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:27.606847 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:27.606847 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:27.606847 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:27.606847 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:27.606847 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:27.606847 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:27.606847 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:27.606847 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:27.606847 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:27.608056 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:27.608056 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:27.608056 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:09:27.608056 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:09:27.608056 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:09:27.608056 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:09:27.608056 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:09:27.608056 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:09:27.608056 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 11:09:27.608056 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:09:27.608056 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 635/1280] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:09:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:09:27.614341 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50cf25-fa90-4510-9e4e-e34fca2f28e3 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:27.618202 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:27.713878 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50cf25-fa90-4510-9e4e-e34fca2f28e3 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:27.747498 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b2786-686c-4259-b432-40a8a8777f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:27.748096 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b2786-686c-4259-b432-40a8a8777f30 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:27.748378 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b2786-686c-4259-b432-40a8a8777f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:27.748652 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b2786-686c-4259-b432-40a8a8777f30 None admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:27.749475 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b2786-686c-4259-b432-40a8a8777f30 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:27.749805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b2786-686c-4259-b432-40a8a8777f30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:27.751801 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b2786-686c-4259-b432-40a8a8777f30 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:27.769596 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 646/1281] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Jul 11 11:09:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:27.775221 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea62b30-f2c4-468b-834e-5f77e9bfcf43 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:27.865215 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:27.874196 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea62b30-f2c4-468b-834e-5f77e9bfcf43 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:27.906160 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb4959-7ce0-40ba-980d-e01d32dde674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:27.906806 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb4959-7ce0-40ba-980d-e01d32dde674 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:27.907092 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb4959-7ce0-40ba-980d-e01d32dde674 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:27.907573 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb4959-7ce0-40ba-980d-e01d32dde674 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:27.973595 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb4959-7ce0-40ba-980d-e01d32dde674 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:27.975085 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb4959-7ce0-40ba-980d-e01d32dde674 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:28.062148 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:28.072524 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 636/1282] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jul 11 11:09:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 11:09:28.078551 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b2786-686c-4259-b432-40a8a8777f30 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:28.139585 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:28.178387 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b2786-686c-4259-b432-40a8a8777f30 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:28.210379 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616298e-2d6f-4835-a90f-a6af05dbf641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:28.211169 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616298e-2d6f-4835-a90f-a6af05dbf641 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:28.211456 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616298e-2d6f-4835-a90f-a6af05dbf641 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:28.211736 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616298e-2d6f-4835-a90f-a6af05dbf641 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:28.222693 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616298e-2d6f-4835-a90f-a6af05dbf641 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:28.224196 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616298e-2d6f-4835-a90f-a6af05dbf641 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:28.250447 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-2616298e-2d6f-4835-a90f-a6af05dbf641 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:09:28.250447 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:28.250447 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:28.250447 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:28.250447 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:28.250447 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:28.250447 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:28.250447 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:28.250447 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:28.250447 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:28.250447 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:28.250447 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:28.250447 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:09:28.250447 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:09:28.250447 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:09:28.251633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:09:28.251633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:28.251633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:28.251633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:28.251633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:28.251633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:28.251633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:28.251633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:28.251633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:28.251633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:28.251633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:28.251633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:28.251633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:28.251633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:28.251633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:28.251633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:28.251633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:28.252792 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:09:28.252792 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:09:28.252792 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:09:28.252792 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:09:28.252792 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 647/1283] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:09:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:09:28.257601 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb4959-7ce0-40ba-980d-e01d32dde674 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:28.354847 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb4959-7ce0-40ba-980d-e01d32dde674 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:28.387475 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365e9e9-a16a-4b4b-8c95-377b23de5a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:28.388132 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365e9e9-a16a-4b4b-8c95-377b23de5a5b None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:28.388414 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365e9e9-a16a-4b4b-8c95-377b23de5a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:28.388687 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365e9e9-a16a-4b4b-8c95-377b23de5a5b None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:28.389475 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365e9e9-a16a-4b4b-8c95-377b23de5a5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:28.389810 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365e9e9-a16a-4b4b-8c95-377b23de5a5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:28.391227 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365e9e9-a16a-4b4b-8c95-377b23de5a5b None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:28.402566 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 637/1284] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jul 11 11:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:28.408744 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616298e-2d6f-4835-a90f-a6af05dbf641 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:28.508239 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616298e-2d6f-4835-a90f-a6af05dbf641 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:28.522241 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:28.542231 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3786f4-c350-4004-abec-4b98ed23ae56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:28.543053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3786f4-c350-4004-abec-4b98ed23ae56 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:28.543338 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3786f4-c350-4004-abec-4b98ed23ae56 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:28.543614 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3786f4-c350-4004-abec-4b98ed23ae56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:28.550492 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3786f4-c350-4004-abec-4b98ed23ae56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:28.551937 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3786f4-c350-4004-abec-4b98ed23ae56 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:28.566288 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application [None req-6a3786f4-c350-4004-abec-4b98ed23ae56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:09:28.566288 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:28.566288 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:28.566288 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:28.566288 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:28.566288 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:28.566288 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:28.566288 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:28.566288 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:28.566288 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:28.566288 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:28.566288 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:28.566288 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:09:28.566288 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:09:28.566288 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:09:28.567199 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:09:28.567199 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:28.567199 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:28.567199 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:28.567199 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:28.567199 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:28.567199 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:28.567199 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:28.567199 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:28.567199 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:28.567199 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:28.567199 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:28.567199 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:28.567199 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:28.567199 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:28.567199 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:28.567199 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:28.568590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:09:28.568590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:09:28.568590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:09:28.568590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:09:28.568590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:09:28.568590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:09:28.568590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:09:28.568590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: ERROR keystone.server.flask.application Jul 11 11:09:28.568590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 648/1285] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jul 11 11:09:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:09:28.573428 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365e9e9-a16a-4b4b-8c95-377b23de5a5b None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:28.623423 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:28.672686 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365e9e9-a16a-4b4b-8c95-377b23de5a5b None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:28.705302 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec40b4-236b-43e5-8d6b-3bcf4f1713d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:28.705976 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec40b4-236b-43e5-8d6b-3bcf4f1713d6 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:28.706261 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec40b4-236b-43e5-8d6b-3bcf4f1713d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:28.706536 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec40b4-236b-43e5-8d6b-3bcf4f1713d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:28.707310 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec40b4-236b-43e5-8d6b-3bcf4f1713d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:28.707619 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec40b4-236b-43e5-8d6b-3bcf4f1713d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:28.709123 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec40b4-236b-43e5-8d6b-3bcf4f1713d6 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:28.720778 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 638/1286] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jul 11 11:09:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:28.726933 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3786f4-c350-4004-abec-4b98ed23ae56 None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:28.830424 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3786f4-c350-4004-abec-4b98ed23ae56 None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:28.864746 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc88b3a-55d2-400a-80af-cd773026bc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:28.865412 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc88b3a-55d2-400a-80af-cd773026bc11 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:28.865727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc88b3a-55d2-400a-80af-cd773026bc11 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:28.866039 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc88b3a-55d2-400a-80af-cd773026bc11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:28.866867 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc88b3a-55d2-400a-80af-cd773026bc11 None admin] RBAC: Adding query filter params (role.id=736e70deba004b9289c2fed43eb107f7, scope.project.id=38ed7416526e473b816330e24acf7a04, user.id=12b7c9264495433985185332778dbc8c) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:28.867182 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc88b3a-55d2-400a-80af-cd773026bc11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:28.868603 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc88b3a-55d2-400a-80af-cd773026bc11 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:28.874491 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 649/1287] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jul 11 11:09:28 2022] GET /identity/v3/role_assignments?user.id=12b7c9264495433985185332778dbc8c&scope.project.id=38ed7416526e473b816330e24acf7a04&role.id=736e70deba004b9289c2fed43eb107f7 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:30.906075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518249d-a55a-44b0-b218-3e257018ef39 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:30.906598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518249d-a55a-44b0-b218-3e257018ef39 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:30.906689 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518249d-a55a-44b0-b218-3e257018ef39 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:30.908246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 639/1288] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:09:30.913219 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633cebd-a308-49c9-9cc2-aa921971b73a None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:30.913622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633cebd-a308-49c9-9cc2-aa921971b73a None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:30.913782 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633cebd-a308-49c9-9cc2-aa921971b73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:30.930703 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-3633cebd-a308-49c9-9cc2-aa921971b73a None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:09:30.931924 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-3633cebd-a308-49c9-9cc2-aa921971b73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:09:30.961344 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:30.996638 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 650/1289] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:09:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:09:31.018983 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518249d-a55a-44b0-b218-3e257018ef39 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:31.118476 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518249d-a55a-44b0-b218-3e257018ef39 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:31.129183 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:31.151822 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750794a-3e2d-4604-a6c2-2344b3f06964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:31.152612 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750794a-3e2d-4604-a6c2-2344b3f06964 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:31.152900 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750794a-3e2d-4604-a6c2-2344b3f06964 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:31.153193 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750794a-3e2d-4604-a6c2-2344b3f06964 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:31.153858 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7750794a-3e2d-4604-a6c2-2344b3f06964 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:31.155305 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7750794a-3e2d-4604-a6c2-2344b3f06964 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:31.167872 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-7750794a-3e2d-4604-a6c2-2344b3f06964 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 11:09:31.167872 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:31.167872 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:09:31.167872 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:09:31.167872 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:09:31.167872 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:09:31.167872 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:09:31.167872 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:09:31.167872 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 11:09:31.167872 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:09:31.167872 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:09:31.167872 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:09:31.167872 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:31.167872 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:31.167872 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:31.167872 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:31.167872 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:31.173665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:31.173665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:31.173665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:31.173665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:31.173665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:31.173665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:31.173665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:09:31.173665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:09:31.173665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:09:31.173665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:09:31.173665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:31.173665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:31.173665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:31.173665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:31.173665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:31.173665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:31.174701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:31.174701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:31.174701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:31.174701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:31.174701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:31.174701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:31.174701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:31.174701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:31.174701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:31.174701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:31.174701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:09:31.174701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:09:31.174701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 11:09:31.174701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:09:31.174701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 640/1290] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Jul 11 11:09:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:09:31.176049 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633cebd-a308-49c9-9cc2-aa921971b73a None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:31.273526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633cebd-a308-49c9-9cc2-aa921971b73a None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:31.307393 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144cf79-8578-4418-b53f-885a42f0e11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:31.308053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144cf79-8578-4418-b53f-885a42f0e11c None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:31.308345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144cf79-8578-4418-b53f-885a42f0e11c None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:31.308890 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144cf79-8578-4418-b53f-885a42f0e11c None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:31.309565 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144cf79-8578-4418-b53f-885a42f0e11c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:31.309902 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144cf79-8578-4418-b53f-885a42f0e11c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:31.311263 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144cf79-8578-4418-b53f-885a42f0e11c None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:31.318423 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 651/1291] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Jul 11 11:09:31 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:31.324152 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750794a-3e2d-4604-a6c2-2344b3f06964 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:31.430464 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750794a-3e2d-4604-a6c2-2344b3f06964 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:31.463269 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193a01c-4b01-4175-89d1-9d0c2b59b704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:31.463933 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193a01c-4b01-4175-89d1-9d0c2b59b704 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:31.464214 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193a01c-4b01-4175-89d1-9d0c2b59b704 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:31.464492 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193a01c-4b01-4175-89d1-9d0c2b59b704 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:31.465190 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193a01c-4b01-4175-89d1-9d0c2b59b704 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:31.465499 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193a01c-4b01-4175-89d1-9d0c2b59b704 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:31.466907 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193a01c-4b01-4175-89d1-9d0c2b59b704 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:31.471971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 641/1292] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Jul 11 11:09:31 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:33.471991 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e474876-da81-4454-bf5b-421464c3f4d1 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:33.472555 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e474876-da81-4454-bf5b-421464c3f4d1 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:33.472555 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e474876-da81-4454-bf5b-421464c3f4d1 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:33.473995 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 652/1293] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:09:33.479004 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9a61c-1b60-4937-af37-2560895fc18a None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:33.479480 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9a61c-1b60-4937-af37-2560895fc18a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:33.479590 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9a61c-1b60-4937-af37-2560895fc18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:33.496772 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-1ed9a61c-1b60-4937-af37-2560895fc18a None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:09:33.498033 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1ed9a61c-1b60-4937-af37-2560895fc18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:09:33.526256 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:33.562967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 642/1294] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:09:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:09:33.585246 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e474876-da81-4454-bf5b-421464c3f4d1 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:33.616663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:33.686015 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e474876-da81-4454-bf5b-421464c3f4d1 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:33.719308 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843ba8b-e342-4437-8e71-498029772836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:33.720555 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843ba8b-e342-4437-8e71-498029772836 None admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:33.720843 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843ba8b-e342-4437-8e71-498029772836 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:33.721117 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843ba8b-e342-4437-8e71-498029772836 None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:33.721871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843ba8b-e342-4437-8e71-498029772836 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:33.723295 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843ba8b-e342-4437-8e71-498029772836 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:33.928719 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 653/1295] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Jul 11 11:09:33 2022] POST /identity/v3/services => generated 246 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:09:35.930691 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45499d-24e0-41ec-8a4d-df627aeac5ed None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:35.931246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45499d-24e0-41ec-8a4d-df627aeac5ed None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:35.931246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45499d-24e0-41ec-8a4d-df627aeac5ed None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:35.932642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 643/1296] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:09:35.938785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddca2ab-06d4-4c5e-a0a9-fda4c7e0f9f5 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:35.939327 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddca2ab-06d4-4c5e-a0a9-fda4c7e0f9f5 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:35.939327 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddca2ab-06d4-4c5e-a0a9-fda4c7e0f9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:35.956576 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-9ddca2ab-06d4-4c5e-a0a9-fda4c7e0f9f5 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:09:35.957828 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-9ddca2ab-06d4-4c5e-a0a9-fda4c7e0f9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:09:36.029868 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 654/1297] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:09:35 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:09:36.053376 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45499d-24e0-41ec-8a4d-df627aeac5ed None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:36.152020 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45499d-24e0-41ec-8a4d-df627aeac5ed None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:36.184696 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c8d49-17bf-4a65-8d6b-0d0ddc6992b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:36.185483 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c8d49-17bf-4a65-8d6b-0d0ddc6992b2 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:36.185786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c8d49-17bf-4a65-8d6b-0d0ddc6992b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:36.186070 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c8d49-17bf-4a65-8d6b-0d0ddc6992b2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:36.186711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c8d49-17bf-4a65-8d6b-0d0ddc6992b2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:36.188060 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c8d49-17bf-4a65-8d6b-0d0ddc6992b2 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:36.200379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-a04c8d49-17bf-4a65-8d6b-0d0ddc6992b2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 11:09:36.200379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:36.200379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:09:36.200379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:09:36.200379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:09:36.200379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:09:36.200379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:09:36.200379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:09:36.200379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 11:09:36.200379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:09:36.200379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:09:36.200379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:09:36.200379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:36.200379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:36.200379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:36.200379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:36.200379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:36.201482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:36.201482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:36.201482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:36.201482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:36.201482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:36.201482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:36.201482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:09:36.201482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:09:36.201482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:09:36.201482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:09:36.201482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:36.201482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:36.201482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:36.201482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:36.201482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:36.201482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:36.202448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:36.202448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:36.202448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:36.202448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:36.202448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:36.202448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:36.202448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:36.202448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:36.202448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:36.202448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:36.202448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:09:36.202448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:09:36.202448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 11:09:36.202448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:09:36.202448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 644/1298] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Jul 11 11:09:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:09:36.207669 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddca2ab-06d4-4c5e-a0a9-fda4c7e0f9f5 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:36.226806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:36.305310 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddca2ab-06d4-4c5e-a0a9-fda4c7e0f9f5 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:36.339234 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059cc3e-a0cc-4177-ab1e-35ad946a1eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:36.339892 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059cc3e-a0cc-4177-ab1e-35ad946a1eca None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:36.340179 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059cc3e-a0cc-4177-ab1e-35ad946a1eca None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:36.340457 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059cc3e-a0cc-4177-ab1e-35ad946a1eca None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:36.341158 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059cc3e-a0cc-4177-ab1e-35ad946a1eca None admin] RBAC: Adding query filter params (name=placement) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:36.341467 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059cc3e-a0cc-4177-ab1e-35ad946a1eca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:36.342876 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059cc3e-a0cc-4177-ab1e-35ad946a1eca None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:36.348445 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 655/1299] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Jul 11 11:09:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:36.354467 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c8d49-17bf-4a65-8d6b-0d0ddc6992b2 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:36.385250 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:36.450531 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c8d49-17bf-4a65-8d6b-0d0ddc6992b2 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:36.485028 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1bf0f8-c26f-4653-9f93-34acc30b66e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:36.486478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1bf0f8-c26f-4653-9f93-34acc30b66e2 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:36.486761 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1bf0f8-c26f-4653-9f93-34acc30b66e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:36.487036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1bf0f8-c26f-4653-9f93-34acc30b66e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:36.487823 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1bf0f8-c26f-4653-9f93-34acc30b66e2 None admin] RBAC: Adding query filter params (interface=public, service_id=625bd743234a4fabbc7663e043db2507, region_id=RegionOne) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:36.488133 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1bf0f8-c26f-4653-9f93-34acc30b66e2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:36.489504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1bf0f8-c26f-4653-9f93-34acc30b66e2 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:36.495018 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 645/1300] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Jul 11 11:09:36 2022] GET /identity/v3/endpoints?service_id=625bd743234a4fabbc7663e043db2507&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:36.501219 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059cc3e-a0cc-4177-ab1e-35ad946a1eca None admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:36.582015 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:36.600020 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059cc3e-a0cc-4177-ab1e-35ad946a1eca None admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:36.636431 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77174c88-25f5-4819-acee-946415a2aa79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:36.637121 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77174c88-25f5-4819-acee-946415a2aa79 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:36.637409 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77174c88-25f5-4819-acee-946415a2aa79 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:36.637691 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77174c88-25f5-4819-acee-946415a2aa79 None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:36.638423 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77174c88-25f5-4819-acee-946415a2aa79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:36.639835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77174c88-25f5-4819-acee-946415a2aa79 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:36.647915 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 656/1301] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Jul 11 11:09:36 2022] GET /identity/v3/services => generated 2191 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:09:38.697479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f06bb-ccc9-419f-bf9b-8ec2c831a89b None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:38.698033 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f06bb-ccc9-419f-bf9b-8ec2c831a89b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:38.698149 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f06bb-ccc9-419f-bf9b-8ec2c831a89b None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:38.699465 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 646/1302] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:09:38.704640 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdad1f3-dbba-4e97-9b41-e9ac60f6c25d None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:38.705077 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdad1f3-dbba-4e97-9b41-e9ac60f6c25d None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:38.705182 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdad1f3-dbba-4e97-9b41-e9ac60f6c25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:38.721933 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-0cdad1f3-dbba-4e97-9b41-e9ac60f6c25d None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:09:38.726417 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-0cdad1f3-dbba-4e97-9b41-e9ac60f6c25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:09:38.789225 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 657/1303] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:09:38 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 11:09:38.816512 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f06bb-ccc9-419f-bf9b-8ec2c831a89b None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:38.918622 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:38.926341 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f06bb-ccc9-419f-bf9b-8ec2c831a89b None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:38.960326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e47094-c922-43c4-8e05-3a301583c75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:38.961047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e47094-c922-43c4-8e05-3a301583c75d None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:38.961327 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e47094-c922-43c4-8e05-3a301583c75d None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:38.961601 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e47094-c922-43c4-8e05-3a301583c75d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:38.962277 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e47094-c922-43c4-8e05-3a301583c75d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:38.963631 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e47094-c922-43c4-8e05-3a301583c75d None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:38.978776 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-b8e47094-c922-43c4-8e05-3a301583c75d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 11:09:38.978776 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:38.978776 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:09:38.978776 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:09:38.978776 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:09:38.978776 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:09:38.978776 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:09:38.978776 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:09:38.978776 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 11:09:38.978776 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:09:38.978776 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:09:38.978776 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:09:38.978776 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:09:38.978776 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:09:38.978776 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:09:38.978776 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:09:38.978776 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:09:38.980024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:09:38.980024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:09:38.980024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:09:38.980024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:09:38.980024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:09:38.980024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:09:38.980024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:09:38.980024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:09:38.980024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:09:38.980024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:09:38.980024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:09:38.980024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:09:38.980024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:09:38.980024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:09:38.980024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:09:38.980024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:09:38.981084 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:09:38.981084 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Jul 11 11:09:38.981084 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:09:38.981084 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:09:38.981084 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:09:38.981084 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:09:38.981084 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:09:38.981084 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:09:38.981084 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:09:38.981084 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:09:38.981084 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:09:38.981084 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:09:38.981084 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 11:09:38.981084 dv-cinder-848429-2-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Jul 11 11:09:38.981084 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 647/1304] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Jul 11 11:09:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:09:38.987029 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdad1f3-dbba-4e97-9b41-e9ac60f6c25d None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:39.073275 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:39.098017 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdad1f3-dbba-4e97-9b41-e9ac60f6c25d None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:39.133510 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3125c1-3083-4dcc-a171-76c9c82f3784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:39.134212 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3125c1-3083-4dcc-a171-76c9c82f3784 None admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:39.134499 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3125c1-3083-4dcc-a171-76c9c82f3784 None admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:39.134777 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3125c1-3083-4dcc-a171-76c9c82f3784 None admin] PATH_INFO: `/v3/services` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:39.135486 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3125c1-3083-4dcc-a171-76c9c82f3784 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:09:39.135796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3125c1-3083-4dcc-a171-76c9c82f3784 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:39.137262 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3125c1-3083-4dcc-a171-76c9c82f3784 None admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:39.143272 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 658/1305] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Jul 11 11:09:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:09:39.149369 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e47094-c922-43c4-8e05-3a301583c75d None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:09:39.267739 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e47094-c922-43c4-8e05-3a301583c75d None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:09:39.302416 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856fedf-20c2-4142-9ca5-526d951fc5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:09:39.303326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856fedf-20c2-4142-9ca5-526d951fc5b2 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:09:39.303610 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856fedf-20c2-4142-9ca5-526d951fc5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:09:39.303883 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856fedf-20c2-4142-9ca5-526d951fc5b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:09:39.305200 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856fedf-20c2-4142-9ca5-526d951fc5b2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:09:39.306670 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856fedf-20c2-4142-9ca5-526d951fc5b2 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:09:39.396417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 648/1306] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Jul 11 11:09:39 2022] POST /identity/v3/endpoints => generated 331 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:09:49.139409 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=30 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:09:49.391427 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:17:12.445679 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56525ef3-6341-4fd6-9ebf-176c2b37d802 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:12.445679 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56525ef3-6341-4fd6-9ebf-176c2b37d802 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:12.445679 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56525ef3-6341-4fd6-9ebf-176c2b37d802 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:12.445679 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 659/1307] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:17:12.447598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914d93a-0719-4614-bf0f-2adc2a672ed5 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:12.447598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914d93a-0719-4614-bf0f-2adc2a672ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:12.447598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914d93a-0719-4614-bf0f-2adc2a672ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:12.447598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-2914d93a-0719-4614-bf0f-2adc2a672ed5 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:17:12.447598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2914d93a-0719-4614-bf0f-2adc2a672ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:12.558431 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 649/1308] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:17:12.624445 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce44f6-f6d0-4cad-bfc3-2fc56e276a9e None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:12.624805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce44f6-f6d0-4cad-bfc3-2fc56e276a9e None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:12.625153 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce44f6-f6d0-4cad-bfc3-2fc56e276a9e None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:12.626788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 660/1309] 10.222.0.23 () {54 vars in 964 bytes} [Mon Jul 11 11:17:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:17:12.634041 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfee09-0f46-4f4d-bfe6-2ecdab0ba003 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:12.634334 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfee09-0f46-4f4d-bfe6-2ecdab0ba003 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:12.634622 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfee09-0f46-4f4d-bfe6-2ecdab0ba003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:12.795139 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-d6dfee09-0f46-4f4d-bfe6-2ecdab0ba003 None None] MFA Rules not processed for user `79b8c08920b0417097bebd23344ffe64`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:17:12.796656 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d6dfee09-0f46-4f4d-bfe6-2ecdab0ba003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:12.819969 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:17:12.883104 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 650/1310] 10.222.0.23 () {58 vars in 1061 bytes} [Mon Jul 11 11:17:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:17:12.892984 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce44f6-f6d0-4cad-bfc3-2fc56e276a9e None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:17:12.894839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-05ce44f6-f6d0-4cad-bfc3-2fc56e276a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:13.006185 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce44f6-f6d0-4cad-bfc3-2fc56e276a9e None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:17:13.082479 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c4ccc-9bf9-4b35-8e6a-310d0d283114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:17:13.083131 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c4ccc-9bf9-4b35-8e6a-310d0d283114 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:13.083411 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c4ccc-9bf9-4b35-8e6a-310d0d283114 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:13.083690 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c4ccc-9bf9-4b35-8e6a-310d0d283114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:13.085324 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-5e6c4ccc-9bf9-4b35-8e6a-310d0d283114 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:13.141646 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:17:13.196177 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c4ccc-9bf9-4b35-8e6a-310d0d283114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:17:13.197614 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c4ccc-9bf9-4b35-8e6a-310d0d283114 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:17:13.217540 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 661/1311] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:17:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:17:15.576916 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f4c5c-8c1e-4b65-81ea-34a42037f8b8 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:15.577480 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f4c5c-8c1e-4b65-81ea-34a42037f8b8 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:15.577480 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f4c5c-8c1e-4b65-81ea-34a42037f8b8 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:15.579044 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 651/1312] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:17:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:17:15.584050 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07866f99-aaca-4b9c-8570-52c130a01f67 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:15.584442 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07866f99-aaca-4b9c-8570-52c130a01f67 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:15.584666 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07866f99-aaca-4b9c-8570-52c130a01f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:15.659499 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-07866f99-aaca-4b9c-8570-52c130a01f67 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:17:15.660751 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-07866f99-aaca-4b9c-8570-52c130a01f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:15.771413 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 662/1313] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:17:15.823587 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c1cb4-9d3c-41cc-90c7-b038dc6fd029 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:15.823956 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c1cb4-9d3c-41cc-90c7-b038dc6fd029 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:15.824323 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c1cb4-9d3c-41cc-90c7-b038dc6fd029 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:15.826018 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 652/1314] 10.222.0.23 () {54 vars in 964 bytes} [Mon Jul 11 11:17:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:17:15.832501 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e0dc1-d8a8-40a3-bbdd-b2ed6d70a732 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:15.832856 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e0dc1-d8a8-40a3-bbdd-b2ed6d70a732 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:15.833140 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e0dc1-d8a8-40a3-bbdd-b2ed6d70a732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:15.844513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:17:15.925851 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-328e0dc1-d8a8-40a3-bbdd-b2ed6d70a732 None None] MFA Rules not processed for user `79b8c08920b0417097bebd23344ffe64`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:17:15.927105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-328e0dc1-d8a8-40a3-bbdd-b2ed6d70a732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:16.006774 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 663/1315] 10.222.0.23 () {58 vars in 1061 bytes} [Mon Jul 11 11:17:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:17:16.015947 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c1cb4-9d3c-41cc-90c7-b038dc6fd029 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:17:16.017490 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e22c1cb4-9d3c-41cc-90c7-b038dc6fd029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:16.125355 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c1cb4-9d3c-41cc-90c7-b038dc6fd029 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:17:16.195342 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:17:16.198284 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f70427-2fed-42fa-98c2-12614b89707d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:17:16.198944 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f70427-2fed-42fa-98c2-12614b89707d service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:16.199224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f70427-2fed-42fa-98c2-12614b89707d service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:16.199498 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f70427-2fed-42fa-98c2-12614b89707d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:16.201224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-47f70427-2fed-42fa-98c2-12614b89707d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:16.310650 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f70427-2fed-42fa-98c2-12614b89707d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:17:16.312079 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f70427-2fed-42fa-98c2-12614b89707d service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:17:16.330535 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 653/1316] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:17:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:17:19.020290 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637138ad-611e-42d5-a241-3a6489e0baaf None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:19.020794 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637138ad-611e-42d5-a241-3a6489e0baaf None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:19.020794 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637138ad-611e-42d5-a241-3a6489e0baaf None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:19.022172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 664/1317] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:17:19.027284 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3aaa0-331d-4797-a80c-7e31b84ddf84 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:19.027690 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3aaa0-331d-4797-a80c-7e31b84ddf84 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:19.027870 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3aaa0-331d-4797-a80c-7e31b84ddf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:19.092354 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-2ab3aaa0-331d-4797-a80c-7e31b84ddf84 None None] MFA Rules not processed for user `ea2579845baa4661a50c96046959ebc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:17:19.093543 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2ab3aaa0-331d-4797-a80c-7e31b84ddf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:19.143587 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:17:19.187079 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 654/1318] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:17:19 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:17:19.225951 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637138ad-611e-42d5-a241-3a6489e0baaf None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:17:19.227987 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-637138ad-611e-42d5-a241-3a6489e0baaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:19.328671 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637138ad-611e-42d5-a241-3a6489e0baaf None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:17:19.331477 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:17:19.400210 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a5c64-c259-46c2-bb8d-467a1e2a1409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:17:19.400847 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a5c64-c259-46c2-bb8d-467a1e2a1409 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:19.401132 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a5c64-c259-46c2-bb8d-467a1e2a1409 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:19.401410 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a5c64-c259-46c2-bb8d-467a1e2a1409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:19.403605 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-4e1a5c64-c259-46c2-bb8d-467a1e2a1409 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:19.507716 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a5c64-c259-46c2-bb8d-467a1e2a1409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:17:19.509135 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a5c64-c259-46c2-bb8d-467a1e2a1409 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:17:19.527087 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 665/1319] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:17:19 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:17:22.474629 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95d2d9-4566-49f3-aee2-c31f71f0eb8c None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:22.475165 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95d2d9-4566-49f3-aee2-c31f71f0eb8c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:22.475165 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95d2d9-4566-49f3-aee2-c31f71f0eb8c None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:22.476561 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 655/1320] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:17:22.482476 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e899bb-b608-4ff0-ae26-c949fd19b55b None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:22.482893 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e899bb-b608-4ff0-ae26-c949fd19b55b None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:22.483032 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e899bb-b608-4ff0-ae26-c949fd19b55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:22.521144 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:17:22.546645 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-40e899bb-b608-4ff0-ae26-c949fd19b55b None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:17:22.547841 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-40e899bb-b608-4ff0-ae26-c949fd19b55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:22.644746 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 666/1321] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:17:22 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:17:22.685291 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95d2d9-4566-49f3-aee2-c31f71f0eb8c None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:17:22.686990 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3c95d2d9-4566-49f3-aee2-c31f71f0eb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:22.791537 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95d2d9-4566-49f3-aee2-c31f71f0eb8c None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:17:22.862767 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350f610-c408-4a3b-a485-cb95b12fecbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:17:22.863428 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350f610-c408-4a3b-a485-cb95b12fecbe service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:22.863745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350f610-c408-4a3b-a485-cb95b12fecbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:22.864022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350f610-c408-4a3b-a485-cb95b12fecbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:22.865674 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c350f610-c408-4a3b-a485-cb95b12fecbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:22.873028 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:17:22.974363 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350f610-c408-4a3b-a485-cb95b12fecbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:17:22.975803 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350f610-c408-4a3b-a485-cb95b12fecbe service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:17:22.993590 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 656/1322] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:17:22 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:17:26.128404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43143fe-a1f7-4052-841f-02fe9fd2ce35 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:26.128943 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43143fe-a1f7-4052-841f-02fe9fd2ce35 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:26.128943 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43143fe-a1f7-4052-841f-02fe9fd2ce35 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:26.130403 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 667/1323] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:17:26.135634 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39be4d-82d9-4162-92d2-86f6fe33e0c0 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:26.136040 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39be4d-82d9-4162-92d2-86f6fe33e0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:26.136188 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39be4d-82d9-4162-92d2-86f6fe33e0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:26.202136 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-8b39be4d-82d9-4162-92d2-86f6fe33e0c0 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:17:26.203360 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8b39be4d-82d9-4162-92d2-86f6fe33e0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:26.264139 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:17:26.310648 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 657/1324] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:17:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:17:26.348539 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43143fe-a1f7-4052-841f-02fe9fd2ce35 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:17:26.350130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-a43143fe-a1f7-4052-841f-02fe9fd2ce35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:26.462524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43143fe-a1f7-4052-841f-02fe9fd2ce35 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:17:26.476890 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:17:26.537890 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd93c2-1d25-49b7-9fea-d30910f9f5a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:17:26.538543 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd93c2-1d25-49b7-9fea-d30910f9f5a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:26.538829 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd93c2-1d25-49b7-9fea-d30910f9f5a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:26.539112 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd93c2-1d25-49b7-9fea-d30910f9f5a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:26.540766 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-e4cd93c2-1d25-49b7-9fea-d30910f9f5a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:26.652110 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd93c2-1d25-49b7-9fea-d30910f9f5a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:17:26.654888 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd93c2-1d25-49b7-9fea-d30910f9f5a7 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:17:26.673144 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 668/1325] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:17:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:17:28.766444 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de410ce2-01e7-46ab-b380-2debb13c0a97 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:28.766916 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de410ce2-01e7-46ab-b380-2debb13c0a97 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:28.767008 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de410ce2-01e7-46ab-b380-2debb13c0a97 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:28.768397 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 658/1326] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:17:28.773927 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502a4b9-f9b7-4cd8-bb0e-69ea55c58553 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:28.774365 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502a4b9-f9b7-4cd8-bb0e-69ea55c58553 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:28.774502 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502a4b9-f9b7-4cd8-bb0e-69ea55c58553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:28.826824 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:17:28.845308 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-3502a4b9-f9b7-4cd8-bb0e-69ea55c58553 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:17:28.846552 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-3502a4b9-f9b7-4cd8-bb0e-69ea55c58553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:28.948423 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 669/1327] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:17:28.984868 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de410ce2-01e7-46ab-b380-2debb13c0a97 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:17:28.986453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-de410ce2-01e7-46ab-b380-2debb13c0a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:29.090889 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de410ce2-01e7-46ab-b380-2debb13c0a97 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:17:29.170275 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409f906-f609-403a-b857-d7f42d096e15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:17:29.170944 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409f906-f609-403a-b857-d7f42d096e15 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:29.171229 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409f906-f609-403a-b857-d7f42d096e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:29.171504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409f906-f609-403a-b857-d7f42d096e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:29.173270 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7409f906-f609-403a-b857-d7f42d096e15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:29.191456 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:17:29.285367 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7409f906-f609-403a-b857-d7f42d096e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:17:29.286846 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7409f906-f609-403a-b857-d7f42d096e15 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:17:29.306547 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 659/1328] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:17:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:17:31.383658 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ad72b-1e86-4b14-811a-dd50e759c82d None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:31.384183 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ad72b-1e86-4b14-811a-dd50e759c82d None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:31.384383 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ad72b-1e86-4b14-811a-dd50e759c82d None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:31.385639 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 670/1329] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:17:31.391175 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96810981-47ef-4dc7-914d-de10711b4afd None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:31.391581 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96810981-47ef-4dc7-914d-de10711b4afd None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:31.391866 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96810981-47ef-4dc7-914d-de10711b4afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:31.460310 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-96810981-47ef-4dc7-914d-de10711b4afd None None] MFA Rules not processed for user `ea2579845baa4661a50c96046959ebc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:17:31.461521 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-96810981-47ef-4dc7-914d-de10711b4afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:31.535000 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:17:31.569002 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 660/1330] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:17:31 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:17:31.607027 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ad72b-1e86-4b14-811a-dd50e759c82d None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:17:31.608558 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-b05ad72b-1e86-4b14-811a-dd50e759c82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:31.711264 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ad72b-1e86-4b14-811a-dd50e759c82d None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:17:31.732091 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:17:31.790315 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693703b7-9be2-491d-8eef-44f188bc73fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:17:31.790966 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693703b7-9be2-491d-8eef-44f188bc73fe service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:31.791251 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693703b7-9be2-491d-8eef-44f188bc73fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:31.791532 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693703b7-9be2-491d-8eef-44f188bc73fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:31.793172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-693703b7-9be2-491d-8eef-44f188bc73fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:31.913167 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693703b7-9be2-491d-8eef-44f188bc73fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:17:31.914672 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693703b7-9be2-491d-8eef-44f188bc73fe service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:17:31.937011 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 671/1331] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:17:31 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:17:34.446631 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318df903-4c9d-4efd-bf19-e4573e0301d4 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:34.447142 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318df903-4c9d-4efd-bf19-e4573e0301d4 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:34.447236 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318df903-4c9d-4efd-bf19-e4573e0301d4 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:34.448565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 661/1332] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:17:34.454571 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a4452-bf54-414b-bfb3-a3d4ac9b1adc None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:34.455052 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a4452-bf54-414b-bfb3-a3d4ac9b1adc None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:34.455156 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a4452-bf54-414b-bfb3-a3d4ac9b1adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:34.517008 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:17:34.519797 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-f51a4452-bf54-414b-bfb3-a3d4ac9b1adc None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:17:34.520995 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-f51a4452-bf54-414b-bfb3-a3d4ac9b1adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:34.615281 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 672/1333] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:17:34.651371 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318df903-4c9d-4efd-bf19-e4573e0301d4 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:17:34.653028 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-318df903-4c9d-4efd-bf19-e4573e0301d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:34.755973 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318df903-4c9d-4efd-bf19-e4573e0301d4 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:17:34.829972 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1084ba-8711-4dc7-95e1-738effed495c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:17:34.830689 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1084ba-8711-4dc7-95e1-738effed495c service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:34.830971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1084ba-8711-4dc7-95e1-738effed495c service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:34.831249 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1084ba-8711-4dc7-95e1-738effed495c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:34.832943 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9d1084ba-8711-4dc7-95e1-738effed495c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:34.859415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:17:34.939198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1084ba-8711-4dc7-95e1-738effed495c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:17:34.940621 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1084ba-8711-4dc7-95e1-738effed495c service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:17:34.958451 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 662/1334] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:17:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:17:37.008375 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee71f0e-9ca9-4883-8e28-5298de900c4e None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:37.008931 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee71f0e-9ca9-4883-8e28-5298de900c4e None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:37.008931 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee71f0e-9ca9-4883-8e28-5298de900c4e None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:37.010341 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 673/1335] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:17:37.015652 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da9bc0-524f-4ec3-a832-463c09a1e90a None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:37.016070 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da9bc0-524f-4ec3-a832-463c09a1e90a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:37.016162 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da9bc0-524f-4ec3-a832-463c09a1e90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:37.080011 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-92da9bc0-524f-4ec3-a832-463c09a1e90a None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:17:37.081219 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-92da9bc0-524f-4ec3-a832-463c09a1e90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:37.153783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:17:37.175605 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 663/1336] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:17:37.215967 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee71f0e-9ca9-4883-8e28-5298de900c4e None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:17:37.217678 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-aee71f0e-9ca9-4883-8e28-5298de900c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:37.320669 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee71f0e-9ca9-4883-8e28-5298de900c4e None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:17:37.348329 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:17:37.392312 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b71912-d9cc-4a9c-9977-ce0c3935fe84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:17:37.392984 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b71912-d9cc-4a9c-9977-ce0c3935fe84 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:37.393267 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b71912-d9cc-4a9c-9977-ce0c3935fe84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:37.393542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b71912-d9cc-4a9c-9977-ce0c3935fe84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:37.395206 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-17b71912-d9cc-4a9c-9977-ce0c3935fe84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:37.500449 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b71912-d9cc-4a9c-9977-ce0c3935fe84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:17:37.501890 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b71912-d9cc-4a9c-9977-ce0c3935fe84 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:17:37.519501 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 674/1337] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:17:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:17:40.174017 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e1e03-70cf-47f7-a400-4f8bbb1501ea None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:40.174549 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e1e03-70cf-47f7-a400-4f8bbb1501ea None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:40.174668 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e1e03-70cf-47f7-a400-4f8bbb1501ea None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:40.175947 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 664/1338] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:17:40.181244 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732b7c0-38b6-4e16-aa67-6bff1885163d None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:40.181698 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732b7c0-38b6-4e16-aa67-6bff1885163d None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:40.181842 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732b7c0-38b6-4e16-aa67-6bff1885163d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:40.246477 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-1732b7c0-38b6-4e16-aa67-6bff1885163d None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:17:40.247612 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-1732b7c0-38b6-4e16-aa67-6bff1885163d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:40.255765 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:17:40.343991 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 675/1339] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:17:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:17:40.381321 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e1e03-70cf-47f7-a400-4f8bbb1501ea None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:17:40.382919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-929e1e03-70cf-47f7-a400-4f8bbb1501ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:40.488984 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e1e03-70cf-47f7-a400-4f8bbb1501ea None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:17:40.560909 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19229dc-2a52-4f75-a1fe-448e698383b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:17:40.561559 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19229dc-2a52-4f75-a1fe-448e698383b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:40.561901 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19229dc-2a52-4f75-a1fe-448e698383b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:40.562187 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19229dc-2a52-4f75-a1fe-448e698383b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:40.563839 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e19229dc-2a52-4f75-a1fe-448e698383b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:40.599095 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:17:40.670421 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19229dc-2a52-4f75-a1fe-448e698383b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:17:40.671841 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19229dc-2a52-4f75-a1fe-448e698383b8 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:17:40.691002 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 665/1340] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:17:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:17:44.891196 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a279e-59e4-4226-9b86-0d676b331bba None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:44.891737 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a279e-59e4-4226-9b86-0d676b331bba None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:44.891737 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a279e-59e4-4226-9b86-0d676b331bba None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:44.893145 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 676/1341] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:17:44.898620 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06fff8-fea3-447f-82b0-3aaf2cea5e38 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:44.899035 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06fff8-fea3-447f-82b0-3aaf2cea5e38 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:44.899316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06fff8-fea3-447f-82b0-3aaf2cea5e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:44.971156 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-ac06fff8-fea3-447f-82b0-3aaf2cea5e38 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:17:44.972370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ac06fff8-fea3-447f-82b0-3aaf2cea5e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:45.063320 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:17:45.075295 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 666/1342] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:17:45.115332 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a279e-59e4-4226-9b86-0d676b331bba None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:17:45.116907 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-7d8a279e-59e4-4226-9b86-0d676b331bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:45.221665 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a279e-59e4-4226-9b86-0d676b331bba None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:17:45.258536 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:17:45.295844 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71690f1-e3f0-408a-a4c6-bc84c03f7623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:17:45.296504 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71690f1-e3f0-408a-a4c6-bc84c03f7623 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:45.296792 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71690f1-e3f0-408a-a4c6-bc84c03f7623 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:45.297072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71690f1-e3f0-408a-a4c6-bc84c03f7623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:45.298758 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-c71690f1-e3f0-408a-a4c6-bc84c03f7623 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:45.406021 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71690f1-e3f0-408a-a4c6-bc84c03f7623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:17:45.407372 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71690f1-e3f0-408a-a4c6-bc84c03f7623 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:17:45.425379 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 677/1343] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:17:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:17:48.675231 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7f850-c245-494d-a7fc-f6c8560c9afb None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:48.675754 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7f850-c245-494d-a7fc-f6c8560c9afb None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:48.675754 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7f850-c245-494d-a7fc-f6c8560c9afb None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:48.677092 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 667/1344] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:17:48.682218 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ab2fd-ebee-4cac-a65d-c10db9ce8a89 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:48.682646 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ab2fd-ebee-4cac-a65d-c10db9ce8a89 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:48.682840 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ab2fd-ebee-4cac-a65d-c10db9ce8a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:48.746631 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-5c9ab2fd-ebee-4cac-a65d-c10db9ce8a89 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:17:48.747815 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-5c9ab2fd-ebee-4cac-a65d-c10db9ce8a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:48.766816 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:17:48.851741 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 678/1345] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:17:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:17:48.889614 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7f850-c245-494d-a7fc-f6c8560c9afb None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:17:48.891349 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-48a7f850-c245-494d-a7fc-f6c8560c9afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:48.998183 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7f850-c245-494d-a7fc-f6c8560c9afb None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:17:49.079787 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87380f6c-42b5-49a3-820b-d0dc3cab7c01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:17:49.080445 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87380f6c-42b5-49a3-820b-d0dc3cab7c01 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:49.080733 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87380f6c-42b5-49a3-820b-d0dc3cab7c01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:49.081016 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87380f6c-42b5-49a3-820b-d0dc3cab7c01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:49.082706 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-87380f6c-42b5-49a3-820b-d0dc3cab7c01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:49.130864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:17:49.203103 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87380f6c-42b5-49a3-820b-d0dc3cab7c01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:17:49.204517 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87380f6c-42b5-49a3-820b-d0dc3cab7c01 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:17:49.223924 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 668/1346] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:17:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:17:53.414084 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46844a69-377b-48e0-a783-b39915fb1be9 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:53.414645 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46844a69-377b-48e0-a783-b39915fb1be9 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:53.414645 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46844a69-377b-48e0-a783-b39915fb1be9 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:53.416035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 679/1347] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:17:53.422088 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de7daf-df49-4622-87f0-cb7e3e462c39 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:53.422839 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de7daf-df49-4622-87f0-cb7e3e462c39 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:53.422839 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de7daf-df49-4622-87f0-cb7e3e462c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:53.491992 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-d4de7daf-df49-4622-87f0-cb7e3e462c39 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:17:53.493143 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d4de7daf-df49-4622-87f0-cb7e3e462c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:53.596587 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:17:53.599289 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 669/1348] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:17:53.637280 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46844a69-377b-48e0-a783-b39915fb1be9 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:17:53.638953 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-46844a69-377b-48e0-a783-b39915fb1be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:53.747418 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46844a69-377b-48e0-a783-b39915fb1be9 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:17:53.796237 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:17:53.822078 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafd20e-37dd-4894-90f4-b92fd43c4bd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:17:53.822728 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafd20e-37dd-4894-90f4-b92fd43c4bd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:53.823015 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafd20e-37dd-4894-90f4-b92fd43c4bd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:53.823292 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafd20e-37dd-4894-90f4-b92fd43c4bd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:53.825543 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-4fafd20e-37dd-4894-90f4-b92fd43c4bd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:53.931795 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fafd20e-37dd-4894-90f4-b92fd43c4bd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:17:53.933224 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fafd20e-37dd-4894-90f4-b92fd43c4bd8 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:17:53.951999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 680/1349] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:17:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:17:58.890572 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634036e6-9437-4f28-bdf2-bd43880e6cee None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:58.891005 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634036e6-9437-4f28-bdf2-bd43880e6cee None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:58.891193 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634036e6-9437-4f28-bdf2-bd43880e6cee None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:58.892822 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 670/1350] 10.222.0.23 () {54 vars in 921 bytes} [Mon Jul 11 11:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:17:58.897847 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4e8be-0f52-4618-bbbd-da4959728564 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:17:58.898634 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4e8be-0f52-4618-bbbd-da4959728564 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:17:58.899219 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4e8be-0f52-4618-bbbd-da4959728564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:17:59.006730 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-92d4e8be-0f52-4618-bbbd-da4959728564 None None] MFA Rules not processed for user `12b7c9264495433985185332778dbc8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:17:59.008259 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-92d4e8be-0f52-4618-bbbd-da4959728564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:17:59.032381 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:17:59.137252 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 681/1351] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Jul 11 11:17:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:18:03.293470 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef1f8d-5044-476f-8908-8a909602a96a None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:03.294060 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef1f8d-5044-476f-8908-8a909602a96a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:03.294060 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef1f8d-5044-476f-8908-8a909602a96a None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:03.295430 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 671/1352] 10.222.0.23 () {54 vars in 921 bytes} [Mon Jul 11 11:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:18:03.300511 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf99a4-c7ea-4873-8b51-69018875767b None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:03.300905 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf99a4-c7ea-4873-8b51-69018875767b None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:03.301088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf99a4-c7ea-4873-8b51-69018875767b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:03.380803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-6eaf99a4-c7ea-4873-8b51-69018875767b None None] MFA Rules not processed for user `12b7c9264495433985185332778dbc8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:18:03.382049 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-6eaf99a4-c7ea-4873-8b51-69018875767b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:03.457267 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:03.493360 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 682/1353] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Jul 11 11:18:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:18:04.859635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2e4a8-bf0f-4edd-b955-fe0215952b7c None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:04.860154 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2e4a8-bf0f-4edd-b955-fe0215952b7c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:04.860273 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2e4a8-bf0f-4edd-b955-fe0215952b7c None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:04.861554 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 672/1354] 10.222.0.23 () {54 vars in 921 bytes} [Mon Jul 11 11:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:18:04.866596 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635d068-4510-4013-80c6-8e1e973ab8b4 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:04.866989 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635d068-4510-4013-80c6-8e1e973ab8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:04.868316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635d068-4510-4013-80c6-8e1e973ab8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:04.941231 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-0635d068-4510-4013-80c6-8e1e973ab8b4 None None] MFA Rules not processed for user `12b7c9264495433985185332778dbc8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:18:04.942457 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-0635d068-4510-4013-80c6-8e1e973ab8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:05.050322 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 683/1355] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Jul 11 11:18:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:18:08.446185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af3195-0215-4620-b017-e378008d0b9a None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:08.446682 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af3195-0215-4620-b017-e378008d0b9a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:08.446780 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af3195-0215-4620-b017-e378008d0b9a None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:08.448105 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 673/1356] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:18:08.454761 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cca18-6369-4aa8-9ca9-940b1c8bc9ea None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:08.455230 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cca18-6369-4aa8-9ca9-940b1c8bc9ea None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:08.455308 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cca18-6369-4aa8-9ca9-940b1c8bc9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:08.496972 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:08.534780 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-078cca18-6369-4aa8-9ca9-940b1c8bc9ea None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:18:08.535968 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-078cca18-6369-4aa8-9ca9-940b1c8bc9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:08.639482 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 684/1357] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:18:08.694130 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309737e-fabe-406a-8ee5-8fdd10a3b8db None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:08.695035 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309737e-fabe-406a-8ee5-8fdd10a3b8db None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:08.695791 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309737e-fabe-406a-8ee5-8fdd10a3b8db None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:08.700529 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 674/1358] 10.222.0.23 () {54 vars in 961 bytes} [Mon Jul 11 11:18:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:18:08.709098 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cbd27-142f-43ff-92a4-cbeb6f0c6809 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:08.709488 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cbd27-142f-43ff-92a4-cbeb6f0c6809 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:08.710078 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cbd27-142f-43ff-92a4-cbeb6f0c6809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:08.803454 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-343cbd27-142f-43ff-92a4-cbeb6f0c6809 None None] MFA Rules not processed for user `5b9e7594afc346e593ef3e6c579e237b`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:18:08.804798 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-343cbd27-142f-43ff-92a4-cbeb6f0c6809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:08.858179 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:08.928839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 685/1359] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Jul 11 11:18:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:18:08.937464 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309737e-fabe-406a-8ee5-8fdd10a3b8db None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:18:08.939429 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-5309737e-fabe-406a-8ee5-8fdd10a3b8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:09.093692 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309737e-fabe-406a-8ee5-8fdd10a3b8db None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:18:09.184769 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:09.243450 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaff7c4-53fb-41fc-b839-d8d31f5d0d6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:18:09.244261 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaff7c4-53fb-41fc-b839-d8d31f5d0d6b service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:09.244640 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaff7c4-53fb-41fc-b839-d8d31f5d0d6b service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:09.245034 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaff7c4-53fb-41fc-b839-d8d31f5d0d6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:09.247080 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1aaff7c4-53fb-41fc-b839-d8d31f5d0d6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:09.339629 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaff7c4-53fb-41fc-b839-d8d31f5d0d6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:18:09.341262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaff7c4-53fb-41fc-b839-d8d31f5d0d6b service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:18:09.369924 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 675/1360] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:18:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:18:11.622519 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aba1e-8968-49b3-846d-033b0a8ff0a2 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:11.623080 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aba1e-8968-49b3-846d-033b0a8ff0a2 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:11.623080 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aba1e-8968-49b3-846d-033b0a8ff0a2 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:11.624673 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 686/1361] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:18:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:18:11.630155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdecec-b487-4f5c-9c36-9f75593e738c None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:11.630534 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdecec-b487-4f5c-9c36-9f75593e738c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:11.630687 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdecec-b487-4f5c-9c36-9f75593e738c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:11.701745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-28cdecec-b487-4f5c-9c36-9f75593e738c None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:18:11.703004 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-28cdecec-b487-4f5c-9c36-9f75593e738c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:11.743197 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:11.812860 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 676/1362] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:18:11.859247 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771aba1e-8968-49b3-846d-033b0a8ff0a2 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:18:11.860864 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-771aba1e-8968-49b3-846d-033b0a8ff0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:12.035541 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771aba1e-8968-49b3-846d-033b0a8ff0a2 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:18:12.046800 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:12.155430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad4952-9c56-4ca0-bd65-3388d876bcd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:18:12.156338 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad4952-9c56-4ca0-bd65-3388d876bcd2 service nova] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:12.156338 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad4952-9c56-4ca0-bd65-3388d876bcd2 service nova] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:12.156703 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad4952-9c56-4ca0-bd65-3388d876bcd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:12.158426 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-7dad4952-9c56-4ca0-bd65-3388d876bcd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:12.274120 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad4952-9c56-4ca0-bd65-3388d876bcd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:18:12.275744 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad4952-9c56-4ca0-bd65-3388d876bcd2 service nova] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:18:12.299337 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 687/1363] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:18:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:18:14.842871 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428f3eb-f4be-4f37-a73b-4bd172c69008 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:14.843456 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428f3eb-f4be-4f37-a73b-4bd172c69008 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:14.843456 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428f3eb-f4be-4f37-a73b-4bd172c69008 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:14.844863 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 677/1364] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:18:14.850120 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d86455-913e-4bbb-8d33-d27f9d847642 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:14.850575 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d86455-913e-4bbb-8d33-d27f9d847642 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:14.850732 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d86455-913e-4bbb-8d33-d27f9d847642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:14.869005 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:14.933988 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-84d86455-913e-4bbb-8d33-d27f9d847642 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:18:14.935545 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-84d86455-913e-4bbb-8d33-d27f9d847642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:15.049802 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 688/1365] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:18:15.093413 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45978c5-6bdb-4412-a433-13b1bf8acc90 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:15.094052 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45978c5-6bdb-4412-a433-13b1bf8acc90 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:15.094407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45978c5-6bdb-4412-a433-13b1bf8acc90 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:15.096027 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 678/1366] 10.222.0.23 () {54 vars in 961 bytes} [Mon Jul 11 11:18:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:18:15.101525 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc8c7d-a01a-4afe-a123-63c6c7456609 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:15.101838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc8c7d-a01a-4afe-a123-63c6c7456609 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:15.102118 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc8c7d-a01a-4afe-a123-63c6c7456609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:15.182117 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-28fc8c7d-a01a-4afe-a123-63c6c7456609 None None] MFA Rules not processed for user `5b9e7594afc346e593ef3e6c579e237b`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:18:15.183942 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-28fc8c7d-a01a-4afe-a123-63c6c7456609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:15.221806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:15.317705 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45978c5-6bdb-4412-a433-13b1bf8acc90 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:18:15.318220 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 689/1367] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Jul 11 11:18:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:18:15.320174 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a45978c5-6bdb-4412-a433-13b1bf8acc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:15.477403 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45978c5-6bdb-4412-a433-13b1bf8acc90 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:18:15.499692 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:15.599151 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c853d-ad94-4eb9-b435-8fe928a05d1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:18:15.599808 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c853d-ad94-4eb9-b435-8fe928a05d1b service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:15.600088 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c853d-ad94-4eb9-b435-8fe928a05d1b service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:15.600363 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c853d-ad94-4eb9-b435-8fe928a05d1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:15.602032 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d87c853d-ad94-4eb9-b435-8fe928a05d1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:15.700386 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c853d-ad94-4eb9-b435-8fe928a05d1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:18:15.702020 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c853d-ad94-4eb9-b435-8fe928a05d1b service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:18:15.721872 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 679/1368] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:18:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:18:16.795402 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dc292-9318-4303-bd51-d1c590e8451d None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:16.795963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dc292-9318-4303-bd51-d1c590e8451d None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:16.795963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dc292-9318-4303-bd51-d1c590e8451d None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:16.798084 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 690/1369] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:18:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:18:16.803090 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dff98f-b38f-46fa-b0da-54104b2fe880 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:16.803997 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dff98f-b38f-46fa-b0da-54104b2fe880 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:16.803997 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dff98f-b38f-46fa-b0da-54104b2fe880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:16.837294 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:16.874125 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-91dff98f-b38f-46fa-b0da-54104b2fe880 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:18:16.875374 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-91dff98f-b38f-46fa-b0da-54104b2fe880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:16.982338 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 680/1370] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:18:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:18:17.328794 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f5e87-10b6-41dd-bce8-f81b9bb7cc32 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:17.329084 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f5e87-10b6-41dd-bce8-f81b9bb7cc32 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:17.329393 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f5e87-10b6-41dd-bce8-f81b9bb7cc32 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:17.330952 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 691/1371] 10.222.0.23 () {54 vars in 963 bytes} [Mon Jul 11 11:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:18:17.335823 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3334b83-8ef3-46a5-894d-048be6c387f0 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:17.336217 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3334b83-8ef3-46a5-894d-048be6c387f0 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:17.336597 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3334b83-8ef3-46a5-894d-048be6c387f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:17.416153 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-d3334b83-8ef3-46a5-894d-048be6c387f0 None None] MFA Rules not processed for user `3096077887344140805ec8a23fe72f48`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:18:17.418277 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d3334b83-8ef3-46a5-894d-048be6c387f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:17.469062 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:17.509374 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f5e87-10b6-41dd-bce8-f81b9bb7cc32 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:18:17.509854 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 681/1372] 10.222.0.23 () {58 vars in 1060 bytes} [Mon Jul 11 11:18:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:18:17.511359 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-150f5e87-10b6-41dd-bce8-f81b9bb7cc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:17.622469 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f5e87-10b6-41dd-bce8-f81b9bb7cc32 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:18:17.665506 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:17.702864 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa0b7c-4795-4ad9-9489-71f0bbd0dac5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:18:17.703693 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa0b7c-4795-4ad9-9489-71f0bbd0dac5 service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:17.704072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa0b7c-4795-4ad9-9489-71f0bbd0dac5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:17.704445 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa0b7c-4795-4ad9-9489-71f0bbd0dac5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:17.706861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-1bfa0b7c-4795-4ad9-9489-71f0bbd0dac5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:17.829432 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa0b7c-4795-4ad9-9489-71f0bbd0dac5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:18:17.831607 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa0b7c-4795-4ad9-9489-71f0bbd0dac5 service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:18:17.854167 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 692/1373] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:18:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:18:18.016540 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a53279-f3fb-4a49-b5f0-a91ba4a145d1 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:18.017056 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a53279-f3fb-4a49-b5f0-a91ba4a145d1 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:18.017056 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a53279-f3fb-4a49-b5f0-a91ba4a145d1 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:18.018644 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 682/1374] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:18:18.025875 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25916540-47ec-445d-aa97-5dd205eab4cb None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:18.025875 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25916540-47ec-445d-aa97-5dd205eab4cb None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:18.025875 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25916540-47ec-445d-aa97-5dd205eab4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:18.103680 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-25916540-47ec-445d-aa97-5dd205eab4cb None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:18:18.105363 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-25916540-47ec-445d-aa97-5dd205eab4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:18.129907 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:18.231124 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 693/1375] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:18:18.274110 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a53279-f3fb-4a49-b5f0-a91ba4a145d1 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:18:18.275637 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-68a53279-f3fb-4a49-b5f0-a91ba4a145d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:18.427437 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a53279-f3fb-4a49-b5f0-a91ba4a145d1 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:18:18.478806 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:18.541303 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fda81a-ad3d-4431-9032-ad8675efc854 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:18:18.541998 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fda81a-ad3d-4431-9032-ad8675efc854 service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:18.543017 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fda81a-ad3d-4431-9032-ad8675efc854 service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:18.543308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fda81a-ad3d-4431-9032-ad8675efc854 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:18.545040 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-40fda81a-ad3d-4431-9032-ad8675efc854 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:18.634812 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fda81a-ad3d-4431-9032-ad8675efc854 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:18:18.637172 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fda81a-ad3d-4431-9032-ad8675efc854 service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:18:18.655946 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 683/1376] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:18:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:18:20.838027 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a93180-ff0b-4cbb-9d9d-5b9bdefc31d5 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:20.838525 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a93180-ff0b-4cbb-9d9d-5b9bdefc31d5 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:20.838619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a93180-ff0b-4cbb-9d9d-5b9bdefc31d5 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:20.840876 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 694/1377] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:18:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:18:20.846184 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e3133-7fc7-4e7a-bea5-156b59c5a044 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:20.846629 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e3133-7fc7-4e7a-bea5-156b59c5a044 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:20.846865 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e3133-7fc7-4e7a-bea5-156b59c5a044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:20.918018 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-037e3133-7fc7-4e7a-bea5-156b59c5a044 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:18:20.919256 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-037e3133-7fc7-4e7a-bea5-156b59c5a044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:20.926142 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:21.033245 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 684/1378] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:18:21.078289 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a93180-ff0b-4cbb-9d9d-5b9bdefc31d5 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:18:21.079865 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-51a93180-ff0b-4cbb-9d9d-5b9bdefc31d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:21.224321 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a93180-ff0b-4cbb-9d9d-5b9bdefc31d5 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:18:21.227987 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:21.348839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc940a7-be91-417e-adde-4906c1482d58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:18:21.349504 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc940a7-be91-417e-adde-4906c1482d58 service nova] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:21.350442 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc940a7-be91-417e-adde-4906c1482d58 service nova] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:21.350442 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc940a7-be91-417e-adde-4906c1482d58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:21.353805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-ffc940a7-be91-417e-adde-4906c1482d58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:21.470513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc940a7-be91-417e-adde-4906c1482d58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:18:21.472034 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc940a7-be91-417e-adde-4906c1482d58 service nova] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:18:21.504833 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 695/1379] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:18:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:18:23.635110 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d5f08-0bb8-4e75-91a7-8fbb1ad6dec4 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:23.635659 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d5f08-0bb8-4e75-91a7-8fbb1ad6dec4 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:23.635659 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d5f08-0bb8-4e75-91a7-8fbb1ad6dec4 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:23.637399 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 685/1380] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:18:23.642574 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e6ea7-0c6c-4e2d-8614-f7c44b07f301 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:23.643034 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e6ea7-0c6c-4e2d-8614-f7c44b07f301 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:23.643132 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e6ea7-0c6c-4e2d-8614-f7c44b07f301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:23.653923 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:23.709863 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-201e6ea7-0c6c-4e2d-8614-f7c44b07f301 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:18:23.711038 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-201e6ea7-0c6c-4e2d-8614-f7c44b07f301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:23.812908 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 696/1381] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:18:23.856945 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d5f08-0bb8-4e75-91a7-8fbb1ad6dec4 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:18:23.858796 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-eb2d5f08-0bb8-4e75-91a7-8fbb1ad6dec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:24.011420 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:24.021706 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d5f08-0bb8-4e75-91a7-8fbb1ad6dec4 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:18:24.139594 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385f4f2-11d8-4bcc-9c48-63d7c647b578 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:18:24.140214 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385f4f2-11d8-4bcc-9c48-63d7c647b578 service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:24.140501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385f4f2-11d8-4bcc-9c48-63d7c647b578 service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:24.140782 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385f4f2-11d8-4bcc-9c48-63d7c647b578 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:24.142944 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9385f4f2-11d8-4bcc-9c48-63d7c647b578 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:24.240114 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385f4f2-11d8-4bcc-9c48-63d7c647b578 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:18:24.241538 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385f4f2-11d8-4bcc-9c48-63d7c647b578 service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:18:24.254188 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:24.262771 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 686/1382] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:18:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:18:26.649056 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0422a-c62e-48c4-94a4-b01f92290940 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:26.649592 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0422a-c62e-48c4-94a4-b01f92290940 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:26.650050 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0422a-c62e-48c4-94a4-b01f92290940 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:26.652395 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 697/1383] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:18:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:18:26.657752 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48733fe-3243-4a67-ae29-d79f81a7d6c7 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:26.658194 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48733fe-3243-4a67-ae29-d79f81a7d6c7 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:26.658376 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48733fe-3243-4a67-ae29-d79f81a7d6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:26.742370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-b48733fe-3243-4a67-ae29-d79f81a7d6c7 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:18:26.744295 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b48733fe-3243-4a67-ae29-d79f81a7d6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:26.874396 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 687/1384] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:18:26.919798 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0422a-c62e-48c4-94a4-b01f92290940 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:18:26.921335 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-f8e0422a-c62e-48c4-94a4-b01f92290940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:27.008853 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:27.099268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0422a-c62e-48c4-94a4-b01f92290940 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:18:27.229010 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ee54e-afb4-4870-86d2-a7f24db04005 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:18:27.230235 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ee54e-afb4-4870-86d2-a7f24db04005 service nova] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:27.230524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ee54e-afb4-4870-86d2-a7f24db04005 service nova] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:27.230803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ee54e-afb4-4870-86d2-a7f24db04005 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:27.232474 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-079ee54e-afb4-4870-86d2-a7f24db04005 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:27.284386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:27.327043 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ee54e-afb4-4870-86d2-a7f24db04005 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:18:27.328694 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ee54e-afb4-4870-86d2-a7f24db04005 service nova] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:18:27.352225 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 698/1385] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:18:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:18:29.764733 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a45c9-5cdd-41b9-953d-f7926d2406f0 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:29.765214 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a45c9-5cdd-41b9-953d-f7926d2406f0 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:29.765327 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a45c9-5cdd-41b9-953d-f7926d2406f0 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:29.766865 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 688/1386] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:18:29.773325 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0aee2a-3ba6-4d71-8e96-7d25238e1faa None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:29.773788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0aee2a-3ba6-4d71-8e96-7d25238e1faa None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:29.774338 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0aee2a-3ba6-4d71-8e96-7d25238e1faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:29.868466 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-ec0aee2a-3ba6-4d71-8e96-7d25238e1faa None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:18:29.870396 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-ec0aee2a-3ba6-4d71-8e96-7d25238e1faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:29.977578 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 699/1387] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:18:30.029987 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a45c9-5cdd-41b9-953d-f7926d2406f0 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:18:30.031742 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-886a45c9-5cdd-41b9-953d-f7926d2406f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:30.116747 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:30.189065 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a45c9-5cdd-41b9-953d-f7926d2406f0 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:18:30.321222 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc59c48-dd7b-4998-b98b-2e03fa58de79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:18:30.321902 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc59c48-dd7b-4998-b98b-2e03fa58de79 service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:30.322186 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc59c48-dd7b-4998-b98b-2e03fa58de79 service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:30.322471 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc59c48-dd7b-4998-b98b-2e03fa58de79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:30.324711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8cc59c48-dd7b-4998-b98b-2e03fa58de79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:30.363100 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:30.417467 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc59c48-dd7b-4998-b98b-2e03fa58de79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:18:30.419171 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc59c48-dd7b-4998-b98b-2e03fa58de79 service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:18:30.441385 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 689/1388] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:18:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:18:32.694358 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6ba22-3182-487a-8ed1-2e389daf1df5 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:32.694899 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6ba22-3182-487a-8ed1-2e389daf1df5 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:32.694899 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6ba22-3182-487a-8ed1-2e389daf1df5 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:32.696324 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 700/1389] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:18:32.702272 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e71c30-5925-4f54-b189-6349f55818ef None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:32.702720 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e71c30-5925-4f54-b189-6349f55818ef None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:32.702862 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e71c30-5925-4f54-b189-6349f55818ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:32.769394 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-39e71c30-5925-4f54-b189-6349f55818ef None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:18:32.770659 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-39e71c30-5925-4f54-b189-6349f55818ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:32.872552 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 690/1390] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:18:32.917181 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6ba22-3182-487a-8ed1-2e389daf1df5 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:18:32.918806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-69b6ba22-3182-487a-8ed1-2e389daf1df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:32.949337 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:33.066030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6ba22-3182-487a-8ed1-2e389daf1df5 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:18:33.170461 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:33.182329 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736597c3-8935-49a0-9124-de474860df10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:18:33.183045 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736597c3-8935-49a0-9124-de474860df10 service nova] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:33.183345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736597c3-8935-49a0-9124-de474860df10 service nova] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:33.183662 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736597c3-8935-49a0-9124-de474860df10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:33.185633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-736597c3-8935-49a0-9124-de474860df10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:33.278572 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736597c3-8935-49a0-9124-de474860df10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:18:33.280072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736597c3-8935-49a0-9124-de474860df10 service nova] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:18:33.298588 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 701/1391] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:18:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:18:33.507642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298bd5e-948c-467a-b12f-aac1cf85c57f None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:33.507938 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298bd5e-948c-467a-b12f-aac1cf85c57f None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:33.508218 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298bd5e-948c-467a-b12f-aac1cf85c57f None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:33.509603 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 691/1392] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:18:33.515446 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664816bf-a066-4548-80f0-4f50293cff66 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:33.515740 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664816bf-a066-4548-80f0-4f50293cff66 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:33.516018 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664816bf-a066-4548-80f0-4f50293cff66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:33.581728 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-664816bf-a066-4548-80f0-4f50293cff66 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:18:33.582946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-664816bf-a066-4548-80f0-4f50293cff66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:33.641750 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:33.678434 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 702/1393] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:18:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:18:33.735202 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbc973-f6d3-4700-b3be-c57f45721627 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:33.735621 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbc973-f6d3-4700-b3be-c57f45721627 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:33.735766 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbc973-f6d3-4700-b3be-c57f45721627 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:33.737149 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 692/1394] 10.222.0.23 () {54 vars in 962 bytes} [Mon Jul 11 11:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:18:33.750482 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee824635-f68d-4f02-a31d-f874cd520914 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:33.750482 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee824635-f68d-4f02-a31d-f874cd520914 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:33.750482 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee824635-f68d-4f02-a31d-f874cd520914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:33.823370 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-ee824635-f68d-4f02-a31d-f874cd520914 None None] MFA Rules not processed for user `65a2d8d24562459493a3bcd399665a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:18:33.825508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-ee824635-f68d-4f02-a31d-f874cd520914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:33.909447 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 703/1395] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Jul 11 11:18:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:18:33.917030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbc973-f6d3-4700-b3be-c57f45721627 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:18:33.918638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-13dbc973-f6d3-4700-b3be-c57f45721627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:33.932765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:34.025887 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbc973-f6d3-4700-b3be-c57f45721627 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:18:34.101169 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3342113-ffcd-48a7-83b4-60cc840df332 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a2d8d24562459493a3bcd399665a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:18:34.101739 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3342113-ffcd-48a7-83b4-60cc840df332 service glance] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:34.102055 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3342113-ffcd-48a7-83b4-60cc840df332 service glance] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:34.102332 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3342113-ffcd-48a7-83b4-60cc840df332 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:34.103976 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a3342113-ffcd-48a7-83b4-60cc840df332 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:34.174961 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:34.214894 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3342113-ffcd-48a7-83b4-60cc840df332 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:18:34.216942 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3342113-ffcd-48a7-83b4-60cc840df332 service glance] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:18:34.235597 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 693/1396] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:18:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:18:35.175709 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95054862-4132-492b-a0f8-4b725e20ecd4 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:35.176190 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95054862-4132-492b-a0f8-4b725e20ecd4 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:35.176290 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95054862-4132-492b-a0f8-4b725e20ecd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:35.242681 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-95054862-4132-492b-a0f8-4b725e20ecd4 None None] MFA Rules not processed for user `cdfa8f4012c2471b81f8749b013d3117`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:18:35.243816 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-95054862-4132-492b-a0f8-4b725e20ecd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:35.252159 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:35.448929 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 704/1397] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Jul 11 11:18:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:18:35.491363 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f00bd8-a73e-4f69-bec3-52c4aeff3809 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:35.491839 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f00bd8-a73e-4f69-bec3-52c4aeff3809 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:35.492018 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f00bd8-a73e-4f69-bec3-52c4aeff3809 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:35.493458 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 694/1398] 10.222.0.23 () {54 vars in 942 bytes} [Mon Jul 11 11:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:18:35.500316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342af2c-d674-4ad0-b5ef-08618778a5f4 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:35.500680 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342af2c-d674-4ad0-b5ef-08618778a5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:35.501027 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342af2c-d674-4ad0-b5ef-08618778a5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:35.577801 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-3342af2c-d674-4ad0-b5ef-08618778a5f4 None None] MFA Rules not processed for user `736f6d4d1dbb47ff98bc67e53614d49c`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:18:35.579059 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-3342af2c-d674-4ad0-b5ef-08618778a5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:35.666269 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:35.689997 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 705/1399] 10.222.0.23 () {58 vars in 1039 bytes} [Mon Jul 11 11:18:35 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:18:35.699697 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f00bd8-a73e-4f69-bec3-52c4aeff3809 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:18:35.701383 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b7f00bd8-a73e-4f69-bec3-52c4aeff3809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:35.837534 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31194a-c9de-4916-8e8a-205c352ce65e None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:35.837860 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31194a-c9de-4916-8e8a-205c352ce65e None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:35.838139 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31194a-c9de-4916-8e8a-205c352ce65e None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:35.839524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 706/1400] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:18:35.844353 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96e423-7a3c-469f-86a4-1bb8121a4160 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:35.844644 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96e423-7a3c-469f-86a4-1bb8121a4160 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:35.844927 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96e423-7a3c-469f-86a4-1bb8121a4160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:35.846208 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f00bd8-a73e-4f69-bec3-52c4aeff3809 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:18:35.885072 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:35.911078 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-7d96e423-7a3c-469f-86a4-1bb8121a4160 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:18:35.912326 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-7d96e423-7a3c-469f-86a4-1bb8121a4160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:35.951905 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a09ced-e0af-43b8-85c0-71556e39432c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736f6d4d1dbb47ff98bc67e53614d49c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:18:35.952556 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a09ced-e0af-43b8-85c0-71556e39432c service swift] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:35.952838 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a09ced-e0af-43b8-85c0-71556e39432c service swift] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:35.953112 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a09ced-e0af-43b8-85c0-71556e39432c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:35.954813 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-96a09ced-e0af-43b8-85c0-71556e39432c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:36.017567 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 707/1401] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:18:36.041528 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a09ced-e0af-43b8-85c0-71556e39432c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:18:36.043231 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a09ced-e0af-43b8-85c0-71556e39432c service swift] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:18:36.051578 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 695/1402] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jul 11 11:18:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 11:18:36.062454 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96e423-7a3c-469f-86a4-1bb8121a4160 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:18:36.063644 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-7d96e423-7a3c-469f-86a4-1bb8121a4160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:36.126864 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:36.176069 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96e423-7a3c-469f-86a4-1bb8121a4160 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:18:36.288511 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c5989-b742-41c3-9608-a256544c8e70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:18:36.289230 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c5989-b742-41c3-9608-a256544c8e70 service nova] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:36.289509 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c5989-b742-41c3-9608-a256544c8e70 service nova] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:36.289810 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c5989-b742-41c3-9608-a256544c8e70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:36.291445 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-f50c5989-b742-41c3-9608-a256544c8e70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:36.351008 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:36.381594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c5989-b742-41c3-9608-a256544c8e70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:18:36.383260 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c5989-b742-41c3-9608-a256544c8e70 service nova] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:18:36.400637 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 708/1403] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:18:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:18:38.603880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedd345-fc73-4a2d-a3cc-02d04d0d51a0 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:38.604438 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedd345-fc73-4a2d-a3cc-02d04d0d51a0 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:38.604438 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedd345-fc73-4a2d-a3cc-02d04d0d51a0 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:38.605871 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 696/1404] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:18:38.611579 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d56498-5ec1-40fa-bf2f-7d323c8666ac None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:38.611579 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d56498-5ec1-40fa-bf2f-7d323c8666ac None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:38.612079 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d56498-5ec1-40fa-bf2f-7d323c8666ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:38.687333 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-74d56498-5ec1-40fa-bf2f-7d323c8666ac None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:18:38.688650 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-74d56498-5ec1-40fa-bf2f-7d323c8666ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:38.808927 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 709/1405] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:18:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:18:38.856089 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fedd345-fc73-4a2d-a3cc-02d04d0d51a0 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:18:38.857559 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8fedd345-fc73-4a2d-a3cc-02d04d0d51a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:38.939061 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:39.026723 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fedd345-fc73-4a2d-a3cc-02d04d0d51a0 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:18:39.163247 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0d750-1e4c-41ae-a2c1-8b38f4793541 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:18:39.163909 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0d750-1e4c-41ae-a2c1-8b38f4793541 service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:39.164197 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0d750-1e4c-41ae-a2c1-8b38f4793541 service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:39.164479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0d750-1e4c-41ae-a2c1-8b38f4793541 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:39.166473 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c9a0d750-1e4c-41ae-a2c1-8b38f4793541 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:39.217400 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:39.283112 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0d750-1e4c-41ae-a2c1-8b38f4793541 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:18:39.284729 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0d750-1e4c-41ae-a2c1-8b38f4793541 service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:18:39.318869 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 697/1406] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:18:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:18:42.319502 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fa919-169d-4af0-a79c-8d90d7678f1c None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:42.320101 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fa919-169d-4af0-a79c-8d90d7678f1c None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:42.320101 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fa919-169d-4af0-a79c-8d90d7678f1c None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:42.321463 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 710/1407] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:18:42.327346 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2ca96-4ca9-47de-94d3-0a5f7a898785 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:42.327771 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2ca96-4ca9-47de-94d3-0a5f7a898785 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:42.327940 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2ca96-4ca9-47de-94d3-0a5f7a898785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:42.399764 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-54a2ca96-4ca9-47de-94d3-0a5f7a898785 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:18:42.401027 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-54a2ca96-4ca9-47de-94d3-0a5f7a898785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:42.511027 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 698/1408] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:18:42.555318 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fa919-169d-4af0-a79c-8d90d7678f1c None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:18:42.557033 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-543fa919-169d-4af0-a79c-8d90d7678f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:42.606897 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:42.734909 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fa919-169d-4af0-a79c-8d90d7678f1c None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:18:42.862026 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:42.868879 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489530f-4013-4c44-8bd2-8962af390671 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:18:42.869530 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489530f-4013-4c44-8bd2-8962af390671 service nova] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:42.869842 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489530f-4013-4c44-8bd2-8962af390671 service nova] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:42.870125 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489530f-4013-4c44-8bd2-8962af390671 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:42.872646 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-a489530f-4013-4c44-8bd2-8962af390671 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:18:42.972541 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489530f-4013-4c44-8bd2-8962af390671 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:18:42.974292 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489530f-4013-4c44-8bd2-8962af390671 service nova] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:18:42.993319 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 711/1409] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:18:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:18:52.508835 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:52.990308 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=47 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:59.930460 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed158a8-d213-4ba2-84cf-9f17415606a9 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:59.931019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed158a8-d213-4ba2-84cf-9f17415606a9 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:59.931019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed158a8-d213-4ba2-84cf-9f17415606a9 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:18:59.932429 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 699/1410] 10.222.0.23 () {54 vars in 918 bytes} [Mon Jul 11 11:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:18:59.938181 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d819f1f-8865-47c7-9cd4-5331ef581cae None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:18:59.938631 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d819f1f-8865-47c7-9cd4-5331ef581cae None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:18:59.938735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d819f1f-8865-47c7-9cd4-5331ef581cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:00.011482 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-9d819f1f-8865-47c7-9cd4-5331ef581cae None None] MFA Rules not processed for user `12b7c9264495433985185332778dbc8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:19:00.012674 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-9d819f1f-8865-47c7-9cd4-5331ef581cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:00.118014 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 712/1411] 10.222.0.23 () {58 vars in 1015 bytes} [Mon Jul 11 11:18:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:19:00.132569 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02eacf-f8f5-4175-925c-88cdef83d79e None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:00.132866 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02eacf-f8f5-4175-925c-88cdef83d79e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:00.133153 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02eacf-f8f5-4175-925c-88cdef83d79e None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:00.134584 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 700/1412] 10.222.0.23 () {54 vars in 918 bytes} [Mon Jul 11 11:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:19:00.139567 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb14f0f-c755-436d-8975-dfa8b3a32bef None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:00.139859 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb14f0f-c755-436d-8975-dfa8b3a32bef None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:00.140140 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb14f0f-c755-436d-8975-dfa8b3a32bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:00.210936 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:00.213366 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-6cb14f0f-c755-436d-8975-dfa8b3a32bef None None] MFA Rules not processed for user `5b9e7594afc346e593ef3e6c579e237b`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:19:00.214633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-6cb14f0f-c755-436d-8975-dfa8b3a32bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:00.329364 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 713/1413] 10.222.0.23 () {58 vars in 1015 bytes} [Mon Jul 11 11:19:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:19:02.797646 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c4a34-6140-4473-819c-7b69b0cb6d2b None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:02.798167 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c4a34-6140-4473-819c-7b69b0cb6d2b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:02.798302 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c4a34-6140-4473-819c-7b69b0cb6d2b None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:02.799626 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 11:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:19:02.804808 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abd20f-2cfc-4fa0-9e3d-f7cdcea62c41 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:02.805234 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abd20f-2cfc-4fa0-9e3d-f7cdcea62c41 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:02.805362 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abd20f-2cfc-4fa0-9e3d-f7cdcea62c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:02.871091 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-81abd20f-2cfc-4fa0-9e3d-f7cdcea62c41 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:19:02.872310 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-81abd20f-2cfc-4fa0-9e3d-f7cdcea62c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:02.924673 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:02.966118 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 11:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:19:03.008178 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c4a34-6140-4473-819c-7b69b0cb6d2b None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:19:03.009748 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-103c4a34-6140-4473-819c-7b69b0cb6d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:03.153802 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c4a34-6140-4473-819c-7b69b0cb6d2b None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:19:03.224971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:03.265298 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364e6e9-c883-4ba0-bd1a-40759010c1ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:19:03.265972 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364e6e9-c883-4ba0-bd1a-40759010c1ba service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:03.266256 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364e6e9-c883-4ba0-bd1a-40759010c1ba service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:03.266531 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364e6e9-c883-4ba0-bd1a-40759010c1ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:03.268658 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1364e6e9-c883-4ba0-bd1a-40759010c1ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:03.356289 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364e6e9-c883-4ba0-bd1a-40759010c1ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:19:03.357913 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364e6e9-c883-4ba0-bd1a-40759010c1ba service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:19:03.375441 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 702/1416] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:19:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:19:04.265371 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f46eb6-6e01-42a4-aee3-a5ef3734d62b None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:04.265866 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f46eb6-6e01-42a4-aee3-a5ef3734d62b None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:04.266028 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f46eb6-6e01-42a4-aee3-a5ef3734d62b None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:04.267418 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 11:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:19:04.272222 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306003c-0ab2-4372-a49f-45bfa9c0c9db None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:04.272641 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306003c-0ab2-4372-a49f-45bfa9c0c9db None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:04.272779 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306003c-0ab2-4372-a49f-45bfa9c0c9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:04.345336 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-1306003c-0ab2-4372-a49f-45bfa9c0c9db None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:19:04.346565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1306003c-0ab2-4372-a49f-45bfa9c0c9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:04.373806 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:04.441233 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 11:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:19:04.589035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f46eb6-6e01-42a4-aee3-a5ef3734d62b None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:19:04.591327 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-f0f46eb6-6e01-42a4-aee3-a5ef3734d62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:04.738555 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f46eb6-6e01-42a4-aee3-a5ef3734d62b None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:19:04.781439 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:04.854239 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70dd8ff-6338-49c5-901d-055fa4e4fad8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:19:04.854839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dd8ff-6338-49c5-901d-055fa4e4fad8 service nova] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:04.855132 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dd8ff-6338-49c5-901d-055fa4e4fad8 service nova] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:04.855402 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dd8ff-6338-49c5-901d-055fa4e4fad8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:04.857054 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-f70dd8ff-6338-49c5-901d-055fa4e4fad8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:04.945355 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70dd8ff-6338-49c5-901d-055fa4e4fad8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:19:04.946965 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70dd8ff-6338-49c5-901d-055fa4e4fad8 service nova] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:19:04.965228 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 716/1419] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:19:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:19:05.838987 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422a4a8-5ccd-4f42-a8bd-4086ddb4f90f None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:05.840143 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422a4a8-5ccd-4f42-a8bd-4086ddb4f90f None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:05.840320 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422a4a8-5ccd-4f42-a8bd-4086ddb4f90f None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:05.841779 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 11:19:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:19:05.846799 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcb2e2-7e86-4ec4-b829-c51347ab6f8f None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:05.847219 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcb2e2-7e86-4ec4-b829-c51347ab6f8f None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:05.847364 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcb2e2-7e86-4ec4-b829-c51347ab6f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:05.899195 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:05.921523 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-1cfcb2e2-7e86-4ec4-b829-c51347ab6f8f None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:19:05.922802 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-1cfcb2e2-7e86-4ec4-b829-c51347ab6f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:06.018857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 11:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:19:06.171813 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422a4a8-5ccd-4f42-a8bd-4086ddb4f90f None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:19:06.173382 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d422a4a8-5ccd-4f42-a8bd-4086ddb4f90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:06.320865 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422a4a8-5ccd-4f42-a8bd-4086ddb4f90f None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:19:06.333587 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:06.435908 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78228ec-c354-4e18-8099-b49154b32d5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:19:06.436563 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78228ec-c354-4e18-8099-b49154b32d5d service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:06.436874 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78228ec-c354-4e18-8099-b49154b32d5d service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:06.437153 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78228ec-c354-4e18-8099-b49154b32d5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:06.438856 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e78228ec-c354-4e18-8099-b49154b32d5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:06.527404 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78228ec-c354-4e18-8099-b49154b32d5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:19:06.529014 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78228ec-c354-4e18-8099-b49154b32d5d service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:19:06.547054 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 705/1422] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:19:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:19:07.405243 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b75f0-b5b2-4024-a096-9541a2412160 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:07.405808 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b75f0-b5b2-4024-a096-9541a2412160 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:07.405808 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b75f0-b5b2-4024-a096-9541a2412160 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:07.407203 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 11:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:19:07.412032 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8b418-e485-4ef2-9e15-f6aa6fc1cdc2 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:07.412480 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8b418-e485-4ef2-9e15-f6aa6fc1cdc2 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:07.412577 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8b418-e485-4ef2-9e15-f6aa6fc1cdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:07.430722 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:07.486591 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-08f8b418-e485-4ef2-9e15-f6aa6fc1cdc2 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:19:07.487787 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-08f8b418-e485-4ef2-9e15-f6aa6fc1cdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:07.583682 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 11:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:19:07.734306 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b75f0-b5b2-4024-a096-9541a2412160 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:19:07.735766 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-9f9b75f0-b5b2-4024-a096-9541a2412160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:07.845558 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:07.880115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b75f0-b5b2-4024-a096-9541a2412160 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:19:07.992337 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870429a8-a9ff-41c2-be65-6ecc1ff871b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:19:07.992908 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870429a8-a9ff-41c2-be65-6ecc1ff871b9 service nova] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:07.993196 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870429a8-a9ff-41c2-be65-6ecc1ff871b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:07.993474 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870429a8-a9ff-41c2-be65-6ecc1ff871b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:07.995151 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-870429a8-a9ff-41c2-be65-6ecc1ff871b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:08.071193 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:08.084543 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870429a8-a9ff-41c2-be65-6ecc1ff871b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:19:08.086181 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870429a8-a9ff-41c2-be65-6ecc1ff871b9 service nova] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:19:08.103839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 719/1425] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:19:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:19:08.970148 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86503e6f-e018-45ff-a6c7-a638ec0c6914 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:08.970679 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86503e6f-e018-45ff-a6c7-a638ec0c6914 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:08.970774 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86503e6f-e018-45ff-a6c7-a638ec0c6914 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:08.972126 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 11:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:19:08.977264 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7e331-a38c-4937-8dbb-c55b19db54e3 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:08.977688 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7e331-a38c-4937-8dbb-c55b19db54e3 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:08.977851 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7e331-a38c-4937-8dbb-c55b19db54e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:09.050694 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-31f7e331-a38c-4937-8dbb-c55b19db54e3 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:19:09.051892 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-31f7e331-a38c-4937-8dbb-c55b19db54e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:09.149955 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 11:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:19:09.303121 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86503e6f-e018-45ff-a6c7-a638ec0c6914 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:19:09.304650 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-86503e6f-e018-45ff-a6c7-a638ec0c6914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:09.390273 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:09.452768 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86503e6f-e018-45ff-a6c7-a638ec0c6914 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:19:09.563863 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7db2d2-874f-42e5-8c97-93609dedfdc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:19:09.564438 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7db2d2-874f-42e5-8c97-93609dedfdc3 service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:09.564720 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7db2d2-874f-42e5-8c97-93609dedfdc3 service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:09.564996 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7db2d2-874f-42e5-8c97-93609dedfdc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:09.566683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9b7db2d2-874f-42e5-8c97-93609dedfdc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:09.614319 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:09.654888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7db2d2-874f-42e5-8c97-93609dedfdc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:19:09.656468 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7db2d2-874f-42e5-8c97-93609dedfdc3 service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:19:09.674067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 708/1428] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:19:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:19:10.530897 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53849d72-b54d-432d-8ca6-f8636e0803dc None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:10.531418 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53849d72-b54d-432d-8ca6-f8636e0803dc None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:10.531418 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53849d72-b54d-432d-8ca6-f8636e0803dc None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:10.532801 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 11:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:19:10.537780 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc505e8a-bfb6-4543-947f-1b4114a1782c None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:10.538167 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc505e8a-bfb6-4543-947f-1b4114a1782c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:10.538336 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc505e8a-bfb6-4543-947f-1b4114a1782c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:10.613749 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-cc505e8a-bfb6-4543-947f-1b4114a1782c None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:19:10.614992 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-cc505e8a-bfb6-4543-947f-1b4114a1782c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:10.711135 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 11:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:19:10.867758 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53849d72-b54d-432d-8ca6-f8636e0803dc None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:19:10.869296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-53849d72-b54d-432d-8ca6-f8636e0803dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:10.923741 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:11.023366 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53849d72-b54d-432d-8ca6-f8636e0803dc None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:19:11.133532 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fab7d-0fc6-494d-a7d7-49914c6e46a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:19:11.134152 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fab7d-0fc6-494d-a7d7-49914c6e46a0 service nova] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:11.134438 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fab7d-0fc6-494d-a7d7-49914c6e46a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:11.134715 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fab7d-0fc6-494d-a7d7-49914c6e46a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:11.136361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-f37fab7d-0fc6-494d-a7d7-49914c6e46a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:11.143153 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:11.227147 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37fab7d-0fc6-494d-a7d7-49914c6e46a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:19:11.228811 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37fab7d-0fc6-494d-a7d7-49914c6e46a0 service nova] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:19:11.250625 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 722/1431] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:19:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:19:12.237827 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d2e9f-5e14-4cd3-80df-2bff11b2a318 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:12.238521 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d2e9f-5e14-4cd3-80df-2bff11b2a318 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:12.238521 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d2e9f-5e14-4cd3-80df-2bff11b2a318 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:12.239783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 11:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:19:12.244680 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c92d7-c174-40cb-ad96-e1cfcb2de620 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:12.245110 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c92d7-c174-40cb-ad96-e1cfcb2de620 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:12.245359 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c92d7-c174-40cb-ad96-e1cfcb2de620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:12.320914 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-211c92d7-c174-40cb-ad96-e1cfcb2de620 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:19:12.322145 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-211c92d7-c174-40cb-ad96-e1cfcb2de620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:12.388188 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:12.416224 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 11:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:19:12.563601 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d2e9f-5e14-4cd3-80df-2bff11b2a318 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:19:12.565109 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9a3d2e9f-5e14-4cd3-80df-2bff11b2a318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:12.583007 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:12.713443 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d2e9f-5e14-4cd3-80df-2bff11b2a318 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:19:12.802113 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:12.828748 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ae0bb-1340-45e6-a659-409d32d71cc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:19:12.829341 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ae0bb-1340-45e6-a659-409d32d71cc1 service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:12.829629 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ae0bb-1340-45e6-a659-409d32d71cc1 service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:12.829950 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ae0bb-1340-45e6-a659-409d32d71cc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:12.831711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-743ae0bb-1340-45e6-a659-409d32d71cc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:12.920281 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ae0bb-1340-45e6-a659-409d32d71cc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:19:12.921909 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ae0bb-1340-45e6-a659-409d32d71cc1 service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:19:12.940110 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 711/1434] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:19:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:19:13.815413 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa13be4-7d1e-4ac3-a2c1-d718ef128484 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:13.815935 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa13be4-7d1e-4ac3-a2c1-d718ef128484 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:13.816065 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa13be4-7d1e-4ac3-a2c1-d718ef128484 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:13.817349 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 11:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:19:13.822478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a1fa8-b026-4fba-a387-b4d5f6f627b1 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:13.822873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a1fa8-b026-4fba-a387-b4d5f6f627b1 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:13.823036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a1fa8-b026-4fba-a387-b4d5f6f627b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:13.895792 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-e06a1fa8-b026-4fba-a387-b4d5f6f627b1 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:19:13.896916 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e06a1fa8-b026-4fba-a387-b4d5f6f627b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:13.939254 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:13.993657 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 11:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:19:14.143704 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa13be4-7d1e-4ac3-a2c1-d718ef128484 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:19:14.145266 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-aaa13be4-7d1e-4ac3-a2c1-d718ef128484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:14.297637 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa13be4-7d1e-4ac3-a2c1-d718ef128484 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:19:14.351175 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:14.409831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc9ed0-8401-4078-aa0c-ac1db8195fc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:19:14.410479 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc9ed0-8401-4078-aa0c-ac1db8195fc6 service nova] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:14.410763 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc9ed0-8401-4078-aa0c-ac1db8195fc6 service nova] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:14.411042 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc9ed0-8401-4078-aa0c-ac1db8195fc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:14.412694 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-4fbc9ed0-8401-4078-aa0c-ac1db8195fc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:14.500634 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc9ed0-8401-4078-aa0c-ac1db8195fc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:19:14.502193 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc9ed0-8401-4078-aa0c-ac1db8195fc6 service nova] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:19:14.520462 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 725/1437] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:19:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:19:15.411186 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83173637-41b5-4cc5-a494-7f027cbced52 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:15.411759 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83173637-41b5-4cc5-a494-7f027cbced52 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:15.411759 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83173637-41b5-4cc5-a494-7f027cbced52 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:15.413173 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 11:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:19:15.418812 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327bc98-f92c-4a20-843c-19c29052a9d9 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:15.419239 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327bc98-f92c-4a20-843c-19c29052a9d9 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:15.419386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327bc98-f92c-4a20-843c-19c29052a9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:15.492642 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-7327bc98-f92c-4a20-843c-19c29052a9d9 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:19:15.493872 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-7327bc98-f92c-4a20-843c-19c29052a9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:15.496017 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:15.590605 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 11:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:19:15.739986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83173637-41b5-4cc5-a494-7f027cbced52 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:19:15.741438 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-83173637-41b5-4cc5-a494-7f027cbced52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:15.885656 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83173637-41b5-4cc5-a494-7f027cbced52 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:19:15.911990 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:15.998189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09438776-8e55-4629-b820-4a6137871938 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:19:15.998763 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09438776-8e55-4629-b820-4a6137871938 service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:15.999045 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09438776-8e55-4629-b820-4a6137871938 service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:15.999319 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09438776-8e55-4629-b820-4a6137871938 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:16.000940 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-09438776-8e55-4629-b820-4a6137871938 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:16.087680 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09438776-8e55-4629-b820-4a6137871938 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:19:16.089272 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09438776-8e55-4629-b820-4a6137871938 service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:19:16.106649 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 714/1440] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:19:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:19:18.014611 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74a283-631c-43bd-a0fa-c9bc6859a041 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:18.015163 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74a283-631c-43bd-a0fa-c9bc6859a041 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:18.015163 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74a283-631c-43bd-a0fa-c9bc6859a041 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:18.016461 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 11:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:19:18.021886 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799029e-8002-4287-82ac-b420eb5378df None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:18.022282 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799029e-8002-4287-82ac-b420eb5378df None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:18.022449 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799029e-8002-4287-82ac-b420eb5378df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:18.061570 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:18.086957 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-a799029e-8002-4287-82ac-b420eb5378df None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:19:18.088168 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a799029e-8002-4287-82ac-b420eb5378df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:18.184355 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 11:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:19:18.223272 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74a283-631c-43bd-a0fa-c9bc6859a041 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:19:18.224810 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-0e74a283-631c-43bd-a0fa-c9bc6859a041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:18.329425 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74a283-631c-43bd-a0fa-c9bc6859a041 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:19:18.364271 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:18.405362 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0842ebc-c2a5-4afe-94dc-e3dff3b739b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:19:18.406036 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0842ebc-c2a5-4afe-94dc-e3dff3b739b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:18.406318 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0842ebc-c2a5-4afe-94dc-e3dff3b739b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:18.406595 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0842ebc-c2a5-4afe-94dc-e3dff3b739b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:18.408235 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-c0842ebc-c2a5-4afe-94dc-e3dff3b739b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:18.514437 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0842ebc-c2a5-4afe-94dc-e3dff3b739b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:19:18.515877 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0842ebc-c2a5-4afe-94dc-e3dff3b739b4 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:19:18.534470 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 728/1443] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:19:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:19:20.696354 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfe370-e81a-46a9-88fb-184b6f12ea23 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:20.696926 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfe370-e81a-46a9-88fb-184b6f12ea23 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:20.696926 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfe370-e81a-46a9-88fb-184b6f12ea23 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:20.698888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 11:19:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:19:20.704209 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c174c-2b52-4aa4-a157-ca3efdf33760 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:20.704636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c174c-2b52-4aa4-a157-ca3efdf33760 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:20.704773 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c174c-2b52-4aa4-a157-ca3efdf33760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:20.769632 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-d56c174c-2b52-4aa4-a157-ca3efdf33760 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:19:20.770868 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-d56c174c-2b52-4aa4-a157-ca3efdf33760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:20.783613 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:20.867017 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 11:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:19:20.904380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddfe370-e81a-46a9-88fb-184b6f12ea23 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:19:20.905949 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-eddfe370-e81a-46a9-88fb-184b6f12ea23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:21.007030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddfe370-e81a-46a9-88fb-184b6f12ea23 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:19:21.019241 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:21.080447 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487de17-9eb6-408b-8d73-f9c3717b63db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:19:21.081107 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487de17-9eb6-408b-8d73-f9c3717b63db service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:21.081391 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487de17-9eb6-408b-8d73-f9c3717b63db service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:21.081665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487de17-9eb6-408b-8d73-f9c3717b63db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:21.083351 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3487de17-9eb6-408b-8d73-f9c3717b63db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:21.189917 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487de17-9eb6-408b-8d73-f9c3717b63db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:19:21.191347 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487de17-9eb6-408b-8d73-f9c3717b63db service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:19:21.209702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 717/1446] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:19:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:19:23.584378 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8821cc3-49b7-4e27-ba32-1c852b878379 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:23.584913 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8821cc3-49b7-4e27-ba32-1c852b878379 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:23.585009 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8821cc3-49b7-4e27-ba32-1c852b878379 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:23.586361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 11:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:19:23.592024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10376c-2a2e-4cb4-9e49-88e20e9186c0 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:23.592424 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10376c-2a2e-4cb4-9e49-88e20e9186c0 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:23.592598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10376c-2a2e-4cb4-9e49-88e20e9186c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:23.638853 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:23.657660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-4d10376c-2a2e-4cb4-9e49-88e20e9186c0 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:19:23.658909 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4d10376c-2a2e-4cb4-9e49-88e20e9186c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:23.755730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 11:19:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:19:23.795360 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8821cc3-49b7-4e27-ba32-1c852b878379 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:19:23.796950 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-e8821cc3-49b7-4e27-ba32-1c852b878379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:23.900294 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8821cc3-49b7-4e27-ba32-1c852b878379 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:19:23.939440 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:23.973807 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f5dc9-7af1-4f95-9611-5aeafed3f6cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:19:23.974456 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f5dc9-7af1-4f95-9611-5aeafed3f6cf service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:23.974740 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f5dc9-7af1-4f95-9611-5aeafed3f6cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:23.975019 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f5dc9-7af1-4f95-9611-5aeafed3f6cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:23.976664 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-7a1f5dc9-7af1-4f95-9611-5aeafed3f6cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:24.082458 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f5dc9-7af1-4f95-9611-5aeafed3f6cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:19:24.083872 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f5dc9-7af1-4f95-9611-5aeafed3f6cf service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:19:24.101964 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 731/1449] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:19:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:19:26.298607 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f85e16-7273-45d0-95e7-965701ce83c4 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:26.299090 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f85e16-7273-45d0-95e7-965701ce83c4 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:26.299185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f85e16-7273-45d0-95e7-965701ce83c4 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:26.300563 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 11:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:19:26.305712 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc9848-0579-45a3-bff1-f8fa8d3a4525 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:26.306163 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc9848-0579-45a3-bff1-f8fa8d3a4525 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:26.306299 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc9848-0579-45a3-bff1-f8fa8d3a4525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:26.370846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-96bc9848-0579-45a3-bff1-f8fa8d3a4525 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:19:26.372044 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-96bc9848-0579-45a3-bff1-f8fa8d3a4525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:26.393971 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:26.470775 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 11:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:19:26.509073 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f85e16-7273-45d0-95e7-965701ce83c4 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:19:26.510689 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b7f85e16-7273-45d0-95e7-965701ce83c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:26.615523 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f85e16-7273-45d0-95e7-965701ce83c4 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:19:26.635188 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:26.688035 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973d29f-d520-467f-b898-3b4f9b2d4dd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:19:26.688692 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973d29f-d520-467f-b898-3b4f9b2d4dd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:26.688986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973d29f-d520-467f-b898-3b4f9b2d4dd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:26.689268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973d29f-d520-467f-b898-3b4f9b2d4dd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:26.690962 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1973d29f-d520-467f-b898-3b4f9b2d4dd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:26.803715 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973d29f-d520-467f-b898-3b4f9b2d4dd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:19:26.805147 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973d29f-d520-467f-b898-3b4f9b2d4dd2 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:19:26.824664 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 720/1452] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:19:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:19:28.999679 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b27fc3-4607-484b-bed1-9ed14a8e0124 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:29.000240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b27fc3-4607-484b-bed1-9ed14a8e0124 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:29.000240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b27fc3-4607-484b-bed1-9ed14a8e0124 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:29.001626 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 11:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:19:29.006828 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c651e-8cdc-4daf-bab1-e3eef531d826 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:29.007209 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c651e-8cdc-4daf-bab1-e3eef531d826 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:29.007402 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c651e-8cdc-4daf-bab1-e3eef531d826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:29.071491 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:29.074589 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-6e9c651e-8cdc-4daf-bab1-e3eef531d826 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:19:29.075801 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6e9c651e-8cdc-4daf-bab1-e3eef531d826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:29.174556 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 11:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:19:29.212303 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b27fc3-4607-484b-bed1-9ed14a8e0124 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:19:29.213925 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-72b27fc3-4607-484b-bed1-9ed14a8e0124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:29.315079 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b27fc3-4607-484b-bed1-9ed14a8e0124 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:19:29.364528 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:29.389779 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a141d7-ac59-4c6d-a2d7-9f62933e591e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:19:29.390433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a141d7-ac59-4c6d-a2d7-9f62933e591e service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:29.390720 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a141d7-ac59-4c6d-a2d7-9f62933e591e service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:29.390999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a141d7-ac59-4c6d-a2d7-9f62933e591e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:29.392640 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-c6a141d7-ac59-4c6d-a2d7-9f62933e591e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:29.499732 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a141d7-ac59-4c6d-a2d7-9f62933e591e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:19:29.501174 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a141d7-ac59-4c6d-a2d7-9f62933e591e service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:19:29.518977 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 734/1455] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:19:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:19:31.583952 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d72e1-8d2a-4c5b-b7ab-5ea566f894ed None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:31.584557 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d72e1-8d2a-4c5b-b7ab-5ea566f894ed None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:31.584661 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d72e1-8d2a-4c5b-b7ab-5ea566f894ed None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:31.586096 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 11:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:19:31.591645 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5658ed-38af-4c0b-8498-694400204410 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:31.592047 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5658ed-38af-4c0b-8498-694400204410 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:31.592201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5658ed-38af-4c0b-8498-694400204410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:31.656732 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-0c5658ed-38af-4c0b-8498-694400204410 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:19:31.657943 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-0c5658ed-38af-4c0b-8498-694400204410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:31.686497 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:31.752257 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 11:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:19:31.790986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d72e1-8d2a-4c5b-b7ab-5ea566f894ed None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:19:31.793553 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-875d72e1-8d2a-4c5b-b7ab-5ea566f894ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:31.897482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d72e1-8d2a-4c5b-b7ab-5ea566f894ed None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:19:31.925159 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:31.969417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ec187-3110-4d7e-8d66-0b9e4329f469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:19:31.970102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ec187-3110-4d7e-8d66-0b9e4329f469 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:31.970381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ec187-3110-4d7e-8d66-0b9e4329f469 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:31.970653 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ec187-3110-4d7e-8d66-0b9e4329f469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:31.972273 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9d1ec187-3110-4d7e-8d66-0b9e4329f469 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:32.079039 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ec187-3110-4d7e-8d66-0b9e4329f469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:19:32.080463 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ec187-3110-4d7e-8d66-0b9e4329f469 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:19:32.098025 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 723/1458] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:19:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:19:34.159066 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f57a2-268e-4e82-b8ab-4a3f3890ee60 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:34.159645 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f57a2-268e-4e82-b8ab-4a3f3890ee60 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:34.159645 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f57a2-268e-4e82-b8ab-4a3f3890ee60 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:34.160990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 11:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:19:34.166166 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210721a3-1a1f-49d7-819d-2e0fa48b9e4e None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:34.167042 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210721a3-1a1f-49d7-819d-2e0fa48b9e4e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:34.167256 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210721a3-1a1f-49d7-819d-2e0fa48b9e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:34.230946 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-210721a3-1a1f-49d7-819d-2e0fa48b9e4e None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:19:34.232149 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-210721a3-1a1f-49d7-819d-2e0fa48b9e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:34.240350 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:34.330821 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 11:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:19:34.368018 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f57a2-268e-4e82-b8ab-4a3f3890ee60 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:19:34.369565 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-b50f57a2-268e-4e82-b8ab-4a3f3890ee60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:34.471930 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f57a2-268e-4e82-b8ab-4a3f3890ee60 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:19:34.526822 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:34.545309 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604644b8-28bf-46ea-b216-7d6ff9595aca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:19:34.546204 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604644b8-28bf-46ea-b216-7d6ff9595aca service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:34.546667 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604644b8-28bf-46ea-b216-7d6ff9595aca service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:34.547182 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604644b8-28bf-46ea-b216-7d6ff9595aca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:34.548860 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-604644b8-28bf-46ea-b216-7d6ff9595aca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:34.656109 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604644b8-28bf-46ea-b216-7d6ff9595aca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:19:34.657582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604644b8-28bf-46ea-b216-7d6ff9595aca service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:19:34.675409 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 737/1461] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:19:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:19:36.738861 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7222b6-7492-4c53-b0ce-2e8453e4f244 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:36.742331 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7222b6-7492-4c53-b0ce-2e8453e4f244 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:36.742331 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7222b6-7492-4c53-b0ce-2e8453e4f244 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:36.742331 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 11:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:19:36.746432 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f9e2d-4287-4c3f-b68d-5da147fdbb0c None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:36.746827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f9e2d-4287-4c3f-b68d-5da147fdbb0c None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:36.746991 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f9e2d-4287-4c3f-b68d-5da147fdbb0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:36.813125 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-cf6f9e2d-4287-4c3f-b68d-5da147fdbb0c None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:19:36.814344 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-cf6f9e2d-4287-4c3f-b68d-5da147fdbb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:36.852741 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:36.910308 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 11:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:19:36.947580 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7222b6-7492-4c53-b0ce-2e8453e4f244 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:19:36.949807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-bf7222b6-7492-4c53-b0ce-2e8453e4f244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:37.050346 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7222b6-7492-4c53-b0ce-2e8453e4f244 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:19:37.087482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:37.123798 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bee22d-c07e-4c0f-9b24-0ce48f685f34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:19:37.124456 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bee22d-c07e-4c0f-9b24-0ce48f685f34 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:37.124743 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bee22d-c07e-4c0f-9b24-0ce48f685f34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:37.125020 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bee22d-c07e-4c0f-9b24-0ce48f685f34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:37.126758 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-86bee22d-c07e-4c0f-9b24-0ce48f685f34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:37.237881 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bee22d-c07e-4c0f-9b24-0ce48f685f34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:19:37.239309 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bee22d-c07e-4c0f-9b24-0ce48f685f34 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:19:37.257524 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 726/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:19:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:19:39.303233 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b501232-eb41-498e-8160-5b147cafc191 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:39.303794 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b501232-eb41-498e-8160-5b147cafc191 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:39.303794 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b501232-eb41-498e-8160-5b147cafc191 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:39.305284 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 11:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:19:39.311517 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208740e8-9c36-4e74-b8ca-0530b761273b None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:39.314314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208740e8-9c36-4e74-b8ca-0530b761273b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:39.314314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208740e8-9c36-4e74-b8ca-0530b761273b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:39.375494 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-208740e8-9c36-4e74-b8ca-0530b761273b None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:19:39.376793 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-208740e8-9c36-4e74-b8ca-0530b761273b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:39.395035 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:39.473944 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 11:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:19:39.511758 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b501232-eb41-498e-8160-5b147cafc191 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:19:39.513298 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-4b501232-eb41-498e-8160-5b147cafc191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:39.615895 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b501232-eb41-498e-8160-5b147cafc191 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:19:39.681065 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:39.688393 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc81921-069f-4077-956a-15d1a97b7149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:19:39.689045 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc81921-069f-4077-956a-15d1a97b7149 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:39.689331 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc81921-069f-4077-956a-15d1a97b7149 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:39.689612 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc81921-069f-4077-956a-15d1a97b7149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:39.691318 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-cfc81921-069f-4077-956a-15d1a97b7149 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:39.801530 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc81921-069f-4077-956a-15d1a97b7149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:19:39.803066 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc81921-069f-4077-956a-15d1a97b7149 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:19:39.821076 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 740/1467] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:19:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:19:41.999791 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7ee4b-3d66-4454-9f0c-c0ebdc43b885 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:41.999791 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7ee4b-3d66-4454-9f0c-c0ebdc43b885 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:41.999791 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7ee4b-3d66-4454-9f0c-c0ebdc43b885 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:41.999791 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 11:19:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:19:42.000711 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09923e4-7ff4-443b-bc3a-ad25387c88a0 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:42.000711 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09923e4-7ff4-443b-bc3a-ad25387c88a0 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:42.000711 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09923e4-7ff4-443b-bc3a-ad25387c88a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:42.038304 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-e09923e4-7ff4-443b-bc3a-ad25387c88a0 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:19:42.039488 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-e09923e4-7ff4-443b-bc3a-ad25387c88a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:42.086472 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:42.133866 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 11:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:19:42.173063 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7ee4b-3d66-4454-9f0c-c0ebdc43b885 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:19:42.174663 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ecf7ee4b-3d66-4454-9f0c-c0ebdc43b885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:42.277376 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7ee4b-3d66-4454-9f0c-c0ebdc43b885 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:19:42.324216 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:42.349440 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebfc1a-67c0-402e-ba4c-35733de321e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:19:42.350113 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebfc1a-67c0-402e-ba4c-35733de321e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:19:42.350396 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebfc1a-67c0-402e-ba4c-35733de321e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:19:42.350672 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebfc1a-67c0-402e-ba4c-35733de321e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:19:42.352306 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f5ebfc1a-67c0-402e-ba4c-35733de321e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:19:42.457826 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ebfc1a-67c0-402e-ba4c-35733de321e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:19:42.459257 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ebfc1a-67c0-402e-ba4c-35733de321e5 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:19:42.477845 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 729/1470] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:19:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:19:52.132044 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=22 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:19:52.475635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=66 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:20:02.168923 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86eec1-3952-43b8-8a2d-0d08ac3e98bb None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:20:02.169485 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86eec1-3952-43b8-8a2d-0d08ac3e98bb None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:20:02.169584 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86eec1-3952-43b8-8a2d-0d08ac3e98bb None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:20:02.171053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 742/1471] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:20:02.176374 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb1379-ec4f-41ec-b4b3-969a21196d41 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:20:02.176850 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb1379-ec4f-41ec-b4b3-969a21196d41 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:20:02.176967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb1379-ec4f-41ec-b4b3-969a21196d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:20:02.240070 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-4cdb1379-ec4f-41ec-b4b3-969a21196d41 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:20:02.241270 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4cdb1379-ec4f-41ec-b4b3-969a21196d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:20:02.335231 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 730/1472] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:20:02.419866 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aed715-db78-450e-bfbe-dcf6b01dd855 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:20:02.420111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aed715-db78-450e-bfbe-dcf6b01dd855 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:20:02.420396 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aed715-db78-450e-bfbe-dcf6b01dd855 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:20:02.421847 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 743/1473] 10.222.0.23 () {54 vars in 962 bytes} [Mon Jul 11 11:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:20:02.426757 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276bced-64d1-4a53-bf1f-3cf6204e07d8 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:20:02.427055 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276bced-64d1-4a53-bf1f-3cf6204e07d8 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:20:02.427340 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276bced-64d1-4a53-bf1f-3cf6204e07d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:20:02.501679 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-2276bced-64d1-4a53-bf1f-3cf6204e07d8 None None] MFA Rules not processed for user `65a2d8d24562459493a3bcd399665a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:20:02.502909 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2276bced-64d1-4a53-bf1f-3cf6204e07d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:20:02.523226 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:20:02.578999 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 731/1474] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Jul 11 11:20:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:20:02.586918 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aed715-db78-450e-bfbe-dcf6b01dd855 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:20:02.589224 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-66aed715-db78-450e-bfbe-dcf6b01dd855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:20:02.692434 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aed715-db78-450e-bfbe-dcf6b01dd855 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:20:02.767460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420dcf8-11e7-403f-abfc-0fac77f29786 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a2d8d24562459493a3bcd399665a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:20:02.768144 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420dcf8-11e7-403f-abfc-0fac77f29786 service glance] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:20:02.768433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420dcf8-11e7-403f-abfc-0fac77f29786 service glance] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:20:02.768715 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420dcf8-11e7-403f-abfc-0fac77f29786 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:20:02.770456 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-8420dcf8-11e7-403f-abfc-0fac77f29786 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:20:02.825742 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:20:02.880961 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420dcf8-11e7-403f-abfc-0fac77f29786 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:20:02.882545 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420dcf8-11e7-403f-abfc-0fac77f29786 service glance] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:20:02.900799 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 744/1475] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:20:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:20:05.000657 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f56b8-58d5-40b7-b247-a65cbd4d8400 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:20:05.001249 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f56b8-58d5-40b7-b247-a65cbd4d8400 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:20:05.001249 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f56b8-58d5-40b7-b247-a65cbd4d8400 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:20:05.002648 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 732/1476] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:20:05.007876 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ec243-85b6-44dd-b902-310253b9da18 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:20:05.008253 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ec243-85b6-44dd-b902-310253b9da18 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:20:05.008431 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ec243-85b6-44dd-b902-310253b9da18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:20:05.073100 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-db4ec243-85b6-44dd-b902-310253b9da18 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:20:05.074312 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-db4ec243-85b6-44dd-b902-310253b9da18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:20:05.170890 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 745/1477] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:20:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:20:05.194279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f56b8-58d5-40b7-b247-a65cbd4d8400 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:20:05.195809 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e13f56b8-58d5-40b7-b247-a65cbd4d8400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:20:05.320360 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f56b8-58d5-40b7-b247-a65cbd4d8400 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:20:05.370469 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:20:05.414708 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b0a2d-6562-41e4-bd26-0024d2fc8c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:20:05.415374 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b0a2d-6562-41e4-bd26-0024d2fc8c43 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:20:05.415710 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b0a2d-6562-41e4-bd26-0024d2fc8c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:20:05.416500 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b0a2d-6562-41e4-bd26-0024d2fc8c43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:20:05.417263 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b0a2d-6562-41e4-bd26-0024d2fc8c43 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:20:05.419142 dv-cinder-848429-2-smb devstack@keystone.service[80521]: WARNING py.warnings [None req-d88b0a2d-6562-41e4-bd26-0024d2fc8c43 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 11:20:05.419142 dv-cinder-848429-2-smb devstack@keystone.service[80521]: warnings.warn(msg) Jul 11 11:20:05.419142 dv-cinder-848429-2-smb devstack@keystone.service[80521]: Jul 11 11:20:05.420502 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b0a2d-6562-41e4-bd26-0024d2fc8c43 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:20:05.439815 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 733/1478] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jul 11 11:20:05 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:20:07.460880 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11375931-f620-4be6-adbc-e43f3a8d9767 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:20:07.461457 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11375931-f620-4be6-adbc-e43f3a8d9767 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:20:07.461457 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11375931-f620-4be6-adbc-e43f3a8d9767 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:20:07.463617 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 746/1479] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:20:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:20:07.468964 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd7df0-533d-4354-8b94-4385711cdcea None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:20:07.469402 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd7df0-533d-4354-8b94-4385711cdcea None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:20:07.469538 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd7df0-533d-4354-8b94-4385711cdcea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:20:07.533715 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-94cd7df0-533d-4354-8b94-4385711cdcea None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:20:07.534985 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-94cd7df0-533d-4354-8b94-4385711cdcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:20:07.630358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 734/1480] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:20:07.675059 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11375931-f620-4be6-adbc-e43f3a8d9767 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:20:07.676700 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-11375931-f620-4be6-adbc-e43f3a8d9767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:20:07.686887 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:20:07.824763 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11375931-f620-4be6-adbc-e43f3a8d9767 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:20:07.905100 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:20:07.936445 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15b9aa-ccb1-494f-9431-4a6e177f05f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:20:07.937132 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15b9aa-ccb1-494f-9431-4a6e177f05f8 service nova] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:20:07.937603 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15b9aa-ccb1-494f-9431-4a6e177f05f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:20:07.937960 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15b9aa-ccb1-494f-9431-4a6e177f05f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:20:07.940049 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-6e15b9aa-ccb1-494f-9431-4a6e177f05f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:20:08.029448 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15b9aa-ccb1-494f-9431-4a6e177f05f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:20:08.031033 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15b9aa-ccb1-494f-9431-4a6e177f05f8 service nova] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:20:08.050974 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 747/1481] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:20:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:20:10.224792 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c420f-7da5-4863-835e-7b759a794d7a None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:20:10.225362 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c420f-7da5-4863-835e-7b759a794d7a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:20:10.225362 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c420f-7da5-4863-835e-7b759a794d7a None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:20:10.226788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 735/1482] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:20:10.232003 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee4691-535f-445e-a694-f01a44de83fc None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:20:10.232408 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee4691-535f-445e-a694-f01a44de83fc None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:20:10.232559 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee4691-535f-445e-a694-f01a44de83fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:20:10.296799 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-1eee4691-535f-445e-a694-f01a44de83fc None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:20:10.298011 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-1eee4691-535f-445e-a694-f01a44de83fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:20:10.347359 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:20:10.398887 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 748/1483] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:20:10.435281 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c420f-7da5-4863-835e-7b759a794d7a None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:20:10.436844 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ab1c420f-7da5-4863-835e-7b759a794d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:20:10.459781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:20:10.541626 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c420f-7da5-4863-835e-7b759a794d7a None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:20:10.616343 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059b2e4-7636-4931-b319-629479014d1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:20:10.616997 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059b2e4-7636-4931-b319-629479014d1a service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:20:10.617286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059b2e4-7636-4931-b319-629479014d1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:20:10.617566 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059b2e4-7636-4931-b319-629479014d1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:20:10.619857 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-0059b2e4-7636-4931-b319-629479014d1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:20:10.694794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:20:10.730085 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059b2e4-7636-4931-b319-629479014d1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:20:10.731634 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059b2e4-7636-4931-b319-629479014d1a service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:20:10.750183 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 736/1484] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:20:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:20:12.809883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cff4ed-12c5-411f-94e8-0a60e98ae4a8 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:20:12.810385 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cff4ed-12c5-411f-94e8-0a60e98ae4a8 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:20:12.810497 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cff4ed-12c5-411f-94e8-0a60e98ae4a8 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:20:12.811876 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 749/1485] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:20:12.817097 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a40844-b5e7-4512-bc53-1f9257d88d59 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:20:12.817542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a40844-b5e7-4512-bc53-1f9257d88d59 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:20:12.817651 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a40844-b5e7-4512-bc53-1f9257d88d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:20:12.881398 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-91a40844-b5e7-4512-bc53-1f9257d88d59 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:20:12.882619 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-91a40844-b5e7-4512-bc53-1f9257d88d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:20:12.978922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 737/1486] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:20:13.015738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cff4ed-12c5-411f-94e8-0a60e98ae4a8 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:20:13.017272 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-98cff4ed-12c5-411f-94e8-0a60e98ae4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:20:13.120514 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cff4ed-12c5-411f-94e8-0a60e98ae4a8 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:20:13.190480 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:20:13.192073 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb60c31-1795-4676-9cc3-c91ded817682 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:20:13.192765 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb60c31-1795-4676-9cc3-c91ded817682 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:20:13.193054 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb60c31-1795-4676-9cc3-c91ded817682 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:20:13.193329 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb60c31-1795-4676-9cc3-c91ded817682 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:20:13.195271 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-7bb60c31-1795-4676-9cc3-c91ded817682 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:20:13.302331 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb60c31-1795-4676-9cc3-c91ded817682 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:20:13.303772 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb60c31-1795-4676-9cc3-c91ded817682 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:20:13.323514 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 750/1487] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:20:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:20:15.474033 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108fc95-8753-4710-9bcd-ea4f4d1eadaa None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:20:15.474599 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108fc95-8753-4710-9bcd-ea4f4d1eadaa None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:20:15.474599 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108fc95-8753-4710-9bcd-ea4f4d1eadaa None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:20:15.476015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 738/1488] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:20:15.482074 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716ecad-8f89-4f28-aadb-2300484a0dba None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:20:15.482498 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716ecad-8f89-4f28-aadb-2300484a0dba None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:20:15.482634 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716ecad-8f89-4f28-aadb-2300484a0dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:20:15.546533 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-5716ecad-8f89-4f28-aadb-2300484a0dba None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:20:15.547767 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-5716ecad-8f89-4f28-aadb-2300484a0dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:20:15.599730 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:20:15.646106 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 751/1489] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:20:15.686712 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108fc95-8753-4710-9bcd-ea4f4d1eadaa None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:20:15.688385 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a108fc95-8753-4710-9bcd-ea4f4d1eadaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:20:15.725078 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:20:15.794711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108fc95-8753-4710-9bcd-ea4f4d1eadaa None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:20:15.867234 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0e37a-6d47-44d6-bf24-9092f65cf888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:20:15.867879 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0e37a-6d47-44d6-bf24-9092f65cf888 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:20:15.868160 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0e37a-6d47-44d6-bf24-9092f65cf888 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:20:15.868439 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0e37a-6d47-44d6-bf24-9092f65cf888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:20:15.870794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c2c0e37a-6d47-44d6-bf24-9092f65cf888 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:20:15.948581 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:20:16.016218 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0e37a-6d47-44d6-bf24-9092f65cf888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:20:16.016218 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0e37a-6d47-44d6-bf24-9092f65cf888 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:20:16.016218 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 739/1490] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:20:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:20:18.398219 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18053d7e-f33a-406d-9418-ed846ca657e6 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:20:18.398764 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18053d7e-f33a-406d-9418-ed846ca657e6 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:20:18.398764 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18053d7e-f33a-406d-9418-ed846ca657e6 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:20:18.400735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 752/1491] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jul 11 11:20:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:20:18.406044 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eaad61-c949-449f-955b-9e1c3d583f9f None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:20:18.406446 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eaad61-c949-449f-955b-9e1c3d583f9f None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:20:18.406646 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eaad61-c949-449f-955b-9e1c3d583f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:20:18.472095 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-b0eaad61-c949-449f-955b-9e1c3d583f9f None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:20:18.473301 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b0eaad61-c949-449f-955b-9e1c3d583f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:20:18.568274 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 740/1492] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jul 11 11:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:20:18.607214 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18053d7e-f33a-406d-9418-ed846ca657e6 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:20:18.608744 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-18053d7e-f33a-406d-9418-ed846ca657e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:20:18.710069 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18053d7e-f33a-406d-9418-ed846ca657e6 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:20:18.786829 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c2f87-3fe4-4648-8ba5-fbf2a2d47650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:20:18.787476 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c2f87-3fe4-4648-8ba5-fbf2a2d47650 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:20:18.787764 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c2f87-3fe4-4648-8ba5-fbf2a2d47650 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:20:18.788043 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c2f87-3fe4-4648-8ba5-fbf2a2d47650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:20:18.789697 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-da2c2f87-3fe4-4648-8ba5-fbf2a2d47650 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:20:18.798835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:20:18.899433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c2f87-3fe4-4648-8ba5-fbf2a2d47650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:20:18.900991 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c2f87-3fe4-4648-8ba5-fbf2a2d47650 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:20:18.918595 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 753/1493] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:20:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:20:28.566471 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=82 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:20:28.916559 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=50 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:21:56.513621 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2a9db-7d49-4366-86b5-9c0274a25b4d None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:21:56.514371 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2a9db-7d49-4366-86b5-9c0274a25b4d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:21:56.514371 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2a9db-7d49-4366-86b5-9c0274a25b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:21:56.587920 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-b5a2a9db-7d49-4366-86b5-9c0274a25b4d None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:21:56.589140 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b5a2a9db-7d49-4366-86b5-9c0274a25b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:21:56.804852 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 741/1494] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:21:56.813097 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aae1ea-70b6-41ff-b467-c3b0fcd55758 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:21:56.813564 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aae1ea-70b6-41ff-b467-c3b0fcd55758 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:21:56.813670 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aae1ea-70b6-41ff-b467-c3b0fcd55758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:21:56.891260 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-03aae1ea-70b6-41ff-b467-c3b0fcd55758 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:21:56.892465 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-03aae1ea-70b6-41ff-b467-c3b0fcd55758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:21:56.988213 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 754/1495] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:21:56.993460 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2a9db-7d49-4366-86b5-9c0274a25b4d None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:21:56.994690 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b5a2a9db-7d49-4366-86b5-9c0274a25b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:21:57.005806 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2a9db-7d49-4366-86b5-9c0274a25b4d None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:21:57.066516 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:21:57.099625 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea85723-52f3-4e60-8a7d-9326fc10d40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:21:57.100330 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea85723-52f3-4e60-8a7d-9326fc10d40e admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:21:57.100691 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea85723-52f3-4e60-8a7d-9326fc10d40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:21:57.100976 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea85723-52f3-4e60-8a7d-9326fc10d40e admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:21:57.101692 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea85723-52f3-4e60-8a7d-9326fc10d40e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:21:57.102031 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea85723-52f3-4e60-8a7d-9326fc10d40e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:21:57.103049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: WARNING py.warnings [None req-7ea85723-52f3-4e60-8a7d-9326fc10d40e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 11:21:57.103049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: warnings.warn(msg) Jul 11 11:21:57.103049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: Jul 11 11:21:57.103917 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea85723-52f3-4e60-8a7d-9326fc10d40e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:21:57.115104 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 742/1496] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:21:57.123885 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aae1ea-70b6-41ff-b467-c3b0fcd55758 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:21:57.133615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aae1ea-70b6-41ff-b467-c3b0fcd55758 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:21:57.195914 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:21:57.229238 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563e227-d921-4a78-8082-e720e820b168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:21:57.230179 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563e227-d921-4a78-8082-e720e820b168 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:21:57.230556 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563e227-d921-4a78-8082-e720e820b168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:21:57.231091 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563e227-d921-4a78-8082-e720e820b168 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:21:57.231834 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563e227-d921-4a78-8082-e720e820b168 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:21:57.233600 dv-cinder-848429-2-smb devstack@keystone.service[80522]: WARNING py.warnings [None req-6563e227-d921-4a78-8082-e720e820b168 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 11:21:57.233600 dv-cinder-848429-2-smb devstack@keystone.service[80522]: warnings.warn(msg) Jul 11 11:21:57.233600 dv-cinder-848429-2-smb devstack@keystone.service[80522]: Jul 11 11:21:57.234826 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563e227-d921-4a78-8082-e720e820b168 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:21:57.342121 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 755/1497] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:21:57 2022] POST /identity/v3/projects => generated 377 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:21:57.346200 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea85723-52f3-4e60-8a7d-9326fc10d40e admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:21:57.347782 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7ea85723-52f3-4e60-8a7d-9326fc10d40e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:21:57.382308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea85723-52f3-4e60-8a7d-9326fc10d40e admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:21:57.473832 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113f74a-a51c-449c-b821-c1dc12e24251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:21:57.474490 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113f74a-a51c-449c-b821-c1dc12e24251 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:21:57.474771 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113f74a-a51c-449c-b821-c1dc12e24251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:21:57.475562 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113f74a-a51c-449c-b821-c1dc12e24251 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:21:57.476239 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c113f74a-a51c-449c-b821-c1dc12e24251 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:21:57.477239 dv-cinder-848429-2-smb devstack@keystone.service[80521]: WARNING py.warnings [None req-c113f74a-a51c-449c-b821-c1dc12e24251 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 11:21:57.477239 dv-cinder-848429-2-smb devstack@keystone.service[80521]: warnings.warn(msg) Jul 11 11:21:57.477239 dv-cinder-848429-2-smb devstack@keystone.service[80521]: Jul 11 11:21:57.478455 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c113f74a-a51c-449c-b821-c1dc12e24251 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:21:57.624203 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 743/1498] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:21:57 2022] POST /identity/v3/users => generated 289 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:21:57.628214 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563e227-d921-4a78-8082-e720e820b168 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:21:57.629785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-6563e227-d921-4a78-8082-e720e820b168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:21:57.692011 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563e227-d921-4a78-8082-e720e820b168 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:21:57.777670 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:21:57.788276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c3382-a5a5-46a1-9c23-156066960dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:21:57.788941 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c3382-a5a5-46a1-9c23-156066960dfb admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:21:57.789209 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c3382-a5a5-46a1-9c23-156066960dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:21:57.789485 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c3382-a5a5-46a1-9c23-156066960dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:21:57.790249 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c3382-a5a5-46a1-9c23-156066960dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:21:57.791254 dv-cinder-848429-2-smb devstack@keystone.service[80522]: WARNING py.warnings [None req-a76c3382-a5a5-46a1-9c23-156066960dfb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 11:21:57.791254 dv-cinder-848429-2-smb devstack@keystone.service[80522]: warnings.warn(msg) Jul 11 11:21:57.791254 dv-cinder-848429-2-smb devstack@keystone.service[80522]: Jul 11 11:21:57.792133 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c3382-a5a5-46a1-9c23-156066960dfb admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:21:57.804378 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 756/1499] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:21:57.808391 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113f74a-a51c-449c-b821-c1dc12e24251 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:21:57.810907 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c113f74a-a51c-449c-b821-c1dc12e24251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:21:57.821329 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113f74a-a51c-449c-b821-c1dc12e24251 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:21:57.846462 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:21:57.916255 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4bcce-c361-4f91-b45c-c53dc45aa872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:21:57.916870 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4bcce-c361-4f91-b45c-c53dc45aa872 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:21:57.917139 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4bcce-c361-4f91-b45c-c53dc45aa872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:21:57.917418 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4bcce-c361-4f91-b45c-c53dc45aa872 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:21:57.918183 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4bcce-c361-4f91-b45c-c53dc45aa872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:21:57.919185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: WARNING py.warnings [None req-81d4bcce-c361-4f91-b45c-c53dc45aa872 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 11:21:57.919185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: warnings.warn(msg) Jul 11 11:21:57.919185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: Jul 11 11:21:57.920062 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4bcce-c361-4f91-b45c-c53dc45aa872 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:21:57.932827 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 744/1500] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:21:57.937120 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c3382-a5a5-46a1-9c23-156066960dfb admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:21:57.938694 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-a76c3382-a5a5-46a1-9c23-156066960dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:21:57.972167 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c3382-a5a5-46a1-9c23-156066960dfb admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:21:58.065165 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b8de6-62c1-4939-ad69-bdb064a8355c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:21:58.066082 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b8de6-62c1-4939-ad69-bdb064a8355c admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:21:58.066387 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b8de6-62c1-4939-ad69-bdb064a8355c admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:21:58.066652 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b8de6-62c1-4939-ad69-bdb064a8355c admin admin] PATH_INFO: `/v3/projects/b678127458884ff4b144230f54410891/users/f7bb7feb3df746b3a9038ef986527723/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:21:58.089058 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b8de6-62c1-4939-ad69-bdb064a8355c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b678127458884ff4b144230f54410891, user_id=f7bb7feb3df746b3a9038ef986527723, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:21:58.090167 dv-cinder-848429-2-smb devstack@keystone.service[80522]: WARNING py.warnings [None req-996b8de6-62c1-4939-ad69-bdb064a8355c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 11:21:58.090167 dv-cinder-848429-2-smb devstack@keystone.service[80522]: warnings.warn(msg) Jul 11 11:21:58.090167 dv-cinder-848429-2-smb devstack@keystone.service[80522]: Jul 11 11:21:58.092083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b8de6-62c1-4939-ad69-bdb064a8355c admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:21:58.206968 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 757/1501] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:21:57 2022] PUT /identity/v3/projects/b678127458884ff4b144230f54410891/users/f7bb7feb3df746b3a9038ef986527723/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:21:58.222975 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b10f6-f381-402d-adc2-6334e8882ef6 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:21:58.223270 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b10f6-f381-402d-adc2-6334e8882ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:21:58.223550 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b10f6-f381-402d-adc2-6334e8882ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:21:58.278758 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-7d0b10f6-f381-402d-adc2-6334e8882ef6 None None] MFA Rules not processed for user `f7bb7feb3df746b3a9038ef986527723`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:21:58.279950 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7d0b10f6-f381-402d-adc2-6334e8882ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:21:58.358341 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 745/1502] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:21:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:21:58.372335 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bed92f-92c8-407c-a5b7-9bbf8c99fcf8 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:21:58.372635 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bed92f-92c8-407c-a5b7-9bbf8c99fcf8 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:21:58.372922 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bed92f-92c8-407c-a5b7-9bbf8c99fcf8 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:21:58.374424 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 758/1503] 10.222.0.23 () {54 vars in 963 bytes} [Mon Jul 11 11:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:21:58.379448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b00aa1-4af0-42a3-9ea8-0dfe9a98eab5 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:21:58.379739 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b00aa1-4af0-42a3-9ea8-0dfe9a98eab5 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:21:58.380015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b00aa1-4af0-42a3-9ea8-0dfe9a98eab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:21:58.410745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:21:58.457915 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-c5b00aa1-4af0-42a3-9ea8-0dfe9a98eab5 None None] MFA Rules not processed for user `3096077887344140805ec8a23fe72f48`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:21:58.459075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c5b00aa1-4af0-42a3-9ea8-0dfe9a98eab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:21:58.537982 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 746/1504] 10.222.0.23 () {58 vars in 1060 bytes} [Mon Jul 11 11:21:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:21:58.545806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bed92f-92c8-407c-a5b7-9bbf8c99fcf8 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:21:58.547355 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-19bed92f-92c8-407c-a5b7-9bbf8c99fcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:21:58.598068 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:21:58.650909 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bed92f-92c8-407c-a5b7-9bbf8c99fcf8 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:21:58.723644 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca2d20-c292-4744-b8ff-bc8ddc7c5c58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:21:58.724210 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca2d20-c292-4744-b8ff-bc8ddc7c5c58 service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:21:58.724492 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca2d20-c292-4744-b8ff-bc8ddc7c5c58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:21:58.724766 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca2d20-c292-4744-b8ff-bc8ddc7c5c58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:21:58.726474 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-e9ca2d20-c292-4744-b8ff-bc8ddc7c5c58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:21:58.824898 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca2d20-c292-4744-b8ff-bc8ddc7c5c58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:21:58.826371 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca2d20-c292-4744-b8ff-bc8ddc7c5c58 service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:21:58.829883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:21:58.845038 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 759/1505] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:21:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:21:58.889020 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9574d04-4c78-447c-a1f9-58d0f9489455 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:21:58.889459 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9574d04-4c78-447c-a1f9-58d0f9489455 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:21:58.889629 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9574d04-4c78-447c-a1f9-58d0f9489455 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:21:58.891067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 747/1506] 10.222.0.23 () {52 vars in 829 bytes} [Mon Jul 11 11:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:21:58.894536 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca2d20-c292-4744-b8ff-bc8ddc7c5c58 service cinder] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:21:58.895751 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-e9ca2d20-c292-4744-b8ff-bc8ddc7c5c58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:21:58.995324 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca2d20-c292-4744-b8ff-bc8ddc7c5c58 service cinder] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:21:59.086488 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f24637-eb12-4cf9-b79f-9cc196635542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:21:59.087361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f24637-eb12-4cf9-b79f-9cc196635542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:21:59.087643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f24637-eb12-4cf9-b79f-9cc196635542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:21:59.087914 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f24637-eb12-4cf9-b79f-9cc196635542 admin admin] PATH_INFO: `/v3/users/f7bb7feb3df746b3a9038ef986527723` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:21:59.099816 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f24637-eb12-4cf9-b79f-9cc196635542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7bb7feb3df746b3a9038ef986527723)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:21:59.101378 dv-cinder-848429-2-smb devstack@keystone.service[80522]: WARNING py.warnings [None req-78f24637-eb12-4cf9-b79f-9cc196635542 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 11:21:59.101378 dv-cinder-848429-2-smb devstack@keystone.service[80522]: warnings.warn(msg) Jul 11 11:21:59.101378 dv-cinder-848429-2-smb devstack@keystone.service[80522]: Jul 11 11:21:59.102594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f24637-eb12-4cf9-b79f-9cc196635542 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:21:59.112110 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:21:59.344667 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-78f24637-eb12-4cf9-b79f-9cc196635542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7bb7feb3df746b3a9038ef986527723'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:21:59.417827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-78f24637-eb12-4cf9-b79f-9cc196635542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7bb7feb3df746b3a9038ef986527723'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:21:59.430545 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-78f24637-eb12-4cf9-b79f-9cc196635542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7bb7feb3df746b3a9038ef986527723'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:21:59.431075 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-78f24637-eb12-4cf9-b79f-9cc196635542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7bb7feb3df746b3a9038ef986527723'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:21:59.431502 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-78f24637-eb12-4cf9-b79f-9cc196635542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7bb7feb3df746b3a9038ef986527723'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:21:59.454757 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 760/1507] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:21:58 2022] DELETE /identity/v3/users/f7bb7feb3df746b3a9038ef986527723 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:21:59.459124 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a0a50-2557-4b2e-bbef-150386419dec None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:21:59.459910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a0a50-2557-4b2e-bbef-150386419dec None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:21:59.460194 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a0a50-2557-4b2e-bbef-150386419dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:21:59.514210 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-7a1a0a50-2557-4b2e-bbef-150386419dec None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:21:59.515431 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7a1a0a50-2557-4b2e-bbef-150386419dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:21:59.592062 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:21:59.605748 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 748/1508] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:21:59.615198 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f24637-eb12-4cf9-b79f-9cc196635542 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:21:59.616507 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-78f24637-eb12-4cf9-b79f-9cc196635542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:21:59.715038 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f24637-eb12-4cf9-b79f-9cc196635542 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:21:59.769417 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:21:59.789556 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d03f1-4b7a-46e9-9355-ef3072fbe12e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:21:59.790242 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d03f1-4b7a-46e9-9355-ef3072fbe12e service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:21:59.790533 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d03f1-4b7a-46e9-9355-ef3072fbe12e service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:21:59.790920 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d03f1-4b7a-46e9-9355-ef3072fbe12e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:21:59.792699 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-cb6d03f1-4b7a-46e9-9355-ef3072fbe12e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:21:59.909303 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d03f1-4b7a-46e9-9355-ef3072fbe12e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:21:59.910707 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d03f1-4b7a-46e9-9355-ef3072fbe12e service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:21:59.929641 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 761/1509] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:21:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:22:00.394141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a0a50-2557-4b2e-bbef-150386419dec None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:22:00.395461 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7a1a0a50-2557-4b2e-bbef-150386419dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:22:00.407118 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a0a50-2557-4b2e-bbef-150386419dec None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:22:00.510925 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733197ed-8de5-45ce-bf2f-1f0b1359ba50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:22:00.511811 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733197ed-8de5-45ce-bf2f-1f0b1359ba50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:22:00.512089 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733197ed-8de5-45ce-bf2f-1f0b1359ba50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:22:00.512357 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733197ed-8de5-45ce-bf2f-1f0b1359ba50 admin admin] PATH_INFO: `/v3/projects/b678127458884ff4b144230f54410891` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:22:00.522351 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733197ed-8de5-45ce-bf2f-1f0b1359ba50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b678127458884ff4b144230f54410891)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:22:00.523421 dv-cinder-848429-2-smb devstack@keystone.service[80521]: WARNING py.warnings [None req-733197ed-8de5-45ce-bf2f-1f0b1359ba50 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 11:22:00.523421 dv-cinder-848429-2-smb devstack@keystone.service[80521]: warnings.warn(msg) Jul 11 11:22:00.523421 dv-cinder-848429-2-smb devstack@keystone.service[80521]: Jul 11 11:22:00.524595 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733197ed-8de5-45ce-bf2f-1f0b1359ba50 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:22:00.645347 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-733197ed-8de5-45ce-bf2f-1f0b1359ba50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b678127458884ff4b144230f54410891', 'request_id': 'req-733197ed-8de5-45ce-bf2f-1f0b1359ba50'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:22:00.652143 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-733197ed-8de5-45ce-bf2f-1f0b1359ba50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b678127458884ff4b144230f54410891', 'request_id': 'req-733197ed-8de5-45ce-bf2f-1f0b1359ba50'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:22:00.949780 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-733197ed-8de5-45ce-bf2f-1f0b1359ba50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b678127458884ff4b144230f54410891', 'request_id': 'req-733197ed-8de5-45ce-bf2f-1f0b1359ba50'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:22:00.981063 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-733197ed-8de5-45ce-bf2f-1f0b1359ba50 admin admin] The token cache is being invalidate because project b678127458884ff4b144230f54410891 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:22:00.981345 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-733197ed-8de5-45ce-bf2f-1f0b1359ba50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:22:00.981802 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-733197ed-8de5-45ce-bf2f-1f0b1359ba50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:22:00.983275 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 749/1510] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:22:00 2022] DELETE /identity/v3/projects/b678127458884ff4b144230f54410891 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:22:09.927134 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=62 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:22:10.979057 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:23:46.312456 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41764a51-2a53-4bb3-b15c-405eefbef0a4 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:23:46.313041 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41764a51-2a53-4bb3-b15c-405eefbef0a4 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:23:46.313041 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41764a51-2a53-4bb3-b15c-405eefbef0a4 None None] PATH_INFO: `/v3` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:23:46.314382 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 762/1511] 10.222.0.47 () {54 vars in 925 bytes} [Mon Jul 11 11:23:46 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:23:46.321651 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fb9a7-da53-41e4-a860-c9b4d8e7a44f None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:23:46.322101 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fb9a7-da53-41e4-a860-c9b4d8e7a44f None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:23:46.322247 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fb9a7-da53-41e4-a860-c9b4d8e7a44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:23:46.400069 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-ca5fb9a7-da53-41e4-a860-c9b4d8e7a44f None None] MFA Rules not processed for user `12b7c9264495433985185332778dbc8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:23:46.401310 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ca5fb9a7-da53-41e4-a860-c9b4d8e7a44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:23:46.518502 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 750/1512] 10.222.0.47 () {58 vars in 1015 bytes} [Mon Jul 11 11:23:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:23:47.715106 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97c37d-bc06-4b02-8ee8-79013432ba46 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:23:47.715672 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97c37d-bc06-4b02-8ee8-79013432ba46 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:23:47.715672 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97c37d-bc06-4b02-8ee8-79013432ba46 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:23:47.717037 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 763/1513] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 11:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:23:47.721787 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef88db-e813-42c7-8488-33b622303e78 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:23:47.722191 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef88db-e813-42c7-8488-33b622303e78 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:23:47.722366 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef88db-e813-42c7-8488-33b622303e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:23:47.782150 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-f5ef88db-e813-42c7-8488-33b622303e78 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:23:47.783367 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f5ef88db-e813-42c7-8488-33b622303e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:23:47.801565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:23:47.859094 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 751/1514] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 11:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:23:48.013629 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97c37d-bc06-4b02-8ee8-79013432ba46 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:23:48.015719 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-1e97c37d-bc06-4b02-8ee8-79013432ba46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:23:48.119582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97c37d-bc06-4b02-8ee8-79013432ba46 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:23:48.124938 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dad62b-cf0c-493a-bb15-db261ff456b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:23:48.125578 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dad62b-cf0c-493a-bb15-db261ff456b4 service nova] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:23:48.125896 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dad62b-cf0c-493a-bb15-db261ff456b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:23:48.126175 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dad62b-cf0c-493a-bb15-db261ff456b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:23:48.134917 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dad62b-cf0c-493a-bb15-db261ff456b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:23:48.136493 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dad62b-cf0c-493a-bb15-db261ff456b4 service nova] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:23:48.145697 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 764/1515] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:23:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:23:48.970483 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c0cc0-e3b7-46a9-bc39-dd494931d47d None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:23:48.971153 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c0cc0-e3b7-46a9-bc39-dd494931d47d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:23:48.971438 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c0cc0-e3b7-46a9-bc39-dd494931d47d None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:23:48.972824 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 752/1516] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 11:23:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:23:48.978186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853b6a6-83c8-434a-b66c-6e6595c9c8fb None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:23:48.978637 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853b6a6-83c8-434a-b66c-6e6595c9c8fb None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:23:48.978758 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853b6a6-83c8-434a-b66c-6e6595c9c8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:23:48.997027 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-4853b6a6-83c8-434a-b66c-6e6595c9c8fb None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:23:48.998267 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-4853b6a6-83c8-434a-b66c-6e6595c9c8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:23:49.006093 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 765/1517] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 11:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:23:49.159897 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c0cc0-e3b7-46a9-bc39-dd494931d47d None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:23:49.174850 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c0cc0-e3b7-46a9-bc39-dd494931d47d None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:23:49.185143 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe1f8c-79b6-41c2-a777-e458cbda237b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:23:49.185143 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe1f8c-79b6-41c2-a777-e458cbda237b service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:23:49.185143 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe1f8c-79b6-41c2-a777-e458cbda237b service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:23:49.185143 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe1f8c-79b6-41c2-a777-e458cbda237b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:23:49.189581 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe1f8c-79b6-41c2-a777-e458cbda237b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:23:49.191189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe1f8c-79b6-41c2-a777-e458cbda237b service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:23:49.201016 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 753/1518] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:23:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:23:53.625215 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a7a8e-ec1a-4974-85ab-1009695c7de9 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:23:53.625782 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a7a8e-ec1a-4974-85ab-1009695c7de9 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:23:53.625782 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a7a8e-ec1a-4974-85ab-1009695c7de9 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:23:53.627114 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 766/1519] 10.222.0.23 () {54 vars in 960 bytes} [Mon Jul 11 11:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:23:53.632970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a0d86-75d8-4306-85c2-cba8b617cd57 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:23:53.633434 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a0d86-75d8-4306-85c2-cba8b617cd57 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:23:53.633545 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a0d86-75d8-4306-85c2-cba8b617cd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:23:53.651762 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-948a0d86-75d8-4306-85c2-cba8b617cd57 None None] MFA Rules not processed for user `12b7c9264495433985185332778dbc8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:23:53.652957 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-948a0d86-75d8-4306-85c2-cba8b617cd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:23:53.661411 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 754/1520] 10.222.0.23 () {58 vars in 1057 bytes} [Mon Jul 11 11:23:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:23:53.669059 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a7a8e-ec1a-4974-85ab-1009695c7de9 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:23:53.683459 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a7a8e-ec1a-4974-85ab-1009695c7de9 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:23:53.688303 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a5662-4e61-4372-b064-e3d75899854b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b7c9264495433985185332778dbc8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:23:53.688940 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a5662-4e61-4372-b064-e3d75899854b service placement] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:23:53.689220 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a5662-4e61-4372-b064-e3d75899854b service placement] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:23:53.689496 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a5662-4e61-4372-b064-e3d75899854b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:23:53.699005 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a5662-4e61-4372-b064-e3d75899854b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:23:53.700580 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a5662-4e61-4372-b064-e3d75899854b service placement] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:23:53.710259 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 767/1521] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:23:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:24:00.410014 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee90488-faa6-4a9a-91d5-7cb83fc4378f None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:24:00.415082 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee90488-faa6-4a9a-91d5-7cb83fc4378f None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:24:00.415082 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee90488-faa6-4a9a-91d5-7cb83fc4378f None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:24:00.415082 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 11:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:24:00.416841 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bff81-f137-47ef-b99b-b13f97c256e8 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:24:00.417247 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bff81-f137-47ef-b99b-b13f97c256e8 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:24:00.417413 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bff81-f137-47ef-b99b-b13f97c256e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:24:00.435722 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-f34bff81-f137-47ef-b99b-b13f97c256e8 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:24:00.436920 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-f34bff81-f137-47ef-b99b-b13f97c256e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:24:00.445676 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 11:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:24:00.596970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee90488-faa6-4a9a-91d5-7cb83fc4378f None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:24:00.611583 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee90488-faa6-4a9a-91d5-7cb83fc4378f None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:24:00.616980 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafc8f6-ed56-40a8-ab6d-a35ec968ae8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:24:00.617616 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafc8f6-ed56-40a8-ab6d-a35ec968ae8e service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:24:00.620337 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafc8f6-ed56-40a8-ab6d-a35ec968ae8e service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:24:00.620337 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafc8f6-ed56-40a8-ab6d-a35ec968ae8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:24:00.626307 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafc8f6-ed56-40a8-ab6d-a35ec968ae8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:24:00.627879 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafc8f6-ed56-40a8-ab6d-a35ec968ae8e service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:24:00.637614 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 756/1524] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:24:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:24:01.450352 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dae48e-e868-490e-a1f3-51c2779c5a92 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:24:01.450931 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dae48e-e868-490e-a1f3-51c2779c5a92 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:24:01.450931 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dae48e-e868-490e-a1f3-51c2779c5a92 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:24:01.452281 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 769/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 11:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:24:01.456986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f7653-10ea-4d9a-adbf-79449d096999 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:24:01.457452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f7653-10ea-4d9a-adbf-79449d096999 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:24:01.457562 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f7653-10ea-4d9a-adbf-79449d096999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:24:01.476451 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-b66f7653-10ea-4d9a-adbf-79449d096999 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:24:01.477650 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b66f7653-10ea-4d9a-adbf-79449d096999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:24:01.485636 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 757/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 11:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:24:01.635331 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dae48e-e868-490e-a1f3-51c2779c5a92 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:24:01.651048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dae48e-e868-490e-a1f3-51c2779c5a92 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:24:01.656574 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ade98-0f6e-4fe1-98c6-8740df9e7584 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:24:01.657209 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ade98-0f6e-4fe1-98c6-8740df9e7584 service nova] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:24:01.657498 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ade98-0f6e-4fe1-98c6-8740df9e7584 service nova] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:24:01.657801 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ade98-0f6e-4fe1-98c6-8740df9e7584 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:24:01.666103 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ade98-0f6e-4fe1-98c6-8740df9e7584 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:24:01.667680 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ade98-0f6e-4fe1-98c6-8740df9e7584 service nova] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:24:01.677037 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 770/1527] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:24:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:24:05.846955 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6987db-8818-4d57-a10a-3ff46bd0c3f8 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:24:05.847521 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6987db-8818-4d57-a10a-3ff46bd0c3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:24:05.847521 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6987db-8818-4d57-a10a-3ff46bd0c3f8 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:24:05.848915 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 11:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:24:05.854979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a2901-3e65-4369-afa7-9cf3b647c62a None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:24:05.855389 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a2901-3e65-4369-afa7-9cf3b647c62a None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:24:05.855583 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a2901-3e65-4369-afa7-9cf3b647c62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:24:05.873254 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-375a2901-3e65-4369-afa7-9cf3b647c62a None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:24:05.874480 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-375a2901-3e65-4369-afa7-9cf3b647c62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:24:05.882462 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 11:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:24:05.953198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6987db-8818-4d57-a10a-3ff46bd0c3f8 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:24:05.954927 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1e6987db-8818-4d57-a10a-3ff46bd0c3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:24:06.032397 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6987db-8818-4d57-a10a-3ff46bd0c3f8 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:24:06.035971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b8abb-a894-4824-8741-5d1dd07cf417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:24:06.036619 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b8abb-a894-4824-8741-5d1dd07cf417 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:24:06.036905 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b8abb-a894-4824-8741-5d1dd07cf417 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:24:06.037200 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b8abb-a894-4824-8741-5d1dd07cf417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:24:06.046097 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b8abb-a894-4824-8741-5d1dd07cf417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:24:06.047519 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b8abb-a894-4824-8741-5d1dd07cf417 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:24:06.056873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 759/1530] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:24:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:24:08.078567 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294a3f2-9224-4f66-94b1-2157723cf670 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:24:08.079125 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294a3f2-9224-4f66-94b1-2157723cf670 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:24:08.079125 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294a3f2-9224-4f66-94b1-2157723cf670 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:24:08.080513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 11:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:24:08.086138 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953647a9-7792-4b17-8fd3-04133f4d87e0 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:24:08.086558 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953647a9-7792-4b17-8fd3-04133f4d87e0 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:24:08.086702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953647a9-7792-4b17-8fd3-04133f4d87e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:24:08.105163 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-953647a9-7792-4b17-8fd3-04133f4d87e0 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:24:08.106389 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-953647a9-7792-4b17-8fd3-04133f4d87e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:24:08.114226 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 11:24:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:24:08.149507 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294a3f2-9224-4f66-94b1-2157723cf670 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:24:08.160042 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294a3f2-9224-4f66-94b1-2157723cf670 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:24:08.164160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378ba6b-5067-4c01-91ab-ead344e71d50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:24:08.164797 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378ba6b-5067-4c01-91ab-ead344e71d50 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:24:08.165086 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378ba6b-5067-4c01-91ab-ead344e71d50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:24:08.165362 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378ba6b-5067-4c01-91ab-ead344e71d50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:24:08.174145 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378ba6b-5067-4c01-91ab-ead344e71d50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:24:08.175572 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378ba6b-5067-4c01-91ab-ead344e71d50 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:24:08.184971 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 773/1533] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:24:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:24:12.519825 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2796a-e082-4012-93cd-291243731bf0 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:24:12.520345 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2796a-e082-4012-93cd-291243731bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:24:12.520465 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2796a-e082-4012-93cd-291243731bf0 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:24:12.522266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 11:24:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:24:12.527576 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c724c2-a706-4f3c-853e-0a2951a2dd6f None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:24:12.528000 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c724c2-a706-4f3c-853e-0a2951a2dd6f None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:24:12.528217 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c724c2-a706-4f3c-853e-0a2951a2dd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:24:12.534510 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=74 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:24:12.546557 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-e6c724c2-a706-4f3c-853e-0a2951a2dd6f None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:24:12.547751 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-e6c724c2-a706-4f3c-853e-0a2951a2dd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:24:12.555746 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 11:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:24:12.857862 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2796a-e082-4012-93cd-291243731bf0 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:24:12.859585 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2fe2796a-e082-4012-93cd-291243731bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:24:12.907051 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:24:12.936649 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2796a-e082-4012-93cd-291243731bf0 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:24:12.940597 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e127f3-b6ff-4604-91f6-aeb010a12946 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:24:12.941272 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e127f3-b6ff-4604-91f6-aeb010a12946 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:24:12.941557 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e127f3-b6ff-4604-91f6-aeb010a12946 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:24:12.941858 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e127f3-b6ff-4604-91f6-aeb010a12946 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:24:12.951774 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e127f3-b6ff-4604-91f6-aeb010a12946 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:24:12.953181 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e127f3-b6ff-4604-91f6-aeb010a12946 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:24:12.963031 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 762/1536] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:24:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:24:15.015497 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f7a77-c16d-4b1a-a8a3-1397d819854b None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:24:15.016005 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f7a77-c16d-4b1a-a8a3-1397d819854b None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:24:15.016005 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f7a77-c16d-4b1a-a8a3-1397d819854b None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:24:15.017437 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 11:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:24:15.022711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d8e70-9a4c-4c27-952a-a9353261f414 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:24:15.023154 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d8e70-9a4c-4c27-952a-a9353261f414 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:24:15.023291 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d8e70-9a4c-4c27-952a-a9353261f414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:24:15.041241 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-362d8e70-9a4c-4c27-952a-a9353261f414 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:24:15.042492 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-362d8e70-9a4c-4c27-952a-a9353261f414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:24:15.050819 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 11:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:24:15.347700 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f7a77-c16d-4b1a-a8a3-1397d819854b None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:24:15.349394 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-ca6f7a77-c16d-4b1a-a8a3-1397d819854b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:24:15.363060 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f7a77-c16d-4b1a-a8a3-1397d819854b None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:24:15.366763 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ee888-3c5e-4259-bbaf-cabf7309e7c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:24:15.367399 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ee888-3c5e-4259-bbaf-cabf7309e7c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:24:15.367685 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ee888-3c5e-4259-bbaf-cabf7309e7c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:24:15.367965 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ee888-3c5e-4259-bbaf-cabf7309e7c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:24:15.376808 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ee888-3c5e-4259-bbaf-cabf7309e7c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:24:15.378263 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ee888-3c5e-4259-bbaf-cabf7309e7c7 service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:24:15.387560 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 776/1539] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:24:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:24:25.035934 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=18 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:24:25.383421 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=8 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:25:50.018983 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187381ce-7aa6-4f5a-b2bf-e871629f588b None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:50.020923 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187381ce-7aa6-4f5a-b2bf-e871629f588b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:50.020923 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187381ce-7aa6-4f5a-b2bf-e871629f588b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:50.045169 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-187381ce-7aa6-4f5a-b2bf-e871629f588b None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:25:50.046845 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-187381ce-7aa6-4f5a-b2bf-e871629f588b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:50.061023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 764/1540] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:25:50.081051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce79ddd-3db2-4959-826c-71ec67979f84 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:50.081657 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce79ddd-3db2-4959-826c-71ec67979f84 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:50.081657 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce79ddd-3db2-4959-826c-71ec67979f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:50.103206 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20636366-345c-480f-bffe-1d29893f90d8 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:50.103472 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20636366-345c-480f-bffe-1d29893f90d8 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:50.103812 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20636366-345c-480f-bffe-1d29893f90d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:50.107705 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-2ce79ddd-3db2-4959-826c-71ec67979f84 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:25:50.108950 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-2ce79ddd-3db2-4959-826c-71ec67979f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:50.125136 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 777/1541] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:25:50.129919 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce79ddd-3db2-4959-826c-71ec67979f84 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:50.131676 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-20636366-345c-480f-bffe-1d29893f90d8 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:25:50.132887 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-20636366-345c-480f-bffe-1d29893f90d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:50.147233 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce79ddd-3db2-4959-826c-71ec67979f84 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:50.149501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 765/1542] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:25:50.159154 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ef7a8-4e04-4592-bbb1-af2d06d94900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:50.159850 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ef7a8-4e04-4592-bbb1-af2d06d94900 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:50.160141 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ef7a8-4e04-4592-bbb1-af2d06d94900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:50.160421 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ef7a8-4e04-4592-bbb1-af2d06d94900 admin admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:50.161335 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ef7a8-4e04-4592-bbb1-af2d06d94900 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:25:50.161743 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ef7a8-4e04-4592-bbb1-af2d06d94900 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:50.162829 dv-cinder-848429-2-smb devstack@keystone.service[80522]: WARNING py.warnings [None req-906ef7a8-4e04-4592-bbb1-af2d06d94900 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 11:25:50.162829 dv-cinder-848429-2-smb devstack@keystone.service[80522]: warnings.warn(msg) Jul 11 11:25:50.162829 dv-cinder-848429-2-smb devstack@keystone.service[80522]: Jul 11 11:25:50.163729 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ef7a8-4e04-4592-bbb1-af2d06d94900 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:50.170125 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156f108-6cc3-4f8e-a0cc-85c853f2e98c None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:50.170476 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156f108-6cc3-4f8e-a0cc-85c853f2e98c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:50.170705 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156f108-6cc3-4f8e-a0cc-85c853f2e98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:50.184247 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 778/1543] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:25:50.192473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ef7a8-4e04-4592-bbb1-af2d06d94900 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:50.200286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-1156f108-6cc3-4f8e-a0cc-85c853f2e98c None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:25:50.201733 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1156f108-6cc3-4f8e-a0cc-85c853f2e98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:50.209751 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ef7a8-4e04-4592-bbb1-af2d06d94900 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:50.216865 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 766/1544] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:25:50.222704 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac36237-a25a-440f-84a0-7d0ce3c3f968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:50.223464 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac36237-a25a-440f-84a0-7d0ce3c3f968 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:50.223763 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac36237-a25a-440f-84a0-7d0ce3c3f968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:50.224043 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac36237-a25a-440f-84a0-7d0ce3c3f968 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:50.225291 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac36237-a25a-440f-84a0-7d0ce3c3f968 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:50.227410 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac36237-a25a-440f-84a0-7d0ce3c3f968 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:50.230196 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156f108-6cc3-4f8e-a0cc-85c853f2e98c None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:50.248173 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156f108-6cc3-4f8e-a0cc-85c853f2e98c None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:50.253268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed200d-63ff-4247-acd3-3e954867a5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:50.253969 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed200d-63ff-4247-acd3-3e954867a5fd admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:50.254274 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed200d-63ff-4247-acd3-3e954867a5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:50.254532 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed200d-63ff-4247-acd3-3e954867a5fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:50.255973 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed200d-63ff-4247-acd3-3e954867a5fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:25:50.256410 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed200d-63ff-4247-acd3-3e954867a5fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:50.262419 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed200d-63ff-4247-acd3-3e954867a5fd admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:50.281425 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 767/1545] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:25:50.282981 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa69bf-357c-42fc-8fde-2f3ed13f6299 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:50.283276 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa69bf-357c-42fc-8fde-2f3ed13f6299 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:50.283556 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa69bf-357c-42fc-8fde-2f3ed13f6299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:50.314366 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-04fa69bf-357c-42fc-8fde-2f3ed13f6299 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:25:50.315826 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-04fa69bf-357c-42fc-8fde-2f3ed13f6299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:50.328747 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 768/1546] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:25:50.329690 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa69bf-357c-42fc-8fde-2f3ed13f6299 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:50.344296 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa69bf-357c-42fc-8fde-2f3ed13f6299 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:50.350338 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e73505-199e-4d78-bc95-43cdb0fdef0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:50.351021 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e73505-199e-4d78-bc95-43cdb0fdef0b admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:50.351308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e73505-199e-4d78-bc95-43cdb0fdef0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:50.351589 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e73505-199e-4d78-bc95-43cdb0fdef0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:50.352290 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e73505-199e-4d78-bc95-43cdb0fdef0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:50.353314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: WARNING py.warnings [None req-b4e73505-199e-4d78-bc95-43cdb0fdef0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 11:25:50.353314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: warnings.warn(msg) Jul 11 11:25:50.353314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: Jul 11 11:25:50.354544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e73505-199e-4d78-bc95-43cdb0fdef0b admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:50.395313 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 779/1547] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:25:50 2022] POST /identity/v3/projects => generated 375 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:25:50.396786 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d072a-ef9e-4aef-bd1b-cda7abe2696a None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:50.397080 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d072a-ef9e-4aef-bd1b-cda7abe2696a None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:50.397417 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d072a-ef9e-4aef-bd1b-cda7abe2696a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:50.430807 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-094d072a-ef9e-4aef-bd1b-cda7abe2696a None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:25:50.432179 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-094d072a-ef9e-4aef-bd1b-cda7abe2696a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:50.442527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 769/1548] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:25:50 2022] POST /identity/v3/projects => generated 389 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:25:50.443543 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e73505-199e-4d78-bc95-43cdb0fdef0b admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:50.548211 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 780/1549] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:25:50.549553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9caad3d-290f-4eb0-91d0-dfa18e81537f None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:50.549935 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9caad3d-290f-4eb0-91d0-dfa18e81537f None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:50.550367 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9caad3d-290f-4eb0-91d0-dfa18e81537f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:50.554628 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e73505-199e-4d78-bc95-43cdb0fdef0b admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:50.560779 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9157c-9ac0-4419-b9a8-34575fb00f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:50.561501 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9157c-9ac0-4419-b9a8-34575fb00f1f admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:50.561813 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9157c-9ac0-4419-b9a8-34575fb00f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:50.562098 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9157c-9ac0-4419-b9a8-34575fb00f1f admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:50.562797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9157c-9ac0-4419-b9a8-34575fb00f1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:50.564710 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9157c-9ac0-4419-b9a8-34575fb00f1f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:50.573300 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-f9caad3d-290f-4eb0-91d0-dfa18e81537f None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:25:50.577522 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-f9caad3d-290f-4eb0-91d0-dfa18e81537f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:50.585612 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 781/1550] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:25:50.586651 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9caad3d-290f-4eb0-91d0-dfa18e81537f None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:50.597365 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9caad3d-290f-4eb0-91d0-dfa18e81537f None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:50.602349 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f3bd0-a10f-4be7-8dc0-b6ced35c86e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:50.609874 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f3bd0-a10f-4be7-8dc0-b6ced35c86e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:50.609874 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f3bd0-a10f-4be7-8dc0-b6ced35c86e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:50.609874 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f3bd0-a10f-4be7-8dc0-b6ced35c86e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:50.609874 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f3bd0-a10f-4be7-8dc0-b6ced35c86e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:50.609874 dv-cinder-848429-2-smb devstack@keystone.service[80522]: WARNING py.warnings [None req-343f3bd0-a10f-4be7-8dc0-b6ced35c86e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 11:25:50.609874 dv-cinder-848429-2-smb devstack@keystone.service[80522]: warnings.warn(msg) Jul 11 11:25:50.609874 dv-cinder-848429-2-smb devstack@keystone.service[80522]: Jul 11 11:25:50.610558 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f3bd0-a10f-4be7-8dc0-b6ced35c86e1 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:50.660628 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 770/1551] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:25:50 2022] POST /identity/v3/users => generated 288 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:25:50.662187 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d7238-3040-43cc-94b0-4eb0c7be7460 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:50.662481 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d7238-3040-43cc-94b0-4eb0c7be7460 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:50.662760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d7238-3040-43cc-94b0-4eb0c7be7460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:50.680958 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-af9d7238-3040-43cc-94b0-4eb0c7be7460 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:25:50.682181 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-af9d7238-3040-43cc-94b0-4eb0c7be7460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:50.691052 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 771/1552] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:25:50.692309 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b76bd-4145-4517-9986-618b148ed0b6 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:50.692699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b76bd-4145-4517-9986-618b148ed0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:50.693693 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b76bd-4145-4517-9986-618b148ed0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:50.696922 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 782/1553] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:25:50 2022] POST /identity/v3/users => generated 295 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:25:50.696922 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f3bd0-a10f-4be7-8dc0-b6ced35c86e1 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:50.708186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f3bd0-a10f-4be7-8dc0-b6ced35c86e1 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:50.713694 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de2233-4139-41e5-b295-ab238de8e3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:50.714386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de2233-4139-41e5-b295-ab238de8e3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:50.714673 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de2233-4139-41e5-b295-ab238de8e3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:50.714954 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de2233-4139-41e5-b295-ab238de8e3e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:50.715228 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-320b76bd-4145-4517-9986-618b148ed0b6 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:25:50.715685 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de2233-4139-41e5-b295-ab238de8e3e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:25:50.715996 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de2233-4139-41e5-b295-ab238de8e3e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:50.716425 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-320b76bd-4145-4517-9986-618b148ed0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:50.717591 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de2233-4139-41e5-b295-ab238de8e3e6 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:50.724651 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 772/1554] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:25:50.725651 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b17b1-9205-426c-acc5-c76fd57f7a39 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:50.725981 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b17b1-9205-426c-acc5-c76fd57f7a39 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:50.726253 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b17b1-9205-426c-acc5-c76fd57f7a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:50.737402 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 783/1555] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:25:50.739066 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dad059-b95c-4346-8fc5-f0f59c77d07f None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:50.739363 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dad059-b95c-4346-8fc5-f0f59c77d07f None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:50.740288 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dad059-b95c-4346-8fc5-f0f59c77d07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:50.745221 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-ea9b17b1-9205-426c-acc5-c76fd57f7a39 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:25:50.746497 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ea9b17b1-9205-426c-acc5-c76fd57f7a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:50.754854 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 773/1556] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:25:50.757276 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e6c85-3e3a-499f-a3b3-a9463cfa085d None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:50.757790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e6c85-3e3a-499f-a3b3-a9463cfa085d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:50.758267 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e6c85-3e3a-499f-a3b3-a9463cfa085d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:50.765671 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-d1dad059-b95c-4346-8fc5-f0f59c77d07f None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:25:50.766900 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-d1dad059-b95c-4346-8fc5-f0f59c77d07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:50.775616 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 784/1557] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:25:50.776663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dad059-b95c-4346-8fc5-f0f59c77d07f None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:50.780340 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-7d7e6c85-3e3a-499f-a3b3-a9463cfa085d None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:25:50.781568 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7d7e6c85-3e3a-499f-a3b3-a9463cfa085d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:50.787195 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dad059-b95c-4346-8fc5-f0f59c77d07f None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:50.789992 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 774/1558] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:25:50.791242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9000b4-f892-4971-8c8e-50760dfea9a2 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:50.791504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9000b4-f892-4971-8c8e-50760dfea9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:50.791781 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a439e-d8c7-4d7c-a32d-a5593673a075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:50.791909 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9000b4-f892-4971-8c8e-50760dfea9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:50.792438 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a439e-d8c7-4d7c-a32d-a5593673a075 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:50.792724 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a439e-d8c7-4d7c-a32d-a5593673a075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:50.793001 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a439e-d8c7-4d7c-a32d-a5593673a075 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:50.793720 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a439e-d8c7-4d7c-a32d-a5593673a075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:50.795345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a439e-d8c7-4d7c-a32d-a5593673a075 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:50.809393 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 785/1559] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:25:50.809393 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a439e-d8c7-4d7c-a32d-a5593673a075 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:50.813885 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-0e9000b4-f892-4971-8c8e-50760dfea9a2 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:25:50.815095 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-0e9000b4-f892-4971-8c8e-50760dfea9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:50.819296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a439e-d8c7-4d7c-a32d-a5593673a075 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:50.824293 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132c0c3-b3d1-4ddc-bafd-16b33d5cd79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:50.824942 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132c0c3-b3d1-4ddc-bafd-16b33d5cd79d admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:50.825043 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 775/1560] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:25:50.825489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132c0c3-b3d1-4ddc-bafd-16b33d5cd79d admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:50.825830 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132c0c3-b3d1-4ddc-bafd-16b33d5cd79d admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:50.826348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0ece3-f814-4481-a63b-4aad63337721 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:50.826534 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132c0c3-b3d1-4ddc-bafd-16b33d5cd79d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:50.826637 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0ece3-f814-4481-a63b-4aad63337721 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:50.826913 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0ece3-f814-4481-a63b-4aad63337721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:50.828135 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132c0c3-b3d1-4ddc-bafd-16b33d5cd79d admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:50.839950 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 786/1561] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:25:50.841471 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132c0c3-b3d1-4ddc-bafd-16b33d5cd79d admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:50.844824 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-7fa0ece3-f814-4481-a63b-4aad63337721 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:25:50.846050 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7fa0ece3-f814-4481-a63b-4aad63337721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:50.851309 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132c0c3-b3d1-4ddc-bafd-16b33d5cd79d admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:50.854189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 776/1562] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:25:50.855427 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb6b78-99c7-4abe-ae55-5f176455430c None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:50.855718 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb6b78-99c7-4abe-ae55-5f176455430c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:50.856001 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb6b78-99c7-4abe-ae55-5f176455430c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:50.858476 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887917d-f87f-4050-8c53-7e5dc6bc2527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:50.859125 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887917d-f87f-4050-8c53-7e5dc6bc2527 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:50.859411 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887917d-f87f-4050-8c53-7e5dc6bc2527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:50.859691 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887917d-f87f-4050-8c53-7e5dc6bc2527 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:50.860376 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a887917d-f87f-4050-8c53-7e5dc6bc2527 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:50.862299 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a887917d-f87f-4050-8c53-7e5dc6bc2527 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:50.875607 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-edfb6b78-99c7-4abe-ae55-5f176455430c None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:25:50.876803 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-edfb6b78-99c7-4abe-ae55-5f176455430c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:50.885230 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 777/1563] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:25:50.886072 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb6b78-99c7-4abe-ae55-5f176455430c None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:50.895330 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb6b78-99c7-4abe-ae55-5f176455430c None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:50.907653 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a6bdc-164f-441d-b18e-52de4828820a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:50.907653 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a6bdc-164f-441d-b18e-52de4828820a admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:50.907653 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a6bdc-164f-441d-b18e-52de4828820a admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:50.907653 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a6bdc-164f-441d-b18e-52de4828820a admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:50.908064 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a6bdc-164f-441d-b18e-52de4828820a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:25:50.908064 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a6bdc-164f-441d-b18e-52de4828820a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:50.908064 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a6bdc-164f-441d-b18e-52de4828820a admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:50.916529 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 778/1564] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:25:50.917733 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f26d9-43fe-466f-abc6-a3ae02261878 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:50.918056 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f26d9-43fe-466f-abc6-a3ae02261878 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:50.918338 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f26d9-43fe-466f-abc6-a3ae02261878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:50.936050 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-744f26d9-43fe-466f-abc6-a3ae02261878 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:25:50.937240 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-744f26d9-43fe-466f-abc6-a3ae02261878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:50.946024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 779/1565] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:25:50.946786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f26d9-43fe-466f-abc6-a3ae02261878 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:50.955942 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f26d9-43fe-466f-abc6-a3ae02261878 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:50.961087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21189eb2-decf-43a6-afa4-eb6eded4223e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:50.961713 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21189eb2-decf-43a6-afa4-eb6eded4223e admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:50.962032 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21189eb2-decf-43a6-afa4-eb6eded4223e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:50.962314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21189eb2-decf-43a6-afa4-eb6eded4223e admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:50.963097 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21189eb2-decf-43a6-afa4-eb6eded4223e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:50.964663 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21189eb2-decf-43a6-afa4-eb6eded4223e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:50.974452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 780/1566] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:25:50.976481 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21189eb2-decf-43a6-afa4-eb6eded4223e admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:50.980269 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 787/1567] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:25:50 2022] POST /identity/v3/projects => generated 363 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:25:50.980269 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887917d-f87f-4050-8c53-7e5dc6bc2527 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:50.986601 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21189eb2-decf-43a6-afa4-eb6eded4223e admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:50.995202 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:25:51.003142 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:25:51.039769 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887917d-f87f-4050-8c53-7e5dc6bc2527 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:51.044394 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd390f-1656-43b8-953d-53a254156348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:51.044912 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac22cd9-d29c-4f40-8add-297d07d46c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:51.045438 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd390f-1656-43b8-953d-53a254156348 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:51.045438 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd390f-1656-43b8-953d-53a254156348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:51.045661 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac22cd9-d29c-4f40-8add-297d07d46c49 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:51.045791 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd390f-1656-43b8-953d-53a254156348 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:51.046014 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac22cd9-d29c-4f40-8add-297d07d46c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:51.046298 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac22cd9-d29c-4f40-8add-297d07d46c49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:51.046411 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd390f-1656-43b8-953d-53a254156348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:51.047093 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac22cd9-d29c-4f40-8add-297d07d46c49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:25:51.047409 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac22cd9-d29c-4f40-8add-297d07d46c49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:51.047923 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd390f-1656-43b8-953d-53a254156348 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:51.049070 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac22cd9-d29c-4f40-8add-297d07d46c49 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:51.058008 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 788/1568] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:25:51.058741 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd390f-1656-43b8-953d-53a254156348 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:51.066467 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 781/1569] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:25:51.066467 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac22cd9-d29c-4f40-8add-297d07d46c49 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:51.069019 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd390f-1656-43b8-953d-53a254156348 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:51.074047 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731df80-a285-42e1-9e3a-0bd2185508b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:51.074698 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731df80-a285-42e1-9e3a-0bd2185508b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:51.074985 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731df80-a285-42e1-9e3a-0bd2185508b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:51.075263 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731df80-a285-42e1-9e3a-0bd2185508b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:51.075987 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731df80-a285-42e1-9e3a-0bd2185508b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:25:51.076295 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731df80-a285-42e1-9e3a-0bd2185508b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:51.077905 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731df80-a285-42e1-9e3a-0bd2185508b3 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:51.079352 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac22cd9-d29c-4f40-8add-297d07d46c49 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:51.084608 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71baa9db-db26-4c4e-b21d-5976330021b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:51.085286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71baa9db-db26-4c4e-b21d-5976330021b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:51.085599 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71baa9db-db26-4c4e-b21d-5976330021b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:51.085916 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71baa9db-db26-4c4e-b21d-5976330021b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:51.086641 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71baa9db-db26-4c4e-b21d-5976330021b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:25:51.086951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71baa9db-db26-4c4e-b21d-5976330021b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:51.088637 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71baa9db-db26-4c4e-b21d-5976330021b7 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:51.091630 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 789/1570] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:25:51.093102 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731df80-a285-42e1-9e3a-0bd2185508b3 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:51.100435 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 782/1571] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:25:51.110022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71baa9db-db26-4c4e-b21d-5976330021b7 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:51.110156 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731df80-a285-42e1-9e3a-0bd2185508b3 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:51.110776 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71baa9db-db26-4c4e-b21d-5976330021b7 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:51.114424 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60fde5-5324-4ff0-baac-f1c293e98fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:51.115084 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60fde5-5324-4ff0-baac-f1c293e98fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:51.115339 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00bb39-0bfa-48a1-8ec8-e52fc9f01a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:51.115465 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60fde5-5324-4ff0-baac-f1c293e98fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:51.115808 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60fde5-5324-4ff0-baac-f1c293e98fb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:51.115986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00bb39-0bfa-48a1-8ec8-e52fc9f01a13 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:51.116273 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00bb39-0bfa-48a1-8ec8-e52fc9f01a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:51.116499 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60fde5-5324-4ff0-baac-f1c293e98fb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:51.116605 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00bb39-0bfa-48a1-8ec8-e52fc9f01a13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:51.117258 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00bb39-0bfa-48a1-8ec8-e52fc9f01a13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:25:51.117600 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00bb39-0bfa-48a1-8ec8-e52fc9f01a13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:51.118438 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60fde5-5324-4ff0-baac-f1c293e98fb0 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:51.119223 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00bb39-0bfa-48a1-8ec8-e52fc9f01a13 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:51.135024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 783/1572] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:25:51.135024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00bb39-0bfa-48a1-8ec8-e52fc9f01a13 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:51.143887 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00bb39-0bfa-48a1-8ec8-e52fc9f01a13 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:51.149171 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375612aa-19b8-43ba-bcba-5cfa8d464490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:51.150066 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375612aa-19b8-43ba-bcba-5cfa8d464490 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:51.150349 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375612aa-19b8-43ba-bcba-5cfa8d464490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:51.150631 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375612aa-19b8-43ba-bcba-5cfa8d464490 admin admin] PATH_INFO: `/v3/projects/d895c01442c94d6fb92e188a25c883e4/users/1d322f9350b7475b94493d4bbcd61349/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:51.165233 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375612aa-19b8-43ba-bcba-5cfa8d464490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d895c01442c94d6fb92e188a25c883e4, user_id=1d322f9350b7475b94493d4bbcd61349, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:51.166284 dv-cinder-848429-2-smb devstack@keystone.service[80521]: WARNING py.warnings [None req-375612aa-19b8-43ba-bcba-5cfa8d464490 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 11:25:51.166284 dv-cinder-848429-2-smb devstack@keystone.service[80521]: warnings.warn(msg) Jul 11 11:25:51.166284 dv-cinder-848429-2-smb devstack@keystone.service[80521]: Jul 11 11:25:51.168227 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375612aa-19b8-43ba-bcba-5cfa8d464490 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:51.238846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 790/1573] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:25:51 2022] POST /identity/v3/projects => generated 365 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:25:51.239979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60fde5-5324-4ff0-baac-f1c293e98fb0 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:51.283966 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 784/1574] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:25:51 2022] PUT /identity/v3/projects/d895c01442c94d6fb92e188a25c883e4/users/1d322f9350b7475b94493d4bbcd61349/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:25:51.288099 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375612aa-19b8-43ba-bcba-5cfa8d464490 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:51.302012 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60fde5-5324-4ff0-baac-f1c293e98fb0 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:51.348441 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375612aa-19b8-43ba-bcba-5cfa8d464490 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:51.353311 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c30c6-7055-46cf-ace8-615884469b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:51.354248 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c30c6-7055-46cf-ace8-615884469b4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:51.358932 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c30c6-7055-46cf-ace8-615884469b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:51.358932 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c30c6-7055-46cf-ace8-615884469b4d admin admin] PATH_INFO: `/v3/projects/885f9405fd4b4b429e5f34b9d8c269e3/users/0cbaec8b28f9449dab0d5175c8034f50/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:51.359875 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeeb862-83d3-4352-9efb-7ee191da0f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:51.360538 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeeb862-83d3-4352-9efb-7ee191da0f77 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:51.360823 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeeb862-83d3-4352-9efb-7ee191da0f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:51.361101 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeeb862-83d3-4352-9efb-7ee191da0f77 admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:51.361911 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeeb862-83d3-4352-9efb-7ee191da0f77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:51.363826 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeeb862-83d3-4352-9efb-7ee191da0f77 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:51.369836 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c30c6-7055-46cf-ace8-615884469b4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=885f9405fd4b4b429e5f34b9d8c269e3, user_id=0cbaec8b28f9449dab0d5175c8034f50, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:51.372562 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c30c6-7055-46cf-ace8-615884469b4d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:51.466257 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 791/1575] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:25:51 2022] POST /identity/v3/users => generated 282 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:25:51.466701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 785/1576] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:25:51 2022] PUT /identity/v3/projects/885f9405fd4b4b429e5f34b9d8c269e3/users/0cbaec8b28f9449dab0d5175c8034f50/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:25:51.467297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeeb862-83d3-4352-9efb-7ee191da0f77 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:51.468083 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c30c6-7055-46cf-ace8-615884469b4d admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:51.480641 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeeb862-83d3-4352-9efb-7ee191da0f77 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:51.497593 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:25:51.510945 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:25:51.530975 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c30c6-7055-46cf-ace8-615884469b4d admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:51.535705 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be292d0-25c1-4b6f-b1ec-cd2c6d3cf4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:51.536367 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be292d0-25c1-4b6f-b1ec-cd2c6d3cf4d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:51.537279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be292d0-25c1-4b6f-b1ec-cd2c6d3cf4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:51.537564 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be292d0-25c1-4b6f-b1ec-cd2c6d3cf4d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:51.538361 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be292d0-25c1-4b6f-b1ec-cd2c6d3cf4d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:51.539266 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5cc5f-4c70-4807-ac5d-b30aeb152068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:51.539930 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5cc5f-4c70-4807-ac5d-b30aeb152068 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:51.540191 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be292d0-25c1-4b6f-b1ec-cd2c6d3cf4d0 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:51.540302 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5cc5f-4c70-4807-ac5d-b30aeb152068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:51.540482 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5cc5f-4c70-4807-ac5d-b30aeb152068 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:51.541226 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5cc5f-4c70-4807-ac5d-b30aeb152068 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:51.543394 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5cc5f-4c70-4807-ac5d-b30aeb152068 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:51.679355 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 786/1577] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:25:51 2022] POST /identity/v3/projects => generated 393 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:25:51.680083 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be292d0-25c1-4b6f-b1ec-cd2c6d3cf4d0 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:51.690415 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 792/1578] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:25:51 2022] POST /identity/v3/projects => generated 373 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:25:51.691364 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5cc5f-4c70-4807-ac5d-b30aeb152068 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:51.747864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be292d0-25c1-4b6f-b1ec-cd2c6d3cf4d0 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:51.752689 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c87f46-79b7-4198-a9c0-1bc0f7117ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:51.753367 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c87f46-79b7-4198-a9c0-1bc0f7117ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:51.753657 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c87f46-79b7-4198-a9c0-1bc0f7117ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:51.753972 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c87f46-79b7-4198-a9c0-1bc0f7117ac8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:51.754605 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5cc5f-4c70-4807-ac5d-b30aeb152068 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:51.754766 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c87f46-79b7-4198-a9c0-1bc0f7117ac8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:51.757267 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c87f46-79b7-4198-a9c0-1bc0f7117ac8 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:51.761452 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346554c6-b8f1-4025-ae03-47d8b87e30b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:51.762160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346554c6-b8f1-4025-ae03-47d8b87e30b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:51.762444 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346554c6-b8f1-4025-ae03-47d8b87e30b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:51.762722 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346554c6-b8f1-4025-ae03-47d8b87e30b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:51.763545 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346554c6-b8f1-4025-ae03-47d8b87e30b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:51.765490 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346554c6-b8f1-4025-ae03-47d8b87e30b6 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:51.882692 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 787/1579] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:25:51 2022] POST /identity/v3/projects => generated 375 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:25:51.882692 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c87f46-79b7-4198-a9c0-1bc0f7117ac8 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:51.907886 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 793/1580] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:25:51 2022] POST /identity/v3/projects => generated 387 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:25:51.909176 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a0a85-c64f-4265-a30b-c590f236dcda None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:51.909470 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a0a85-c64f-4265-a30b-c590f236dcda None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:51.909750 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a0a85-c64f-4265-a30b-c590f236dcda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:51.926614 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-389a0a85-c64f-4265-a30b-c590f236dcda None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:25:51.927850 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-389a0a85-c64f-4265-a30b-c590f236dcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:51.950687 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c87f46-79b7-4198-a9c0-1bc0f7117ac8 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:51.986770 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 794/1581] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:25:51.987621 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a0a85-c64f-4265-a30b-c590f236dcda None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:51.997728 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a0a85-c64f-4265-a30b-c590f236dcda None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:52.002486 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79537a4-347c-440b-932d-bc25b6c35181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:52.003144 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79537a4-347c-440b-932d-bc25b6c35181 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:52.003437 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79537a4-347c-440b-932d-bc25b6c35181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:52.003663 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:25:52.003762 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79537a4-347c-440b-932d-bc25b6c35181 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:52.004558 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79537a4-347c-440b-932d-bc25b6c35181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:52.006583 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79537a4-347c-440b-932d-bc25b6c35181 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:52.011512 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3eb1f-3d3e-4888-8e63-bc8aa17a254f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:52.012193 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3eb1f-3d3e-4888-8e63-bc8aa17a254f admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:52.013261 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3eb1f-3d3e-4888-8e63-bc8aa17a254f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:52.013261 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3eb1f-3d3e-4888-8e63-bc8aa17a254f admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:52.013478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3eb1f-3d3e-4888-8e63-bc8aa17a254f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:52.015425 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3eb1f-3d3e-4888-8e63-bc8aa17a254f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:52.017159 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 795/1582] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:25:52.022134 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221effa-3e54-47e6-b0b6-4d855d72b18e None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:52.022431 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221effa-3e54-47e6-b0b6-4d855d72b18e None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:52.022714 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221effa-3e54-47e6-b0b6-4d855d72b18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:52.039799 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-0221effa-3e54-47e6-b0b6-4d855d72b18e None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:25:52.040995 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-0221effa-3e54-47e6-b0b6-4d855d72b18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:52.048982 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 796/1583] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:25:52.049719 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0221effa-3e54-47e6-b0b6-4d855d72b18e None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:52.059777 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0221effa-3e54-47e6-b0b6-4d855d72b18e None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:52.064436 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c775507-dc27-4ea2-9364-0468a0e60c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:52.070653 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c775507-dc27-4ea2-9364-0468a0e60c42 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:52.070653 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c775507-dc27-4ea2-9364-0468a0e60c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:52.070653 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c775507-dc27-4ea2-9364-0468a0e60c42 admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:52.070653 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c775507-dc27-4ea2-9364-0468a0e60c42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:52.070653 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c775507-dc27-4ea2-9364-0468a0e60c42 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:52.078676 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:25:52.094834 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 788/1584] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:25:51 2022] POST /identity/v3/users => generated 283 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:25:52.095812 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3eb1f-3d3e-4888-8e63-bc8aa17a254f admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:52.105288 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3eb1f-3d3e-4888-8e63-bc8aa17a254f admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:52.109933 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9c5e1-ecb4-4132-b959-cb4dc35638e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:52.110590 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9c5e1-ecb4-4132-b959-cb4dc35638e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:52.110967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9c5e1-ecb4-4132-b959-cb4dc35638e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:52.111282 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9c5e1-ecb4-4132-b959-cb4dc35638e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:52.111965 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9c5e1-ecb4-4132-b959-cb4dc35638e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:52.113908 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9c5e1-ecb4-4132-b959-cb4dc35638e0 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:52.181207 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 797/1585] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:25:52 2022] POST /identity/v3/users => generated 297 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:25:52.182083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c775507-dc27-4ea2-9364-0468a0e60c42 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:52.191811 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c775507-dc27-4ea2-9364-0468a0e60c42 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:52.198467 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf75216-1c37-4403-bca5-8f015d0447a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:52.199189 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf75216-1c37-4403-bca5-8f015d0447a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:52.199480 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf75216-1c37-4403-bca5-8f015d0447a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:52.199765 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf75216-1c37-4403-bca5-8f015d0447a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:52.200574 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf75216-1c37-4403-bca5-8f015d0447a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:52.202712 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf75216-1c37-4403-bca5-8f015d0447a0 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:52.206584 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 789/1586] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:25:52 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:25:52.206584 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9c5e1-ecb4-4132-b959-cb4dc35638e0 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:52.216390 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9c5e1-ecb4-4132-b959-cb4dc35638e0 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:52.220961 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5a5f1-4324-4b01-8635-ef9e87f00ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:52.221609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5a5f1-4324-4b01-8635-ef9e87f00ccf admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:52.221922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5a5f1-4324-4b01-8635-ef9e87f00ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:52.222199 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5a5f1-4324-4b01-8635-ef9e87f00ccf admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:52.222878 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a5a5f1-4324-4b01-8635-ef9e87f00ccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:52.224995 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a5a5f1-4324-4b01-8635-ef9e87f00ccf admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:52.311842 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 798/1587] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:25:52 2022] POST /identity/v3/users => generated 288 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:25:52.312036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 790/1588] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:25:52 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:25:52.315341 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5a5f1-4324-4b01-8635-ef9e87f00ccf admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:52.315491 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf75216-1c37-4403-bca5-8f015d0447a0 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:52.325998 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5a5f1-4324-4b01-8635-ef9e87f00ccf admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:52.330602 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc5dce-6e50-4e2f-bbd0-015139be046b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:52.331271 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc5dce-6e50-4e2f-bbd0-015139be046b admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:52.331563 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc5dce-6e50-4e2f-bbd0-015139be046b admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:52.331840 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc5dce-6e50-4e2f-bbd0-015139be046b admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:52.332593 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc5dce-6e50-4e2f-bbd0-015139be046b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:52.334363 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc5dce-6e50-4e2f-bbd0-015139be046b admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:52.345114 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 791/1589] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:25:52.347683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc5dce-6e50-4e2f-bbd0-015139be046b admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:52.371940 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf75216-1c37-4403-bca5-8f015d0447a0 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:52.375693 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016bf6d-be45-422d-8079-0f96d19b93b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:52.376333 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016bf6d-be45-422d-8079-0f96d19b93b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:52.376619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016bf6d-be45-422d-8079-0f96d19b93b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:52.376899 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016bf6d-be45-422d-8079-0f96d19b93b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:52.386604 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016bf6d-be45-422d-8079-0f96d19b93b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:52.388046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016bf6d-be45-422d-8079-0f96d19b93b5 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:52.397559 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 799/1590] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:25:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:25:52.402765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc5dce-6e50-4e2f-bbd0-015139be046b admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:52.402977 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016bf6d-be45-422d-8079-0f96d19b93b5 service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:52.410638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba26bbf-2f44-482a-99d9-351fa0c5fda2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:52.410638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba26bbf-2f44-482a-99d9-351fa0c5fda2 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:52.410638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba26bbf-2f44-482a-99d9-351fa0c5fda2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:52.410638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba26bbf-2f44-482a-99d9-351fa0c5fda2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:52.414671 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016bf6d-be45-422d-8079-0f96d19b93b5 service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:52.418504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba26bbf-2f44-482a-99d9-351fa0c5fda2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:52.420064 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba26bbf-2f44-482a-99d9-351fa0c5fda2 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:52.420424 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35336c0-789d-4756-81fd-6a9a8ac3810c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:52.421092 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35336c0-789d-4756-81fd-6a9a8ac3810c admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:52.421379 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35336c0-789d-4756-81fd-6a9a8ac3810c admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:52.421696 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35336c0-789d-4756-81fd-6a9a8ac3810c admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:52.422417 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35336c0-789d-4756-81fd-6a9a8ac3810c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:52.424156 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35336c0-789d-4756-81fd-6a9a8ac3810c admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:52.431883 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 792/1591] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:25:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:25:52.432719 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba26bbf-2f44-482a-99d9-351fa0c5fda2 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:52.435199 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 800/1592] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:25:52.436004 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35336c0-789d-4756-81fd-6a9a8ac3810c admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:52.444442 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba26bbf-2f44-482a-99d9-351fa0c5fda2 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:52.448557 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35336c0-789d-4756-81fd-6a9a8ac3810c admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:52.452987 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5a7d7-122a-494a-8f2f-821f12d236c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:52.453432 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a984f0-b2bb-4997-b7bf-e95a993e535d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:52.453610 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5a7d7-122a-494a-8f2f-821f12d236c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:52.453916 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5a7d7-122a-494a-8f2f-821f12d236c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:52.454129 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a984f0-b2bb-4997-b7bf-e95a993e535d admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:52.454261 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5a7d7-122a-494a-8f2f-821f12d236c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:52.454475 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a984f0-b2bb-4997-b7bf-e95a993e535d admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:52.454690 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a984f0-b2bb-4997-b7bf-e95a993e535d admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:52.454978 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5a7d7-122a-494a-8f2f-821f12d236c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:52.455534 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a984f0-b2bb-4997-b7bf-e95a993e535d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:52.456683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5a7d7-122a-494a-8f2f-821f12d236c4 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:52.457149 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a984f0-b2bb-4997-b7bf-e95a993e535d admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:52.467830 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 801/1593] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:25:52.468100 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 793/1594] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:25:52.468680 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a984f0-b2bb-4997-b7bf-e95a993e535d admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:52.469293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5a7d7-122a-494a-8f2f-821f12d236c4 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:52.479473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a984f0-b2bb-4997-b7bf-e95a993e535d admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:52.480554 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5a7d7-122a-494a-8f2f-821f12d236c4 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:52.484039 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678972f-2a0f-4b10-90ce-244b4b890ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:52.484698 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678972f-2a0f-4b10-90ce-244b4b890ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:52.484985 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678972f-2a0f-4b10-90ce-244b4b890ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:52.485215 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6edc10-12e1-4075-b7d1-f21ccb446ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:52.485325 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678972f-2a0f-4b10-90ce-244b4b890ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:52.485913 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6edc10-12e1-4075-b7d1-f21ccb446ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:52.486039 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678972f-2a0f-4b10-90ce-244b4b890ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:52.486194 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6edc10-12e1-4075-b7d1-f21ccb446ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:52.486479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6edc10-12e1-4075-b7d1-f21ccb446ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:52.487201 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6edc10-12e1-4075-b7d1-f21ccb446ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:52.487595 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678972f-2a0f-4b10-90ce-244b4b890ef4 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:52.489212 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6edc10-12e1-4075-b7d1-f21ccb446ac1 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:52.499603 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 802/1595] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:25:52.500414 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678972f-2a0f-4b10-90ce-244b4b890ef4 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:52.503820 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 794/1596] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:25:52.503820 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6edc10-12e1-4075-b7d1-f21ccb446ac1 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:52.511769 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6edc10-12e1-4075-b7d1-f21ccb446ac1 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:52.512488 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678972f-2a0f-4b10-90ce-244b4b890ef4 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:52.516327 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f782a-1870-4a97-b100-aeeee8b0157c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:52.516970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f782a-1870-4a97-b100-aeeee8b0157c admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:52.517084 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652f758-14e7-4218-8c6e-95f88f0a00ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:52.517253 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f782a-1870-4a97-b100-aeeee8b0157c admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:52.517533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f782a-1870-4a97-b100-aeeee8b0157c admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:52.517962 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652f758-14e7-4218-8c6e-95f88f0a00ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:52.518249 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652f758-14e7-4218-8c6e-95f88f0a00ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:52.518358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f782a-1870-4a97-b100-aeeee8b0157c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:52.518529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652f758-14e7-4218-8c6e-95f88f0a00ea admin admin] PATH_INFO: `/v3/projects/a199f8d3cceb43db9cee303d9c501b05/users/5462e2cddcd14ba290fa3db658128d51/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:52.519840 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f782a-1870-4a97-b100-aeeee8b0157c admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:52.531000 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 795/1597] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:25:52.531824 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f782a-1870-4a97-b100-aeeee8b0157c admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:52.535994 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652f758-14e7-4218-8c6e-95f88f0a00ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=a199f8d3cceb43db9cee303d9c501b05, user_id=5462e2cddcd14ba290fa3db658128d51, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:52.539498 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652f758-14e7-4218-8c6e-95f88f0a00ea admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:52.542197 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f782a-1870-4a97-b100-aeeee8b0157c admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:52.546897 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d71e6-89e7-4ccd-afd3-925693032233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:52.547565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d71e6-89e7-4ccd-afd3-925693032233 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:52.547848 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d71e6-89e7-4ccd-afd3-925693032233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:52.548125 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d71e6-89e7-4ccd-afd3-925693032233 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:52.548886 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d71e6-89e7-4ccd-afd3-925693032233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:52.550549 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d71e6-89e7-4ccd-afd3-925693032233 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:52.562677 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 796/1598] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:25:52.563511 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d71e6-89e7-4ccd-afd3-925693032233 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:52.575695 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d71e6-89e7-4ccd-afd3-925693032233 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:52.580537 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3764a47-8e10-49c1-922a-9268c6b01d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:52.581205 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3764a47-8e10-49c1-922a-9268c6b01d4a admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:52.581533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3764a47-8e10-49c1-922a-9268c6b01d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:52.581798 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3764a47-8e10-49c1-922a-9268c6b01d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:52.582534 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3764a47-8e10-49c1-922a-9268c6b01d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:52.584284 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3764a47-8e10-49c1-922a-9268c6b01d4a admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:52.594712 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 797/1599] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:25:52.595530 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3764a47-8e10-49c1-922a-9268c6b01d4a admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:52.607322 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3764a47-8e10-49c1-922a-9268c6b01d4a admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:52.611949 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea9503-46f7-45e2-9126-8861b0b7abe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:52.612609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea9503-46f7-45e2-9126-8861b0b7abe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:52.612892 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea9503-46f7-45e2-9126-8861b0b7abe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:52.613173 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea9503-46f7-45e2-9126-8861b0b7abe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:52.613961 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea9503-46f7-45e2-9126-8861b0b7abe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:52.616107 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea9503-46f7-45e2-9126-8861b0b7abe3 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:52.627727 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 798/1600] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:25:52.631305 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea9503-46f7-45e2-9126-8861b0b7abe3 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:52.640478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea9503-46f7-45e2-9126-8861b0b7abe3 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:52.645356 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d9abf-11ec-448b-b82a-48f5838f4792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:52.646220 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d9abf-11ec-448b-b82a-48f5838f4792 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:52.646396 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d9abf-11ec-448b-b82a-48f5838f4792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:52.646676 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d9abf-11ec-448b-b82a-48f5838f4792 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:52.647428 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d9abf-11ec-448b-b82a-48f5838f4792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:52.649157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d9abf-11ec-448b-b82a-48f5838f4792 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:52.659242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 799/1601] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:25:52.663776 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d9abf-11ec-448b-b82a-48f5838f4792 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:52.673138 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 803/1602] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:25:52 2022] PUT /identity/v3/projects/a199f8d3cceb43db9cee303d9c501b05/users/5462e2cddcd14ba290fa3db658128d51/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:25:52.673999 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d9abf-11ec-448b-b82a-48f5838f4792 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:52.674800 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652f758-14e7-4218-8c6e-95f88f0a00ea admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:52.697282 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:25:52.734970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a978a-e9f2-476d-a941-e3270d5a5b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:52.735868 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a978a-e9f2-476d-a941-e3270d5a5b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:52.736173 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a978a-e9f2-476d-a941-e3270d5a5b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:52.736448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a978a-e9f2-476d-a941-e3270d5a5b37 admin admin] PATH_INFO: `/v3/projects/b6833cf709bf450a886c72104be2cca3/users/dd463fe37aa04694a02a2776d4d45dfe/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:52.745337 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652f758-14e7-4218-8c6e-95f88f0a00ea admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:52.751692 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9bd11a-f36e-4727-a932-338370e7fa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:52.757921 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a978a-e9f2-476d-a941-e3270d5a5b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6833cf709bf450a886c72104be2cca3, user_id=dd463fe37aa04694a02a2776d4d45dfe, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:52.758063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bd11a-f36e-4727-a932-338370e7fa05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:52.758063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bd11a-f36e-4727-a932-338370e7fa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:52.758063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bd11a-f36e-4727-a932-338370e7fa05 admin admin] PATH_INFO: `/v3/projects/427fe251260e4d309d2ecb7cf532363b/users/c78243de1f4c46b399fc7328e303117a/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:52.758346 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a978a-e9f2-476d-a941-e3270d5a5b37 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:52.774708 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9bd11a-f36e-4727-a932-338370e7fa05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=427fe251260e4d309d2ecb7cf532363b, user_id=c78243de1f4c46b399fc7328e303117a, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:52.777468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9bd11a-f36e-4727-a932-338370e7fa05 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:52.874157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 800/1603] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:25:52 2022] PUT /identity/v3/projects/b6833cf709bf450a886c72104be2cca3/users/dd463fe37aa04694a02a2776d4d45dfe/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:25:52.876969 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a978a-e9f2-476d-a941-e3270d5a5b37 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:52.877128 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 804/1604] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:25:52 2022] PUT /identity/v3/projects/427fe251260e4d309d2ecb7cf532363b/users/c78243de1f4c46b399fc7328e303117a/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:25:52.877613 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9bd11a-f36e-4727-a932-338370e7fa05 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:52.896281 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:25:52.960995 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9bd11a-f36e-4727-a932-338370e7fa05 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:52.963092 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a978a-e9f2-476d-a941-e3270d5a5b37 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:52.967397 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67161c7a-bd5e-4f99-b9c8-4c6ab444ad62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:52.970444 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7a0c6-ecd2-4c59-8f9e-c00ac96c6c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:52.970594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67161c7a-bd5e-4f99-b9c8-4c6ab444ad62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:52.970702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7a0c6-ecd2-4c59-8f9e-c00ac96c6c22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:52.970803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67161c7a-bd5e-4f99-b9c8-4c6ab444ad62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:52.970904 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7a0c6-ecd2-4c59-8f9e-c00ac96c6c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:52.971031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67161c7a-bd5e-4f99-b9c8-4c6ab444ad62 admin admin] PATH_INFO: `/v3/projects/b4358d9876da4ef288a9dec2f830a652/users/d5d47cb8d622421195d3eed6bfcf2e97/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:52.971131 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7a0c6-ecd2-4c59-8f9e-c00ac96c6c22 admin admin] PATH_INFO: `/v3/projects/39e9f9b4531b4105be4cbe2452973b16/users/62bacc0d6a2342deac533c4de67041b1/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:52.985798 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67161c7a-bd5e-4f99-b9c8-4c6ab444ad62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4358d9876da4ef288a9dec2f830a652, user_id=d5d47cb8d622421195d3eed6bfcf2e97, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:52.986155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b7a0c6-ecd2-4c59-8f9e-c00ac96c6c22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39e9f9b4531b4105be4cbe2452973b16, user_id=62bacc0d6a2342deac533c4de67041b1, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:52.988369 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67161c7a-bd5e-4f99-b9c8-4c6ab444ad62 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:52.988931 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b7a0c6-ecd2-4c59-8f9e-c00ac96c6c22 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:53.113833 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 805/1606] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:25:52 2022] PUT /identity/v3/projects/b4358d9876da4ef288a9dec2f830a652/users/d5d47cb8d622421195d3eed6bfcf2e97/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:25:53.120873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 801/1606] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:25:52 2022] PUT /identity/v3/projects/39e9f9b4531b4105be4cbe2452973b16/users/62bacc0d6a2342deac533c4de67041b1/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:25:53.120873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7a0c6-ecd2-4c59-8f9e-c00ac96c6c22 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:53.121510 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443b47a-e804-457c-b2ab-68b2d1012176 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:53.121510 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443b47a-e804-457c-b2ab-68b2d1012176 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:53.121510 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443b47a-e804-457c-b2ab-68b2d1012176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:53.154717 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-8443b47a-e804-457c-b2ab-68b2d1012176 None None] MFA Rules not processed for user `5462e2cddcd14ba290fa3db658128d51`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:25:53.157035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-8443b47a-e804-457c-b2ab-68b2d1012176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:53.201365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7a0c6-ecd2-4c59-8f9e-c00ac96c6c22 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:53.223730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbdd08-b419-4a05-9b52-8642d270e13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:53.225722 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbdd08-b419-4a05-9b52-8642d270e13a admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:53.226388 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbdd08-b419-4a05-9b52-8642d270e13a admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:53.226888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbdd08-b419-4a05-9b52-8642d270e13a admin admin] PATH_INFO: `/v3/projects/45153c22cc9244548b70967319aa9e5a/users/527d6eaa70974bfaba07963b2cf70116/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:53.235796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 806/1607] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:25:53 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:25:53.237290 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5615bd-c121-4e76-a5b6-7ccd49411bad None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:53.237529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5615bd-c121-4e76-a5b6-7ccd49411bad None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:53.237831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5615bd-c121-4e76-a5b6-7ccd49411bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:53.248064 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbdd08-b419-4a05-9b52-8642d270e13a admin admin] RBAC: Authorizing `identity:create_grant(project_id=45153c22cc9244548b70967319aa9e5a, user_id=527d6eaa70974bfaba07963b2cf70116, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:53.251613 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbdd08-b419-4a05-9b52-8642d270e13a admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:53.268413 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-ac5615bd-c121-4e76-a5b6-7ccd49411bad None None] MFA Rules not processed for user `dd463fe37aa04694a02a2776d4d45dfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:25:53.275885 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-ac5615bd-c121-4e76-a5b6-7ccd49411bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:53.336165 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 807/1608] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:25:53 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:25:53.337590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35facd-d4c8-4507-9f11-f1b42bcb0fca None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:53.337937 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35facd-d4c8-4507-9f11-f1b42bcb0fca None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:53.338219 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35facd-d4c8-4507-9f11-f1b42bcb0fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:53.356055 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:25:53.363354 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 802/1609] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:25:53 2022] PUT /identity/v3/projects/45153c22cc9244548b70967319aa9e5a/users/527d6eaa70974bfaba07963b2cf70116/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:25:53.365392 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-9d35facd-d4c8-4507-9f11-f1b42bcb0fca None None] MFA Rules not processed for user `c78243de1f4c46b399fc7328e303117a`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:25:53.382640 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b298ed-98e7-4fbf-ab6d-7771c0a2d79a None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:53.382640 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b298ed-98e7-4fbf-ab6d-7771c0a2d79a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:53.382640 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b298ed-98e7-4fbf-ab6d-7771c0a2d79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:53.382947 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-9d35facd-d4c8-4507-9f11-f1b42bcb0fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:53.388771 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-32b298ed-98e7-4fbf-ab6d-7771c0a2d79a None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:25:53.390047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-32b298ed-98e7-4fbf-ab6d-7771c0a2d79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:53.398659 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:25:53.432341 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 808/1610] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:25:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:25:53.433709 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a872a-7d79-412c-95fc-15bea619fccd None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:53.434041 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a872a-7d79-412c-95fc-15bea619fccd None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:53.434324 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a872a-7d79-412c-95fc-15bea619fccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:53.453400 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 803/1611] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:25:53.454419 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b298ed-98e7-4fbf-ab6d-7771c0a2d79a None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:53.458225 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-f22a872a-7d79-412c-95fc-15bea619fccd None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:25:53.460030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-f22a872a-7d79-412c-95fc-15bea619fccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:53.482422 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 809/1612] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:25:53.482422 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a872a-7d79-412c-95fc-15bea619fccd None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:53.486445 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b298ed-98e7-4fbf-ab6d-7771c0a2d79a None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:53.493223 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d62731-e924-4e4f-aea5-fa9349468453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:53.493866 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d62731-e924-4e4f-aea5-fa9349468453 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:53.494156 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d62731-e924-4e4f-aea5-fa9349468453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:53.494582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d62731-e924-4e4f-aea5-fa9349468453 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:53.495857 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d62731-e924-4e4f-aea5-fa9349468453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:53.498593 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d62731-e924-4e4f-aea5-fa9349468453 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:53.538135 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a872a-7d79-412c-95fc-15bea619fccd None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:53.542325 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fc791-be59-49ec-9fcf-fe0773de1d1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:53.542983 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fc791-be59-49ec-9fcf-fe0773de1d1e service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:53.543279 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fc791-be59-49ec-9fcf-fe0773de1d1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:53.543551 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fc791-be59-49ec-9fcf-fe0773de1d1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:53.617035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426fc791-be59-49ec-9fcf-fe0773de1d1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:53.617513 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 804/1613] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:25:53 2022] POST /identity/v3/projects => generated 365 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:25:53.619382 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426fc791-be59-49ec-9fcf-fe0773de1d1e service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:53.620586 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dc824-5974-4e0f-918b-c02e46b77a2e None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:53.621120 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dc824-5974-4e0f-918b-c02e46b77a2e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:53.621609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dc824-5974-4e0f-918b-c02e46b77a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:53.639632 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 810/1614] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:25:53 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:25:53.642510 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8214c71-e376-4cff-a627-fc145b9889da None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:53.642805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8214c71-e376-4cff-a627-fc145b9889da None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:53.646861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8214c71-e376-4cff-a627-fc145b9889da None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:53.649543 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 811/1615] 10.222.0.23 () {54 vars in 961 bytes} [Mon Jul 11 11:25:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:25:53.649543 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8214c71-e376-4cff-a627-fc145b9889da None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:53.654783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-2e7dc824-5974-4e0f-918b-c02e46b77a2e None None] MFA Rules not processed for user `527d6eaa70974bfaba07963b2cf70116`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:25:53.656325 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2e7dc824-5974-4e0f-918b-c02e46b77a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:53.660336 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-f8214c71-e376-4cff-a627-fc145b9889da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:53.733408 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 805/1616] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:25:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:25:53.734475 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7dc824-5974-4e0f-918b-c02e46b77a2e None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:53.758482 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8214c71-e376-4cff-a627-fc145b9889da None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:53.762580 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4689b4-e3dc-4c4e-a6cf-41b646368966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:53.763330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4689b4-e3dc-4c4e-a6cf-41b646368966 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:53.763732 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4689b4-e3dc-4c4e-a6cf-41b646368966 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:53.764089 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4689b4-e3dc-4c4e-a6cf-41b646368966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:53.821081 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7dc824-5974-4e0f-918b-c02e46b77a2e None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:53.827117 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5dfef-c316-4ea2-a6a2-00f6689fe7c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:53.828090 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5dfef-c316-4ea2-a6a2-00f6689fe7c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:53.828371 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5dfef-c316-4ea2-a6a2-00f6689fe7c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:53.828655 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5dfef-c316-4ea2-a6a2-00f6689fe7c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:53.837142 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4689b4-e3dc-4c4e-a6cf-41b646368966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:53.838777 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4689b4-e3dc-4c4e-a6cf-41b646368966 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:53.851281 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 812/1617] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:25:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:25:53.852296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4689b4-e3dc-4c4e-a6cf-41b646368966 service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:53.855379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5dfef-c316-4ea2-a6a2-00f6689fe7c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:53.860894 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5dfef-c316-4ea2-a6a2-00f6689fe7c4 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:53.863587 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4689b4-e3dc-4c4e-a6cf-41b646368966 service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:53.877223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff304dd-67b4-4ddc-81f1-f39bf211176e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:53.878116 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff304dd-67b4-4ddc-81f1-f39bf211176e admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:53.878411 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff304dd-67b4-4ddc-81f1-f39bf211176e admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:53.878745 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff304dd-67b4-4ddc-81f1-f39bf211176e admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:53.880100 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff304dd-67b4-4ddc-81f1-f39bf211176e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:53.882700 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff304dd-67b4-4ddc-81f1-f39bf211176e admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:53.892151 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 806/1618] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:25:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:25:53.893855 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5bc5c5-ff70-4885-91a4-7d28449e9f54 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:53.894335 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5bc5c5-ff70-4885-91a4-7d28449e9f54 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:53.894780 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5bc5c5-ff70-4885-91a4-7d28449e9f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:53.944487 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-9b5bc5c5-ff70-4885-91a4-7d28449e9f54 None None] MFA Rules not processed for user `5b9e7594afc346e593ef3e6c579e237b`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:25:53.953419 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9b5bc5c5-ff70-4885-91a4-7d28449e9f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:53.985066 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 813/1619] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:25:53 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:25:53.985066 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff304dd-67b4-4ddc-81f1-f39bf211176e admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:53.993891 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff304dd-67b4-4ddc-81f1-f39bf211176e admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:53.998381 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c096b2-bfd5-45f6-97c6-64e77d0ded35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:53.999049 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c096b2-bfd5-45f6-97c6-64e77d0ded35 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:53.999343 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c096b2-bfd5-45f6-97c6-64e77d0ded35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:53.999623 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c096b2-bfd5-45f6-97c6-64e77d0ded35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:54.000319 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c096b2-bfd5-45f6-97c6-64e77d0ded35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:54.002818 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c096b2-bfd5-45f6-97c6-64e77d0ded35 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:54.033895 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 807/1620] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Jul 11 11:25:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:25:54.034841 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5bc5c5-ff70-4885-91a4-7d28449e9f54 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:54.045244 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5bc5c5-ff70-4885-91a4-7d28449e9f54 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:54.049835 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d416c7-ac58-44f0-a809-b5bff34f9779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:54.050482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d416c7-ac58-44f0-a809-b5bff34f9779 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:54.050769 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d416c7-ac58-44f0-a809-b5bff34f9779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:54.051051 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d416c7-ac58-44f0-a809-b5bff34f9779 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:54.051810 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d416c7-ac58-44f0-a809-b5bff34f9779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:54.054068 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d416c7-ac58-44f0-a809-b5bff34f9779 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:54.063775 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 808/1621] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:25:54.064676 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d416c7-ac58-44f0-a809-b5bff34f9779 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:54.081822 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d416c7-ac58-44f0-a809-b5bff34f9779 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:54.084365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651f4cb-15b2-4648-b31a-d4d6a06e0eba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:54.085352 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651f4cb-15b2-4648-b31a-d4d6a06e0eba service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:54.085696 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651f4cb-15b2-4648-b31a-d4d6a06e0eba service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:54.086010 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651f4cb-15b2-4648-b31a-d4d6a06e0eba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:54.112274 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 814/1622] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:25:53 2022] POST /identity/v3/projects => generated 387 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:25:54.113568 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c096b2-bfd5-45f6-97c6-64e77d0ded35 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:54.162724 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651f4cb-15b2-4648-b31a-d4d6a06e0eba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:54.164866 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651f4cb-15b2-4648-b31a-d4d6a06e0eba service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:54.180199 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 809/1623] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:25:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:25:54.181785 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651f4cb-15b2-4648-b31a-d4d6a06e0eba service nova] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:54.194599 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651f4cb-15b2-4648-b31a-d4d6a06e0eba service nova] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:54.197751 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c096b2-bfd5-45f6-97c6-64e77d0ded35 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:54.200069 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852bd03-e7ab-457d-825a-be8a91db5e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:54.200923 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852bd03-e7ab-457d-825a-be8a91db5e2d admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:54.201210 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852bd03-e7ab-457d-825a-be8a91db5e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:54.201548 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852bd03-e7ab-457d-825a-be8a91db5e2d admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:54.202247 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852bd03-e7ab-457d-825a-be8a91db5e2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:54.204208 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852bd03-e7ab-457d-825a-be8a91db5e2d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:54.204774 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b25ca9-fc96-47a7-adc7-e847aaa8c704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:54.205622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b25ca9-fc96-47a7-adc7-e847aaa8c704 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:54.206039 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b25ca9-fc96-47a7-adc7-e847aaa8c704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:54.206482 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b25ca9-fc96-47a7-adc7-e847aaa8c704 admin admin] PATH_INFO: `/v3/projects/ded33f8d334b422a91bc71df0f5192e8/users/b72182edcbb046b9935d78dffa4a402f/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:54.225821 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b25ca9-fc96-47a7-adc7-e847aaa8c704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ded33f8d334b422a91bc71df0f5192e8, user_id=b72182edcbb046b9935d78dffa4a402f, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:54.228836 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b25ca9-fc96-47a7-adc7-e847aaa8c704 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:54.233965 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:25:54.346987 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:25:54.366246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 810/1624] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:25:54 2022] POST /identity/v3/users => generated 300 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:25:54.368464 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852bd03-e7ab-457d-825a-be8a91db5e2d admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:54.387634 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 815/1625] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:25:54 2022] PUT /identity/v3/projects/ded33f8d334b422a91bc71df0f5192e8/users/b72182edcbb046b9935d78dffa4a402f/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:25:54.391696 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b25ca9-fc96-47a7-adc7-e847aaa8c704 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:54.410422 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852bd03-e7ab-457d-825a-be8a91db5e2d admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:54.543705 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b25ca9-fc96-47a7-adc7-e847aaa8c704 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:54.547632 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6403f-b405-471a-bf6f-b0d794d458dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:54.548310 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6403f-b405-471a-bf6f-b0d794d458dc admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:54.548596 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6403f-b405-471a-bf6f-b0d794d458dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:54.548901 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6403f-b405-471a-bf6f-b0d794d458dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:54.565224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d83ec9-3554-4cc3-a239-a0048cdb3b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:54.565224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d83ec9-3554-4cc3-a239-a0048cdb3b30 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:54.565224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d83ec9-3554-4cc3-a239-a0048cdb3b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:54.565224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d83ec9-3554-4cc3-a239-a0048cdb3b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:54.566304 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6403f-b405-471a-bf6f-b0d794d458dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:54.566480 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d83ec9-3554-4cc3-a239-a0048cdb3b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:54.566480 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d83ec9-3554-4cc3-a239-a0048cdb3b30 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:54.571270 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6403f-b405-471a-bf6f-b0d794d458dc admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:54.593813 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 811/1626] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:25:54.600884 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d83ec9-3554-4cc3-a239-a0048cdb3b30 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:54.614386 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d83ec9-3554-4cc3-a239-a0048cdb3b30 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:54.623978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 816/1627] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:25:54.625093 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6403f-b405-471a-bf6f-b0d794d458dc admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:54.643052 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b16e2-f3b0-4ccc-bfe8-2802e1dd7f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:54.643628 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6403f-b405-471a-bf6f-b0d794d458dc admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:54.645806 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b16e2-f3b0-4ccc-bfe8-2802e1dd7f25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:54.647609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b16e2-f3b0-4ccc-bfe8-2802e1dd7f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:54.648147 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b16e2-f3b0-4ccc-bfe8-2802e1dd7f25 admin admin] PATH_INFO: `/v3/projects/da514db5466e45389ad8615fd303eb47/users/0709ad509bbe4bf4a2d6fa35ce676a5f/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:54.650311 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878fd55e-670f-40b1-b119-08c8d36b896b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:54.651319 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fd55e-670f-40b1-b119-08c8d36b896b admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:54.651706 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fd55e-670f-40b1-b119-08c8d36b896b admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:54.652085 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fd55e-670f-40b1-b119-08c8d36b896b admin admin] PATH_INFO: `/v3/projects/ded33f8d334b422a91bc71df0f5192e8/users/b72182edcbb046b9935d78dffa4a402f/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:54.655588 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878fd55e-670f-40b1-b119-08c8d36b896b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ded33f8d334b422a91bc71df0f5192e8, user_id=b72182edcbb046b9935d78dffa4a402f, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:54.666696 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878fd55e-670f-40b1-b119-08c8d36b896b admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:54.677860 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b16e2-f3b0-4ccc-bfe8-2802e1dd7f25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da514db5466e45389ad8615fd303eb47, user_id=0709ad509bbe4bf4a2d6fa35ce676a5f, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:54.679632 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 817/1628] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:25:54 2022] PUT /identity/v3/projects/ded33f8d334b422a91bc71df0f5192e8/users/b72182edcbb046b9935d78dffa4a402f/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:25:54.682106 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b16e2-f3b0-4ccc-bfe8-2802e1dd7f25 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:54.689573 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b87770-5aa5-42cf-9d5a-91ada3d4e6a8 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:54.689895 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b87770-5aa5-42cf-9d5a-91ada3d4e6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:54.690180 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b87770-5aa5-42cf-9d5a-91ada3d4e6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:54.707561 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:25:54.727425 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-26b87770-5aa5-42cf-9d5a-91ada3d4e6a8 None None] MFA Rules not processed for user `b72182edcbb046b9935d78dffa4a402f`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:25:54.729035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-26b87770-5aa5-42cf-9d5a-91ada3d4e6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:54.810210 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 812/1629] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:25:54 2022] PUT /identity/v3/projects/da514db5466e45389ad8615fd303eb47/users/0709ad509bbe4bf4a2d6fa35ce676a5f/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:25:54.819784 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b16e2-f3b0-4ccc-bfe8-2802e1dd7f25 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:54.999889 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 818/1630] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:25:54 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:25:55.013794 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b87770-5aa5-42cf-9d5a-91ada3d4e6a8 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:55.099277 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b16e2-f3b0-4ccc-bfe8-2802e1dd7f25 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:55.116414 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d82e2-59ec-4f7a-b506-c0d31c65893f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:55.117524 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d82e2-59ec-4f7a-b506-c0d31c65893f admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:55.118828 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d82e2-59ec-4f7a-b506-c0d31c65893f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:55.119133 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d82e2-59ec-4f7a-b506-c0d31c65893f admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:55.119908 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d82e2-59ec-4f7a-b506-c0d31c65893f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:55.133737 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d82e2-59ec-4f7a-b506-c0d31c65893f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:55.168059 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 813/1631] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:25:55.172013 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b87770-5aa5-42cf-9d5a-91ada3d4e6a8 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:55.179674 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97face-6172-49e5-9a90-42ff73e243a7 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:55.181562 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97face-6172-49e5-9a90-42ff73e243a7 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:55.181906 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97face-6172-49e5-9a90-42ff73e243a7 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:55.194095 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 814/1632] 10.222.0.23 () {54 vars in 961 bytes} [Mon Jul 11 11:25:55 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:25:55.194969 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97face-6172-49e5-9a90-42ff73e243a7 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:55.221691 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97face-6172-49e5-9a90-42ff73e243a7 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:55.229613 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e60226-a9df-4acd-892b-3e64a8ca6644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:55.231544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e60226-a9df-4acd-892b-3e64a8ca6644 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:55.235194 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e60226-a9df-4acd-892b-3e64a8ca6644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:55.235194 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e60226-a9df-4acd-892b-3e64a8ca6644 admin admin] PATH_INFO: `/v3/projects/da514db5466e45389ad8615fd303eb47/users/0709ad509bbe4bf4a2d6fa35ce676a5f/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:55.235686 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e60226-a9df-4acd-892b-3e64a8ca6644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da514db5466e45389ad8615fd303eb47, user_id=0709ad509bbe4bf4a2d6fa35ce676a5f, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:55.239091 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e60226-a9df-4acd-892b-3e64a8ca6644 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:55.265731 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 815/1633] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:25:55 2022] PUT /identity/v3/projects/da514db5466e45389ad8615fd303eb47/users/0709ad509bbe4bf4a2d6fa35ce676a5f/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:25:55.267562 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d48b3f-2801-4223-9b65-f5255256ed42 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:55.269552 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d48b3f-2801-4223-9b65-f5255256ed42 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:55.269552 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d48b3f-2801-4223-9b65-f5255256ed42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:55.291172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807874e9-2bab-46a8-9fbf-05badb2b5103 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:55.291861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807874e9-2bab-46a8-9fbf-05badb2b5103 service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:55.292154 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807874e9-2bab-46a8-9fbf-05badb2b5103 service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:55.292442 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807874e9-2bab-46a8-9fbf-05badb2b5103 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:55.314552 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-72d48b3f-2801-4223-9b65-f5255256ed42 None None] MFA Rules not processed for user `5b9e7594afc346e593ef3e6c579e237b`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:25:55.317513 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-72d48b3f-2801-4223-9b65-f5255256ed42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:55.400038 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:25:55.421455 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807874e9-2bab-46a8-9fbf-05badb2b5103 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:55.423886 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807874e9-2bab-46a8-9fbf-05badb2b5103 service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:55.436655 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 819/1634] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:25:55 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:25:55.438385 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b4be4-1129-42df-9136-dc7fa70e3fac None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:55.438904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b4be4-1129-42df-9136-dc7fa70e3fac None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:55.439334 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b4be4-1129-42df-9136-dc7fa70e3fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:55.453383 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 816/1635] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Jul 11 11:25:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:25:55.455618 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce577bba-8bab-4ad0-8016-c044cf434398 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:55.455927 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce577bba-8bab-4ad0-8016-c044cf434398 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:55.456214 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce577bba-8bab-4ad0-8016-c044cf434398 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:55.464019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 817/1636] 10.222.0.23 () {54 vars in 912 bytes} [Mon Jul 11 11:25:55 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:25:55.466331 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd2555-b452-4a27-94ad-9ad0023400c9 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:55.466630 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd2555-b452-4a27-94ad-9ad0023400c9 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:55.466924 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd2555-b452-4a27-94ad-9ad0023400c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:55.497650 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-16bd2555-b452-4a27-94ad-9ad0023400c9 None None] MFA Rules not processed for user `5b9e7594afc346e593ef3e6c579e237b`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:25:55.499031 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-16bd2555-b452-4a27-94ad-9ad0023400c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:55.507929 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-6f9b4be4-1129-42df-9136-dc7fa70e3fac None None] MFA Rules not processed for user `0709ad509bbe4bf4a2d6fa35ce676a5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:25:55.509526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-6f9b4be4-1129-42df-9136-dc7fa70e3fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:55.519786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 818/1637] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Jul 11 11:25:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:25:55.529556 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd2555-b452-4a27-94ad-9ad0023400c9 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:55.611931 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 820/1638] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:25:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:25:55.620062 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd2555-b452-4a27-94ad-9ad0023400c9 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:55.624332 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5b913-f841-4b9a-b96c-c1d025fb592c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:55.625095 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5b913-f841-4b9a-b96c-c1d025fb592c service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:55.628243 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5b913-f841-4b9a-b96c-c1d025fb592c service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:55.628243 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5b913-f841-4b9a-b96c-c1d025fb592c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:55.653007 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b4be4-1129-42df-9136-dc7fa70e3fac None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:55.655516 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5b913-f841-4b9a-b96c-c1d025fb592c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:55.657364 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5b913-f841-4b9a-b96c-c1d025fb592c service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:55.673526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b4be4-1129-42df-9136-dc7fa70e3fac None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:55.679133 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 819/1639] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:25:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:25:55.689092 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112bfb22-d32e-4361-a02a-bd828b677c14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:55.690243 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bfb22-d32e-4361-a02a-bd828b677c14 service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:55.690780 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bfb22-d32e-4361-a02a-bd828b677c14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:55.691301 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bfb22-d32e-4361-a02a-bd828b677c14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:55.704827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112bfb22-d32e-4361-a02a-bd828b677c14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:55.706820 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112bfb22-d32e-4361-a02a-bd828b677c14 service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:56.061249 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 821/1640] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:25:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:25:56.111367 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cbfd2-be25-477a-8c51-d4e401ff8121 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:56.111367 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cbfd2-be25-477a-8c51-d4e401ff8121 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:56.111367 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cbfd2-be25-477a-8c51-d4e401ff8121 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:56.111367 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 820/1641] 10.222.0.23 () {54 vars in 912 bytes} [Mon Jul 11 11:25:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:25:56.123244 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1e8eb-08af-4290-8233-84b9b23f980f None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:56.123244 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1e8eb-08af-4290-8233-84b9b23f980f None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:56.123244 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1e8eb-08af-4290-8233-84b9b23f980f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:56.123244 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-43c1e8eb-08af-4290-8233-84b9b23f980f None None] MFA Rules not processed for user `5b9e7594afc346e593ef3e6c579e237b`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:25:56.123244 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-43c1e8eb-08af-4290-8233-84b9b23f980f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:56.123244 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 822/1642] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Jul 11 11:25:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:25:56.131368 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314cbfd2-be25-477a-8c51-d4e401ff8121 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:56.134884 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1e8eb-08af-4290-8233-84b9b23f980f None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:56.135730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314cbfd2-be25-477a-8c51-d4e401ff8121 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:56.135730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4b74e-9861-40be-b0e4-08b88aa46985 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:56.135730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4b74e-9861-40be-b0e4-08b88aa46985 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:56.135730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4b74e-9861-40be-b0e4-08b88aa46985 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:56.136872 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4b74e-9861-40be-b0e4-08b88aa46985 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:56.137086 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1e8eb-08af-4290-8233-84b9b23f980f None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:56.137086 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fcb4f7-ef1f-430e-91bd-5b05bfb36642 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:56.137086 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcb4f7-ef1f-430e-91bd-5b05bfb36642 service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:56.137086 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcb4f7-ef1f-430e-91bd-5b05bfb36642 service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:56.137777 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcb4f7-ef1f-430e-91bd-5b05bfb36642 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:56.137777 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fcb4f7-ef1f-430e-91bd-5b05bfb36642 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:56.137777 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fcb4f7-ef1f-430e-91bd-5b05bfb36642 service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:56.137777 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 823/1643] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:25:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:25:56.228402 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4b74e-9861-40be-b0e4-08b88aa46985 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:56.228402 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4b74e-9861-40be-b0e4-08b88aa46985 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:56.234706 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 821/1644] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:25:55 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:25:56.339452 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fcb4f7-ef1f-430e-91bd-5b05bfb36642 service cinder] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:56.368305 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4b74e-9861-40be-b0e4-08b88aa46985 service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:56.434701 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fcb4f7-ef1f-430e-91bd-5b05bfb36642 service cinder] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:56.442577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc7fee-8263-42fe-875d-8088377b7610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:56.444317 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc7fee-8263-42fe-875d-8088377b7610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:56.444621 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc7fee-8263-42fe-875d-8088377b7610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:56.444932 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc7fee-8263-42fe-875d-8088377b7610 admin admin] PATH_INFO: `/v3/users/c78243de1f4c46b399fc7328e303117a` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:56.446562 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc7fee-8263-42fe-875d-8088377b7610 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c78243de1f4c46b399fc7328e303117a)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:56.450713 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc7fee-8263-42fe-875d-8088377b7610 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:56.462438 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4b74e-9861-40be-b0e4-08b88aa46985 service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:56.469033 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c081f-26b5-4998-9642-5da4e1fe841d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:56.470172 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c081f-26b5-4998-9642-5da4e1fe841d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:56.470618 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c081f-26b5-4998-9642-5da4e1fe841d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:56.470904 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c081f-26b5-4998-9642-5da4e1fe841d admin admin] PATH_INFO: `/v3/users/527d6eaa70974bfaba07963b2cf70116` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:56.472190 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c081f-26b5-4998-9642-5da4e1fe841d admin admin] RBAC: Authorizing `identity:delete_user(user_id=527d6eaa70974bfaba07963b2cf70116)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:56.473297 dv-cinder-848429-2-smb devstack@keystone.service[80521]: WARNING py.warnings [None req-eb3c081f-26b5-4998-9642-5da4e1fe841d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 11:25:56.473297 dv-cinder-848429-2-smb devstack@keystone.service[80521]: warnings.warn(msg) Jul 11 11:25:56.473297 dv-cinder-848429-2-smb devstack@keystone.service[80521]: Jul 11 11:25:56.475366 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c081f-26b5-4998-9642-5da4e1fe841d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:56.785833 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6ddc7fee-8263-42fe-875d-8088377b7610 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c78243de1f4c46b399fc7328e303117a'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:25:56.858558 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:25:56.888357 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-eb3c081f-26b5-4998-9642-5da4e1fe841d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '527d6eaa70974bfaba07963b2cf70116'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:25:56.889641 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-eb3c081f-26b5-4998-9642-5da4e1fe841d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '527d6eaa70974bfaba07963b2cf70116'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:25:56.899303 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6ddc7fee-8263-42fe-875d-8088377b7610 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c78243de1f4c46b399fc7328e303117a'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:25:56.917175 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-eb3c081f-26b5-4998-9642-5da4e1fe841d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '527d6eaa70974bfaba07963b2cf70116'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:25:56.933295 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6ddc7fee-8263-42fe-875d-8088377b7610 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c78243de1f4c46b399fc7328e303117a'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:25:56.934687 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6ddc7fee-8263-42fe-875d-8088377b7610 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c78243de1f4c46b399fc7328e303117a'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:25:56.935461 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6ddc7fee-8263-42fe-875d-8088377b7610 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c78243de1f4c46b399fc7328e303117a'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:25:56.973798 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 824/1645] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:25:56 2022] DELETE /identity/v3/users/c78243de1f4c46b399fc7328e303117a => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:25:56.979475 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a6b27-c66d-40eb-aa7a-cc3e63e9cae6 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:56.980102 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a6b27-c66d-40eb-aa7a-cc3e63e9cae6 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:56.980659 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a6b27-c66d-40eb-aa7a-cc3e63e9cae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:57.005079 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-cd1a6b27-c66d-40eb-aa7a-cc3e63e9cae6 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:25:57.007409 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-cd1a6b27-c66d-40eb-aa7a-cc3e63e9cae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:57.010681 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-eb3c081f-26b5-4998-9642-5da4e1fe841d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '527d6eaa70974bfaba07963b2cf70116'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:25:57.063640 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-eb3c081f-26b5-4998-9642-5da4e1fe841d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '527d6eaa70974bfaba07963b2cf70116'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:25:57.073451 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 822/1646] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:25:56 2022] DELETE /identity/v3/users/527d6eaa70974bfaba07963b2cf70116 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:25:57.078019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10256394-f829-49a6-85d3-376cee64585f None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:57.078592 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10256394-f829-49a6-85d3-376cee64585f None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:57.080650 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10256394-f829-49a6-85d3-376cee64585f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:57.127412 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-10256394-f829-49a6-85d3-376cee64585f None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:25:57.129040 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-10256394-f829-49a6-85d3-376cee64585f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:57.150021 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 825/1647] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:25:57.195319 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a6b27-c66d-40eb-aa7a-cc3e63e9cae6 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:57.197029 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-cd1a6b27-c66d-40eb-aa7a-cc3e63e9cae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:57.249369 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 823/1648] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:25:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:25:57.563273 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a6b27-c66d-40eb-aa7a-cc3e63e9cae6 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:57.563273 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246e2c0-5d8b-4fd9-82b1-793b96227437 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:57.563273 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246e2c0-5d8b-4fd9-82b1-793b96227437 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:57.563273 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246e2c0-5d8b-4fd9-82b1-793b96227437 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:57.565082 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246e2c0-5d8b-4fd9-82b1-793b96227437 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:57.565082 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246e2c0-5d8b-4fd9-82b1-793b96227437 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:57.565082 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246e2c0-5d8b-4fd9-82b1-793b96227437 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:57.565082 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 826/1649] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:25:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:25:57.566508 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10256394-f829-49a6-85d3-376cee64585f None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:57.566508 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10256394-f829-49a6-85d3-376cee64585f None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:57.566508 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e9bfc-472f-40be-8646-3c12c8516577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:57.566508 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e9bfc-472f-40be-8646-3c12c8516577 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:57.566924 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e9bfc-472f-40be-8646-3c12c8516577 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:57.566924 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e9bfc-472f-40be-8646-3c12c8516577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:57.588562 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e9bfc-472f-40be-8646-3c12c8516577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:57.591949 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e9bfc-472f-40be-8646-3c12c8516577 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:57.617664 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 824/1650] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:25:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:25:58.661185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:25:59.215058 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:25:59.481343 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246e2c0-5d8b-4fd9-82b1-793b96227437 service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:59.482674 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e9bfc-472f-40be-8646-3c12c8516577 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:59.484214 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-b246e2c0-5d8b-4fd9-82b1-793b96227437 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:59.484697 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-661e9bfc-472f-40be-8646-3c12c8516577 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:59.506409 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e9bfc-472f-40be-8646-3c12c8516577 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:59.516630 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4bb7eb-43c0-46a6-ae12-f089e14c6a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:59.518717 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bb7eb-43c0-46a6-ae12-f089e14c6a3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:59.520238 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bb7eb-43c0-46a6-ae12-f089e14c6a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:59.520749 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bb7eb-43c0-46a6-ae12-f089e14c6a3e admin admin] PATH_INFO: `/v3/projects/427fe251260e4d309d2ecb7cf532363b` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:59.534762 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4bb7eb-43c0-46a6-ae12-f089e14c6a3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=427fe251260e4d309d2ecb7cf532363b)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:59.535959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246e2c0-5d8b-4fd9-82b1-793b96227437 service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:25:59.541233 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4bb7eb-43c0-46a6-ae12-f089e14c6a3e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:59.544938 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efd5db-36c0-4852-b22d-389b1c8e3525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:25:59.546094 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efd5db-36c0-4852-b22d-389b1c8e3525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:25:59.546644 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efd5db-36c0-4852-b22d-389b1c8e3525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:25:59.547105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efd5db-36c0-4852-b22d-389b1c8e3525 admin admin] PATH_INFO: `/v3/projects/45153c22cc9244548b70967319aa9e5a` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:25:59.562231 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8efd5db-36c0-4852-b22d-389b1c8e3525 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45153c22cc9244548b70967319aa9e5a)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:25:59.572155 dv-cinder-848429-2-smb devstack@keystone.service[80522]: WARNING py.warnings [None req-f8efd5db-36c0-4852-b22d-389b1c8e3525 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 11:25:59.572155 dv-cinder-848429-2-smb devstack@keystone.service[80522]: warnings.warn(msg) Jul 11 11:25:59.572155 dv-cinder-848429-2-smb devstack@keystone.service[80522]: Jul 11 11:25:59.574828 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8efd5db-36c0-4852-b22d-389b1c8e3525 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:25:59.798723 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4b4bb7eb-43c0-46a6-ae12-f089e14c6a3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '427fe251260e4d309d2ecb7cf532363b', 'request_id': 'req-4b4bb7eb-43c0-46a6-ae12-f089e14c6a3e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:25:59.812442 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-f8efd5db-36c0-4852-b22d-389b1c8e3525 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45153c22cc9244548b70967319aa9e5a', 'request_id': 'req-f8efd5db-36c0-4852-b22d-389b1c8e3525'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:25:59.816545 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4b4bb7eb-43c0-46a6-ae12-f089e14c6a3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '427fe251260e4d309d2ecb7cf532363b', 'request_id': 'req-4b4bb7eb-43c0-46a6-ae12-f089e14c6a3e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:25:59.883374 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-f8efd5db-36c0-4852-b22d-389b1c8e3525 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45153c22cc9244548b70967319aa9e5a', 'request_id': 'req-f8efd5db-36c0-4852-b22d-389b1c8e3525'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:25:59.937267 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-f8efd5db-36c0-4852-b22d-389b1c8e3525 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45153c22cc9244548b70967319aa9e5a', 'request_id': 'req-f8efd5db-36c0-4852-b22d-389b1c8e3525'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:25:59.965160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-f8efd5db-36c0-4852-b22d-389b1c8e3525 admin admin] The token cache is being invalidate because project 45153c22cc9244548b70967319aa9e5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:25:59.967614 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-f8efd5db-36c0-4852-b22d-389b1c8e3525 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:25:59.969656 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-f8efd5db-36c0-4852-b22d-389b1c8e3525 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:25:59.974606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 827/1651] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:25:59 2022] DELETE /identity/v3/projects/45153c22cc9244548b70967319aa9e5a => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:25:59.978460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efd5db-36c0-4852-b22d-389b1c8e3525 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:25:59.983755 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-f8efd5db-36c0-4852-b22d-389b1c8e3525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:25:59.989166 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4b4bb7eb-43c0-46a6-ae12-f089e14c6a3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '427fe251260e4d309d2ecb7cf532363b', 'request_id': 'req-4b4bb7eb-43c0-46a6-ae12-f089e14c6a3e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:00.020799 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4b4bb7eb-43c0-46a6-ae12-f089e14c6a3e admin admin] The token cache is being invalidate because project 427fe251260e4d309d2ecb7cf532363b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:26:00.021433 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4b4bb7eb-43c0-46a6-ae12-f089e14c6a3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:00.027762 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4b4bb7eb-43c0-46a6-ae12-f089e14c6a3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:00.029223 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 825/1652] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:25:59 2022] DELETE /identity/v3/projects/427fe251260e4d309d2ecb7cf532363b => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:00.031035 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef27cb-fd24-4914-80f2-f5dcb3682128 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:00.031761 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef27cb-fd24-4914-80f2-f5dcb3682128 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:00.033044 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef27cb-fd24-4914-80f2-f5dcb3682128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:00.116270 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-2aef27cb-fd24-4914-80f2-f5dcb3682128 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:00.124119 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2aef27cb-fd24-4914-80f2-f5dcb3682128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:00.221363 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efd5db-36c0-4852-b22d-389b1c8e3525 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:00.254078 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6f84d-8bf3-411a-9525-75d86d2faf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:00.255926 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6f84d-8bf3-411a-9525-75d86d2faf40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:00.255926 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6f84d-8bf3-411a-9525-75d86d2faf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:00.256116 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6f84d-8bf3-411a-9525-75d86d2faf40 admin admin] PATH_INFO: `/v3/users/0709ad509bbe4bf4a2d6fa35ce676a5f` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:00.257484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6f84d-8bf3-411a-9525-75d86d2faf40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0709ad509bbe4bf4a2d6fa35ce676a5f)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:00.259915 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6f84d-8bf3-411a-9525-75d86d2faf40 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:00.331602 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 826/1653] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:00.342705 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbda26-1553-4ccb-be60-bbd24433f72b None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:00.343287 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbda26-1553-4ccb-be60-bbd24433f72b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:00.343921 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbda26-1553-4ccb-be60-bbd24433f72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:00.419358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-52dbda26-1553-4ccb-be60-bbd24433f72b None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:00.420627 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-52dbda26-1553-4ccb-be60-bbd24433f72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:00.438099 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:00.449705 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 827/1654] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:00.450902 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbda26-1553-4ccb-be60-bbd24433f72b None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:00.468341 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbda26-1553-4ccb-be60-bbd24433f72b None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:00.479131 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b117bb8-9a62-4134-be32-ac0c2561938f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:00.480083 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b117bb8-9a62-4134-be32-ac0c2561938f admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:00.480513 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b117bb8-9a62-4134-be32-ac0c2561938f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:00.480957 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b117bb8-9a62-4134-be32-ac0c2561938f admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:00.481933 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b117bb8-9a62-4134-be32-ac0c2561938f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:26:00.485317 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b117bb8-9a62-4134-be32-ac0c2561938f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:00.485317 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b117bb8-9a62-4134-be32-ac0c2561938f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:00.502828 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 828/1655] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:26:00.507478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b117bb8-9a62-4134-be32-ac0c2561938f admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:00.522415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b117bb8-9a62-4134-be32-ac0c2561938f admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:00.529576 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab89be3-9162-42b6-be9f-009cf366d423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:00.530642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab89be3-9162-42b6-be9f-009cf366d423 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:00.531136 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab89be3-9162-42b6-be9f-009cf366d423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:00.531609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab89be3-9162-42b6-be9f-009cf366d423 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:00.532512 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab89be3-9162-42b6-be9f-009cf366d423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:00.535638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab89be3-9162-42b6-be9f-009cf366d423 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:00.615950 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:00.654455 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-0bf6f84d-8bf3-411a-9525-75d86d2faf40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0709ad509bbe4bf4a2d6fa35ce676a5f'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:00.689252 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 829/1656] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:26:00 2022] POST /identity/v3/projects => generated 373 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:00.690449 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab89be3-9162-42b6-be9f-009cf366d423 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:00.769603 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-0bf6f84d-8bf3-411a-9525-75d86d2faf40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0709ad509bbe4bf4a2d6fa35ce676a5f'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:00.782696 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-0bf6f84d-8bf3-411a-9525-75d86d2faf40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0709ad509bbe4bf4a2d6fa35ce676a5f'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:00.784638 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-0bf6f84d-8bf3-411a-9525-75d86d2faf40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0709ad509bbe4bf4a2d6fa35ce676a5f'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:00.787543 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-0bf6f84d-8bf3-411a-9525-75d86d2faf40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0709ad509bbe4bf4a2d6fa35ce676a5f'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:00.872234 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 828/1657] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:25:59 2022] DELETE /identity/v3/users/0709ad509bbe4bf4a2d6fa35ce676a5f => generated 0 bytes in 894 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:00.893975 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab89be3-9162-42b6-be9f-009cf366d423 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:01.048874 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93049b-8afe-4a6c-b591-87c486a1f99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:01.049655 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93049b-8afe-4a6c-b591-87c486a1f99a admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:01.050043 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93049b-8afe-4a6c-b591-87c486a1f99a admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:01.050318 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93049b-8afe-4a6c-b591-87c486a1f99a admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:01.051036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93049b-8afe-4a6c-b591-87c486a1f99a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:01.053621 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93049b-8afe-4a6c-b591-87c486a1f99a admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:01.214964 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6f84d-8bf3-411a-9525-75d86d2faf40 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:01.216629 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-0bf6f84d-8bf3-411a-9525-75d86d2faf40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:01.219358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 830/1658] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:26:00 2022] POST /identity/v3/users => generated 287 bytes in 529 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:01.236758 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6f84d-8bf3-411a-9525-75d86d2faf40 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:01.255760 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1a713-c27c-4d4a-a817-8138ac1464de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:01.256484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1a713-c27c-4d4a-a817-8138ac1464de admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:01.256751 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1a713-c27c-4d4a-a817-8138ac1464de admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:01.257336 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1a713-c27c-4d4a-a817-8138ac1464de admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:01.258132 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1a713-c27c-4d4a-a817-8138ac1464de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:01.261993 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1a713-c27c-4d4a-a817-8138ac1464de admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:01.299102 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 829/1659] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:26:01.304366 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93049b-8afe-4a6c-b591-87c486a1f99a admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:01.315810 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93049b-8afe-4a6c-b591-87c486a1f99a admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:01.339544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9102d5-136d-4ebb-8df0-5f217f855a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:01.340254 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9102d5-136d-4ebb-8df0-5f217f855a5d admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:01.340605 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9102d5-136d-4ebb-8df0-5f217f855a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:01.340881 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9102d5-136d-4ebb-8df0-5f217f855a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:01.341628 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9102d5-136d-4ebb-8df0-5f217f855a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:01.343303 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9102d5-136d-4ebb-8df0-5f217f855a5d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:01.359310 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1a713-c27c-4d4a-a817-8138ac1464de admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:01.369199 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 831/1660] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:26:01.373914 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1a713-c27c-4d4a-a817-8138ac1464de admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:01.381684 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb17149-546a-495a-8ce3-e7be8f5ff745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:01.382651 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb17149-546a-495a-8ce3-e7be8f5ff745 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:01.382936 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb17149-546a-495a-8ce3-e7be8f5ff745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:01.383213 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb17149-546a-495a-8ce3-e7be8f5ff745 admin admin] PATH_INFO: `/v3/projects/ea1dabc9d1224cbcbaff232c4fabcfe7/users/611ba4ccbad94447ba2f6cbfae96b59c/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:01.418923 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb17149-546a-495a-8ce3-e7be8f5ff745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea1dabc9d1224cbcbaff232c4fabcfe7, user_id=611ba4ccbad94447ba2f6cbfae96b59c, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:01.422131 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb17149-546a-495a-8ce3-e7be8f5ff745 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:01.558445 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 830/1661] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:26:01 2022] PUT /identity/v3/projects/ea1dabc9d1224cbcbaff232c4fabcfe7/users/611ba4ccbad94447ba2f6cbfae96b59c/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:01.569774 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a42c6c-0381-4a5f-84aa-05c1d99e9b7c None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:01.570075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a42c6c-0381-4a5f-84aa-05c1d99e9b7c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:01.570360 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a42c6c-0381-4a5f-84aa-05c1d99e9b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:01.626565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-23a42c6c-0381-4a5f-84aa-05c1d99e9b7c None None] MFA Rules not processed for user `611ba4ccbad94447ba2f6cbfae96b59c`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:01.637176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-23a42c6c-0381-4a5f-84aa-05c1d99e9b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:01.800703 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 832/1662] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:01.805975 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb17149-546a-495a-8ce3-e7be8f5ff745 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:01.929186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb17149-546a-495a-8ce3-e7be8f5ff745 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:01.935268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cce01-cbe0-4043-a438-a84866fa028e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:01.939544 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cce01-cbe0-4043-a438-a84866fa028e admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:01.939544 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cce01-cbe0-4043-a438-a84866fa028e admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:01.939544 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cce01-cbe0-4043-a438-a84866fa028e admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:01.939544 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0cce01-cbe0-4043-a438-a84866fa028e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:01.941242 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0cce01-cbe0-4043-a438-a84866fa028e admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:02.109094 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a42c6c-0381-4a5f-84aa-05c1d99e9b7c None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:02.110932 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 831/1663] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:26:01 2022] POST /identity/v3/projects => generated 373 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:02.122052 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a42c6c-0381-4a5f-84aa-05c1d99e9b7c None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:02.216307 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84a562-68a1-4ba8-a5bf-c1ec3b81d644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:02.217317 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84a562-68a1-4ba8-a5bf-c1ec3b81d644 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:02.217827 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84a562-68a1-4ba8-a5bf-c1ec3b81d644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:02.218329 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84a562-68a1-4ba8-a5bf-c1ec3b81d644 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:02.219237 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84a562-68a1-4ba8-a5bf-c1ec3b81d644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:02.221374 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84a562-68a1-4ba8-a5bf-c1ec3b81d644 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:02.345805 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 833/1664] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:26:02 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:26:02.346536 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cce01-cbe0-4043-a438-a84866fa028e admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:02.368121 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cce01-cbe0-4043-a438-a84866fa028e admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:02.386595 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79308e2-ae6c-434d-8d93-0007c10d9345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:02.387833 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79308e2-ae6c-434d-8d93-0007c10d9345 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:02.387833 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79308e2-ae6c-434d-8d93-0007c10d9345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:02.388131 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79308e2-ae6c-434d-8d93-0007c10d9345 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:02.388830 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79308e2-ae6c-434d-8d93-0007c10d9345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:02.390638 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79308e2-ae6c-434d-8d93-0007c10d9345 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:02.412869 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 832/1665] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:26:02.416117 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84a562-68a1-4ba8-a5bf-c1ec3b81d644 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:02.429077 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84a562-68a1-4ba8-a5bf-c1ec3b81d644 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:02.446622 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b53f47-8c70-48fc-84d7-d9508a5f4250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:02.447616 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b53f47-8c70-48fc-84d7-d9508a5f4250 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:02.447897 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b53f47-8c70-48fc-84d7-d9508a5f4250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:02.448185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b53f47-8c70-48fc-84d7-d9508a5f4250 admin admin] PATH_INFO: `/v3/projects/90aaef50efc54821b1d986220a1ee0ce/users/5f5e5c559ca447b8bb7d22903ae2e3dc/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:02.486894 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b53f47-8c70-48fc-84d7-d9508a5f4250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90aaef50efc54821b1d986220a1ee0ce, user_id=5f5e5c559ca447b8bb7d22903ae2e3dc, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:02.509832 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b53f47-8c70-48fc-84d7-d9508a5f4250 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:02.617086 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 834/1666] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:26:02 2022] PUT /identity/v3/projects/90aaef50efc54821b1d986220a1ee0ce/users/5f5e5c559ca447b8bb7d22903ae2e3dc/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:02.621526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79308e2-ae6c-434d-8d93-0007c10d9345 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:02.637359 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79308e2-ae6c-434d-8d93-0007c10d9345 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:02.800105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e607624-f537-4e44-972e-ee06a2bb819a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:02.801621 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e607624-f537-4e44-972e-ee06a2bb819a admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:02.802769 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e607624-f537-4e44-972e-ee06a2bb819a admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:02.803067 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e607624-f537-4e44-972e-ee06a2bb819a admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:02.803995 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e607624-f537-4e44-972e-ee06a2bb819a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:02.805932 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e607624-f537-4e44-972e-ee06a2bb819a admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:02.810634 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b53f47-8c70-48fc-84d7-d9508a5f4250 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:02.812591 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-75b53f47-8c70-48fc-84d7-d9508a5f4250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:02.837987 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b53f47-8c70-48fc-84d7-d9508a5f4250 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:02.845662 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 833/1667] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:26:02.851738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e607624-f537-4e44-972e-ee06a2bb819a admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:02.853725 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f6673-0b9c-4473-be52-829bc1cd7bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:02.854664 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f6673-0b9c-4473-be52-829bc1cd7bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:02.855005 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f6673-0b9c-4473-be52-829bc1cd7bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:02.855293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f6673-0b9c-4473-be52-829bc1cd7bf2 admin admin] PATH_INFO: `/v3/projects/da514db5466e45389ad8615fd303eb47` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:02.857683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f6673-0b9c-4473-be52-829bc1cd7bf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da514db5466e45389ad8615fd303eb47)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:02.863425 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f6673-0b9c-4473-be52-829bc1cd7bf2 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:02.876083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e607624-f537-4e44-972e-ee06a2bb819a admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:02.889207 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26252410-95eb-450e-a291-b76ad446dd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:02.890175 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26252410-95eb-450e-a291-b76ad446dd99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:02.890471 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26252410-95eb-450e-a291-b76ad446dd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:02.890752 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26252410-95eb-450e-a291-b76ad446dd99 admin admin] PATH_INFO: `/v3/projects/90aaef50efc54821b1d986220a1ee0ce/users/5f5e5c559ca447b8bb7d22903ae2e3dc/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:02.897917 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26252410-95eb-450e-a291-b76ad446dd99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90aaef50efc54821b1d986220a1ee0ce, user_id=5f5e5c559ca447b8bb7d22903ae2e3dc, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:02.900639 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26252410-95eb-450e-a291-b76ad446dd99 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:02.928295 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 834/1668] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:26:02 2022] PUT /identity/v3/projects/90aaef50efc54821b1d986220a1ee0ce/users/5f5e5c559ca447b8bb7d22903ae2e3dc/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:02.939951 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82868a92-b3c7-420f-a159-795a6df66755 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:02.940254 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82868a92-b3c7-420f-a159-795a6df66755 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:02.940545 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82868a92-b3c7-420f-a159-795a6df66755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:02.993897 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-82868a92-b3c7-420f-a159-795a6df66755 None None] MFA Rules not processed for user `5f5e5c559ca447b8bb7d22903ae2e3dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:02.996063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-82868a92-b3c7-420f-a159-795a6df66755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:03.111778 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4f1f6673-0b9c-4473-be52-829bc1cd7bf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da514db5466e45389ad8615fd303eb47', 'request_id': 'req-4f1f6673-0b9c-4473-be52-829bc1cd7bf2'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:03.135589 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4f1f6673-0b9c-4473-be52-829bc1cd7bf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da514db5466e45389ad8615fd303eb47', 'request_id': 'req-4f1f6673-0b9c-4473-be52-829bc1cd7bf2'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:03.174789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 835/1669] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:03.189689 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82868a92-b3c7-420f-a159-795a6df66755 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:03.191866 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-82868a92-b3c7-420f-a159-795a6df66755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:03.226600 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4f1f6673-0b9c-4473-be52-829bc1cd7bf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da514db5466e45389ad8615fd303eb47', 'request_id': 'req-4f1f6673-0b9c-4473-be52-829bc1cd7bf2'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:03.247239 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4f1f6673-0b9c-4473-be52-829bc1cd7bf2 admin admin] The token cache is being invalidate because project da514db5466e45389ad8615fd303eb47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:26:03.247552 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4f1f6673-0b9c-4473-be52-829bc1cd7bf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:03.255688 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4f1f6673-0b9c-4473-be52-829bc1cd7bf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:03.268138 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 835/1670] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:26:02 2022] DELETE /identity/v3/projects/da514db5466e45389ad8615fd303eb47 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:26:03.275410 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610567d-2322-4e24-8d62-1875b25a9e5c None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:03.275746 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610567d-2322-4e24-8d62-1875b25a9e5c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:03.276035 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610567d-2322-4e24-8d62-1875b25a9e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:03.348514 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-2610567d-2322-4e24-8d62-1875b25a9e5c None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:03.362800 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2610567d-2322-4e24-8d62-1875b25a9e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:03.413537 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82868a92-b3c7-420f-a159-795a6df66755 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:03.503396 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 836/1671] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:03.512027 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831be201-2a25-4f79-9c4f-273d6700e8cf None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:03.512436 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831be201-2a25-4f79-9c4f-273d6700e8cf None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:03.513414 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831be201-2a25-4f79-9c4f-273d6700e8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:03.545156 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88684a44-fe03-498a-8c5b-7de7cee196c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:03.545943 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88684a44-fe03-498a-8c5b-7de7cee196c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:03.546235 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88684a44-fe03-498a-8c5b-7de7cee196c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:03.546515 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88684a44-fe03-498a-8c5b-7de7cee196c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:03.548781 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-88684a44-fe03-498a-8c5b-7de7cee196c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:03.560354 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-831be201-2a25-4f79-9c4f-273d6700e8cf None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:03.562148 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-831be201-2a25-4f79-9c4f-273d6700e8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:03.599788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 837/1672] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:26:03.603453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831be201-2a25-4f79-9c4f-273d6700e8cf None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:03.622676 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:03.635459 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831be201-2a25-4f79-9c4f-273d6700e8cf None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:03.666941 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456803c8-25b9-4b13-b6d9-4848b93d70b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:03.667722 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456803c8-25b9-4b13-b6d9-4848b93d70b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:03.668010 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456803c8-25b9-4b13-b6d9-4848b93d70b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:03.668290 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456803c8-25b9-4b13-b6d9-4848b93d70b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:03.669043 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456803c8-25b9-4b13-b6d9-4848b93d70b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:26:03.669353 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456803c8-25b9-4b13-b6d9-4848b93d70b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:03.671024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456803c8-25b9-4b13-b6d9-4848b93d70b8 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:03.699288 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:03.708451 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88684a44-fe03-498a-8c5b-7de7cee196c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:03.709987 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88684a44-fe03-498a-8c5b-7de7cee196c3 service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:03.718775 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 838/1673] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:26:03.724304 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456803c8-25b9-4b13-b6d9-4848b93d70b8 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:03.741501 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 836/1674] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:03 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:26:03.749020 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456803c8-25b9-4b13-b6d9-4848b93d70b8 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:03.756164 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd925be3-3a04-49e7-a6d9-66d690854c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:03.757102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd925be3-3a04-49e7-a6d9-66d690854c6d admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:03.769330 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd925be3-3a04-49e7-a6d9-66d690854c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:03.769649 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd925be3-3a04-49e7-a6d9-66d690854c6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:03.770924 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd925be3-3a04-49e7-a6d9-66d690854c6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:03.772872 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd925be3-3a04-49e7-a6d9-66d690854c6d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:03.964781 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88684a44-fe03-498a-8c5b-7de7cee196c3 service cinder] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:03.969585 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 839/1675] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:26:03 2022] POST /identity/v3/projects => generated 373 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:03.979822 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88684a44-fe03-498a-8c5b-7de7cee196c3 service cinder] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:04.086659 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863bd35-4d41-45b6-a45f-ca7768aefec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:04.093799 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863bd35-4d41-45b6-a45f-ca7768aefec0 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:04.094089 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863bd35-4d41-45b6-a45f-ca7768aefec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:04.094370 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863bd35-4d41-45b6-a45f-ca7768aefec0 admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:04.095081 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863bd35-4d41-45b6-a45f-ca7768aefec0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:04.097123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863bd35-4d41-45b6-a45f-ca7768aefec0 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:04.244270 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 837/1676] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:26:03 2022] POST /identity/v3/users => generated 287 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:26:04.249127 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd925be3-3a04-49e7-a6d9-66d690854c6d admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:04.271756 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863bd35-4d41-45b6-a45f-ca7768aefec0 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:04.286037 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd925be3-3a04-49e7-a6d9-66d690854c6d admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:04.286623 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-4863bd35-4d41-45b6-a45f-ca7768aefec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:04.309035 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92cbca-631f-458f-93b6-dcb5fc5aa4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:04.310973 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92cbca-631f-458f-93b6-dcb5fc5aa4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:04.311479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92cbca-631f-458f-93b6-dcb5fc5aa4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:04.312344 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92cbca-631f-458f-93b6-dcb5fc5aa4c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:04.313287 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92cbca-631f-458f-93b6-dcb5fc5aa4c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:04.316032 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92cbca-631f-458f-93b6-dcb5fc5aa4c4 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:04.347561 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 840/1677] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:26:04.348998 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92cbca-631f-458f-93b6-dcb5fc5aa4c4 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:04.374148 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92cbca-631f-458f-93b6-dcb5fc5aa4c4 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:04.382026 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834f69e-2a9d-4fb9-9e3b-bc917011626b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:04.382960 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834f69e-2a9d-4fb9-9e3b-bc917011626b admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:04.389650 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834f69e-2a9d-4fb9-9e3b-bc917011626b admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:04.392278 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834f69e-2a9d-4fb9-9e3b-bc917011626b admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:04.393791 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834f69e-2a9d-4fb9-9e3b-bc917011626b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:04.396850 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834f69e-2a9d-4fb9-9e3b-bc917011626b admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:04.409468 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 841/1678] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:26:04.414893 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834f69e-2a9d-4fb9-9e3b-bc917011626b admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:04.429191 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834f69e-2a9d-4fb9-9e3b-bc917011626b admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:04.438526 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438601e9-99b4-4950-b85f-e4685cdb45ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:04.440113 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438601e9-99b4-4950-b85f-e4685cdb45ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:04.440601 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438601e9-99b4-4950-b85f-e4685cdb45ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:04.441121 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438601e9-99b4-4950-b85f-e4685cdb45ae admin admin] PATH_INFO: `/v3/projects/80692611ee7d4750ad037ebe99a849ee/users/23502fbb91094f03bb81afa75dbeeb82/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:04.467527 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863bd35-4d41-45b6-a45f-ca7768aefec0 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:04.470790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438601e9-99b4-4950-b85f-e4685cdb45ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=80692611ee7d4750ad037ebe99a849ee, user_id=23502fbb91094f03bb81afa75dbeeb82, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:04.477365 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ab222-2bc7-4a7b-a33f-8976ca697bc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:04.478144 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438601e9-99b4-4950-b85f-e4685cdb45ae admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:04.478833 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ab222-2bc7-4a7b-a33f-8976ca697bc6 service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:04.480237 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ab222-2bc7-4a7b-a33f-8976ca697bc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:04.480391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ab222-2bc7-4a7b-a33f-8976ca697bc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:04.487030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-793ab222-2bc7-4a7b-a33f-8976ca697bc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:04.590122 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 842/1679] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:26:04 2022] PUT /identity/v3/projects/80692611ee7d4750ad037ebe99a849ee/users/23502fbb91094f03bb81afa75dbeeb82/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:26:04.602205 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9148fd-6b7e-4d75-8da0-5f1048a0a562 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:04.602420 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9148fd-6b7e-4d75-8da0-5f1048a0a562 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:04.602687 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9148fd-6b7e-4d75-8da0-5f1048a0a562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:04.673817 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-ad9148fd-6b7e-4d75-8da0-5f1048a0a562 None None] MFA Rules not processed for user `23502fbb91094f03bb81afa75dbeeb82`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:04.678757 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ad9148fd-6b7e-4d75-8da0-5f1048a0a562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:04.709105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ab222-2bc7-4a7b-a33f-8976ca697bc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:04.710860 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ab222-2bc7-4a7b-a33f-8976ca697bc6 service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:04.752156 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 838/1680] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:26:04.923564 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 843/1681] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:26:05.109027 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ab222-2bc7-4a7b-a33f-8976ca697bc6 service cinder] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:05.112203 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-793ab222-2bc7-4a7b-a33f-8976ca697bc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:05.150424 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ab222-2bc7-4a7b-a33f-8976ca697bc6 service cinder] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:05.278551 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b0639-dad6-43c1-9d41-4f6aa40e8479 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:05.279390 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b0639-dad6-43c1-9d41-4f6aa40e8479 service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:05.279756 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b0639-dad6-43c1-9d41-4f6aa40e8479 service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:05.280137 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b0639-dad6-43c1-9d41-4f6aa40e8479 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:05.297045 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b0639-dad6-43c1-9d41-4f6aa40e8479 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:05.298862 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b0639-dad6-43c1-9d41-4f6aa40e8479 service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:05.313911 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 839/1682] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:26:05.343623 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9148fd-6b7e-4d75-8da0-5f1048a0a562 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:05.592257 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9148fd-6b7e-4d75-8da0-5f1048a0a562 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:05.600212 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c26e8-1080-4a3a-ac5a-82bab8fbc285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:05.601268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c26e8-1080-4a3a-ac5a-82bab8fbc285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:05.601654 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c26e8-1080-4a3a-ac5a-82bab8fbc285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:05.602057 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c26e8-1080-4a3a-ac5a-82bab8fbc285 admin admin] PATH_INFO: `/v3/users/23502fbb91094f03bb81afa75dbeeb82` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:05.603401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c26e8-1080-4a3a-ac5a-82bab8fbc285 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23502fbb91094f03bb81afa75dbeeb82)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:05.609474 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c26e8-1080-4a3a-ac5a-82bab8fbc285 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:05.844272 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2cbe3-cf14-422c-bba4-49b679aa7627 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:05.844750 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2cbe3-cf14-422c-bba4-49b679aa7627 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:05.844930 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2cbe3-cf14-422c-bba4-49b679aa7627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:05.869439 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-eb8c26e8-1080-4a3a-ac5a-82bab8fbc285 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23502fbb91094f03bb81afa75dbeeb82'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:05.870279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-eb8c26e8-1080-4a3a-ac5a-82bab8fbc285 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23502fbb91094f03bb81afa75dbeeb82'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:05.885067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-eb8c26e8-1080-4a3a-ac5a-82bab8fbc285 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23502fbb91094f03bb81afa75dbeeb82'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:05.961967 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-a5e2cbe3-cf14-422c-bba4-49b679aa7627 None None] MFA Rules not processed for user `1d322f9350b7475b94493d4bbcd61349`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:05.966358 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-a5e2cbe3-cf14-422c-bba4-49b679aa7627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:06.032545 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-eb8c26e8-1080-4a3a-ac5a-82bab8fbc285 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23502fbb91094f03bb81afa75dbeeb82'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:06.063591 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-eb8c26e8-1080-4a3a-ac5a-82bab8fbc285 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23502fbb91094f03bb81afa75dbeeb82'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:06.076806 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 844/1683] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:26:05 2022] DELETE /identity/v3/users/23502fbb91094f03bb81afa75dbeeb82 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:06.083527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd98e74-d440-46e0-8df7-c546a9c68a8f None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:06.084316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd98e74-d440-46e0-8df7-c546a9c68a8f None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:06.084847 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd98e74-d440-46e0-8df7-c546a9c68a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:06.121619 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-ebd98e74-d440-46e0-8df7-c546a9c68a8f None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:06.123613 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ebd98e74-d440-46e0-8df7-c546a9c68a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:06.233023 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 840/1684] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:06.241815 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2cbe3-cf14-422c-bba4-49b679aa7627 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:06.243518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-a5e2cbe3-cf14-422c-bba4-49b679aa7627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:06.313489 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 845/1685] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:06.320310 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd98e74-d440-46e0-8df7-c546a9c68a8f None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:06.322082 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ebd98e74-d440-46e0-8df7-c546a9c68a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:06.447283 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2cbe3-cf14-422c-bba4-49b679aa7627 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:06.456439 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd98e74-d440-46e0-8df7-c546a9c68a8f None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:06.469279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99073d9b-88fc-4e2f-adb2-1227c79bfb90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:06.471321 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99073d9b-88fc-4e2f-adb2-1227c79bfb90 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:06.471622 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99073d9b-88fc-4e2f-adb2-1227c79bfb90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:06.471904 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99073d9b-88fc-4e2f-adb2-1227c79bfb90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:06.497198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99073d9b-88fc-4e2f-adb2-1227c79bfb90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:06.498808 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99073d9b-88fc-4e2f-adb2-1227c79bfb90 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:06.503543 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:06.522553 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 846/1686] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:26:06.683442 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b1474-6510-4873-80ae-c0820ea6f8b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:06.689093 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b1474-6510-4873-80ae-c0820ea6f8b6 service nova] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:06.689387 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b1474-6510-4873-80ae-c0820ea6f8b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:06.689668 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b1474-6510-4873-80ae-c0820ea6f8b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:06.712284 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:06.857217 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b1474-6510-4873-80ae-c0820ea6f8b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:06.859683 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b1474-6510-4873-80ae-c0820ea6f8b6 service nova] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:06.875021 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 841/1687] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:26:07.954679 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99073d9b-88fc-4e2f-adb2-1227c79bfb90 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:07.961693 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-99073d9b-88fc-4e2f-adb2-1227c79bfb90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:08.001123 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99073d9b-88fc-4e2f-adb2-1227c79bfb90 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:08.013281 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e1f9d-72ed-4f7a-8454-374b596667b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:08.014258 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e1f9d-72ed-4f7a-8454-374b596667b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:08.014554 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e1f9d-72ed-4f7a-8454-374b596667b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:08.014840 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e1f9d-72ed-4f7a-8454-374b596667b8 admin admin] PATH_INFO: `/v3/projects/80692611ee7d4750ad037ebe99a849ee` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:08.017076 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e1f9d-72ed-4f7a-8454-374b596667b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80692611ee7d4750ad037ebe99a849ee)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:08.018823 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e1f9d-72ed-4f7a-8454-374b596667b8 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:08.215684 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-fc4e1f9d-72ed-4f7a-8454-374b596667b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80692611ee7d4750ad037ebe99a849ee', 'request_id': 'req-fc4e1f9d-72ed-4f7a-8454-374b596667b8'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:08.235879 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-fc4e1f9d-72ed-4f7a-8454-374b596667b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80692611ee7d4750ad037ebe99a849ee', 'request_id': 'req-fc4e1f9d-72ed-4f7a-8454-374b596667b8'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:08.329749 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-fc4e1f9d-72ed-4f7a-8454-374b596667b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80692611ee7d4750ad037ebe99a849ee', 'request_id': 'req-fc4e1f9d-72ed-4f7a-8454-374b596667b8'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:08.368662 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-fc4e1f9d-72ed-4f7a-8454-374b596667b8 admin admin] The token cache is being invalidate because project 80692611ee7d4750ad037ebe99a849ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:26:08.369142 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-fc4e1f9d-72ed-4f7a-8454-374b596667b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:08.370218 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-fc4e1f9d-72ed-4f7a-8454-374b596667b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:08.372596 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 847/1688] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:26:07 2022] DELETE /identity/v3/projects/80692611ee7d4750ad037ebe99a849ee => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:08.377367 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b63f2-1991-465f-b008-9a324da2c14a None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:08.383328 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b63f2-1991-465f-b008-9a324da2c14a None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:08.383651 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b63f2-1991-465f-b008-9a324da2c14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:08.420127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-506b63f2-1991-465f-b008-9a324da2c14a None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:08.421639 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-506b63f2-1991-465f-b008-9a324da2c14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:08.649072 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:08.675419 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 842/1689] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:26:08.683989 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80448d7-ca01-431d-a975-f56a608da946 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:08.684454 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80448d7-ca01-431d-a975-f56a608da946 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:08.684873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80448d7-ca01-431d-a975-f56a608da946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:08.725785 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-f80448d7-ca01-431d-a975-f56a608da946 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:08.725785 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f80448d7-ca01-431d-a975-f56a608da946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:08.756637 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b63f2-1991-465f-b008-9a324da2c14a None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:08.764368 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 848/1690] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:08.774120 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b63f2-1991-465f-b008-9a324da2c14a None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:08.782154 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b1c16-fe2d-488e-864c-f1c4af7c693c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:08.783129 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b1c16-fe2d-488e-864c-f1c4af7c693c admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:08.783591 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b1c16-fe2d-488e-864c-f1c4af7c693c admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:08.784051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b1c16-fe2d-488e-864c-f1c4af7c693c admin admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:08.785111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b1c16-fe2d-488e-864c-f1c4af7c693c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:26:08.785645 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b1c16-fe2d-488e-864c-f1c4af7c693c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:08.789330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b1c16-fe2d-488e-864c-f1c4af7c693c admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:08.803684 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 843/1691] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:26:08.808205 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80448d7-ca01-431d-a975-f56a608da946 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:08.827822 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80448d7-ca01-431d-a975-f56a608da946 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:08.837679 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dd47e-67e4-4ba4-b535-5521396890a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:08.838642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dd47e-67e4-4ba4-b535-5521396890a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:08.839068 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dd47e-67e4-4ba4-b535-5521396890a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:08.840009 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dd47e-67e4-4ba4-b535-5521396890a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:08.841153 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123dd47e-67e4-4ba4-b535-5521396890a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:08.843587 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123dd47e-67e4-4ba4-b535-5521396890a3 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:09.059622 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 849/1692] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:26:08 2022] POST /identity/v3/projects => generated 385 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:26:09.064223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b1c16-fe2d-488e-864c-f1c4af7c693c admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:09.083963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b1c16-fe2d-488e-864c-f1c4af7c693c admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:09.210645 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6fdbad-6dcd-449a-855e-748f830f5ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:09.211471 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fdbad-6dcd-449a-855e-748f830f5ddd admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:09.211868 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fdbad-6dcd-449a-855e-748f830f5ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:09.212320 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fdbad-6dcd-449a-855e-748f830f5ddd admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:09.213289 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6fdbad-6dcd-449a-855e-748f830f5ddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:09.218687 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6fdbad-6dcd-449a-855e-748f830f5ddd admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:09.350692 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 844/1693] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:26:09 2022] POST /identity/v3/users => generated 293 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:09.354359 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dd47e-67e4-4ba4-b535-5521396890a3 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:09.377388 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dd47e-67e4-4ba4-b535-5521396890a3 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:09.384364 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c928f7-8a2b-4ffd-b094-98912aa8098c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:09.385063 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c928f7-8a2b-4ffd-b094-98912aa8098c admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:09.385346 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c928f7-8a2b-4ffd-b094-98912aa8098c admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:09.385625 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c928f7-8a2b-4ffd-b094-98912aa8098c admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:09.386464 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c928f7-8a2b-4ffd-b094-98912aa8098c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:09.390061 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c928f7-8a2b-4ffd-b094-98912aa8098c admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:09.414608 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 850/1694] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:26:09.418904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6fdbad-6dcd-449a-855e-748f830f5ddd admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:09.476945 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6fdbad-6dcd-449a-855e-748f830f5ddd admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:09.511229 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb61dc-092e-4a2e-85a6-a58601566d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:09.512867 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb61dc-092e-4a2e-85a6-a58601566d9e admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:09.524508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb61dc-092e-4a2e-85a6-a58601566d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:09.525253 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb61dc-092e-4a2e-85a6-a58601566d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:09.526386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb61dc-092e-4a2e-85a6-a58601566d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:09.547693 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb61dc-092e-4a2e-85a6-a58601566d9e admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:09.561918 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 845/1695] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:26:09.565899 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c928f7-8a2b-4ffd-b094-98912aa8098c admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:09.581687 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:09.586276 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c928f7-8a2b-4ffd-b094-98912aa8098c admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:09.602898 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff127f12-0152-4bb5-a992-c93bdea469ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:09.604072 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff127f12-0152-4bb5-a992-c93bdea469ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:09.604359 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff127f12-0152-4bb5-a992-c93bdea469ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:09.604637 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff127f12-0152-4bb5-a992-c93bdea469ef admin admin] PATH_INFO: `/v3/projects/e89ccb78f4ab4886a3adab7b9d40b641/users/2f30b7bdd9df4cb38de93bfd4f407907/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:09.651987 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff127f12-0152-4bb5-a992-c93bdea469ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=e89ccb78f4ab4886a3adab7b9d40b641, user_id=2f30b7bdd9df4cb38de93bfd4f407907, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:09.655371 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff127f12-0152-4bb5-a992-c93bdea469ef admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:09.731794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 851/1696] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:26:09 2022] PUT /identity/v3/projects/e89ccb78f4ab4886a3adab7b9d40b641/users/2f30b7bdd9df4cb38de93bfd4f407907/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:09.743932 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b907ce5-faf2-4ae8-9f22-21da15d5a5e8 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:09.744599 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b907ce5-faf2-4ae8-9f22-21da15d5a5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:09.745125 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b907ce5-faf2-4ae8-9f22-21da15d5a5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:09.848313 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-6b907ce5-faf2-4ae8-9f22-21da15d5a5e8 None None] MFA Rules not processed for user `2f30b7bdd9df4cb38de93bfd4f407907`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:09.858350 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-6b907ce5-faf2-4ae8-9f22-21da15d5a5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:10.061631 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 846/1697] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:10.066538 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff127f12-0152-4bb5-a992-c93bdea469ef admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:10.205525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff127f12-0152-4bb5-a992-c93bdea469ef admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:10.215624 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f53d78-1b44-4429-a210-5759e8810d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:10.216813 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f53d78-1b44-4429-a210-5759e8810d1c admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:10.217245 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f53d78-1b44-4429-a210-5759e8810d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:10.217693 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f53d78-1b44-4429-a210-5759e8810d1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:10.218709 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f53d78-1b44-4429-a210-5759e8810d1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:10.222291 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f53d78-1b44-4429-a210-5759e8810d1c admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:10.258927 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b907ce5-faf2-4ae8-9f22-21da15d5a5e8 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:10.258927 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-6b907ce5-faf2-4ae8-9f22-21da15d5a5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:10.300186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b907ce5-faf2-4ae8-9f22-21da15d5a5e8 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:10.322506 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cd774-9d92-4eb3-8962-27fa754b47fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:10.323414 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cd774-9d92-4eb3-8962-27fa754b47fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:10.323701 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cd774-9d92-4eb3-8962-27fa754b47fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:10.324391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cd774-9d92-4eb3-8962-27fa754b47fb admin admin] PATH_INFO: `/v3/users/5462e2cddcd14ba290fa3db658128d51` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:10.327896 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cd774-9d92-4eb3-8962-27fa754b47fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5462e2cddcd14ba290fa3db658128d51)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:10.337565 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cd774-9d92-4eb3-8962-27fa754b47fb admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:10.388411 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 852/1698] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:26:10 2022] POST /identity/v3/projects => generated 383 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:10.393082 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f53d78-1b44-4429-a210-5759e8810d1c admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:10.415492 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:10.543298 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f53d78-1b44-4429-a210-5759e8810d1c admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:10.548810 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbbff2-6b7d-4801-b56f-eb50a0a36692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:10.549944 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbbff2-6b7d-4801-b56f-eb50a0a36692 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:10.550283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbbff2-6b7d-4801-b56f-eb50a0a36692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:10.550619 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbbff2-6b7d-4801-b56f-eb50a0a36692 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:10.551336 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbbff2-6b7d-4801-b56f-eb50a0a36692 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:10.555443 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbbff2-6b7d-4801-b56f-eb50a0a36692 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:10.654776 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-498cd774-9d92-4eb3-8962-27fa754b47fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5462e2cddcd14ba290fa3db658128d51'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:10.752358 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-498cd774-9d92-4eb3-8962-27fa754b47fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5462e2cddcd14ba290fa3db658128d51'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:10.762744 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-498cd774-9d92-4eb3-8962-27fa754b47fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5462e2cddcd14ba290fa3db658128d51'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:10.764022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 853/1699] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:26:10 2022] POST /identity/v3/users => generated 292 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:10.767208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-498cd774-9d92-4eb3-8962-27fa754b47fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5462e2cddcd14ba290fa3db658128d51'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:10.771139 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbbff2-6b7d-4801-b56f-eb50a0a36692 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:10.774422 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-498cd774-9d92-4eb3-8962-27fa754b47fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5462e2cddcd14ba290fa3db658128d51'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:10.802247 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b9bbbff2-6b7d-4801-b56f-eb50a0a36692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:10.844624 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbbff2-6b7d-4801-b56f-eb50a0a36692 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:10.861452 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 847/1700] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:26:10 2022] DELETE /identity/v3/users/5462e2cddcd14ba290fa3db658128d51 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:10.863104 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78311152-713e-452b-86bd-a232e707fddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:10.863240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384586b-32d5-448c-b0c5-cd4f25a1edc0 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:10.863624 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384586b-32d5-448c-b0c5-cd4f25a1edc0 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:10.864008 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384586b-32d5-448c-b0c5-cd4f25a1edc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:10.864919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78311152-713e-452b-86bd-a232e707fddb admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:10.865382 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78311152-713e-452b-86bd-a232e707fddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:10.866733 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78311152-713e-452b-86bd-a232e707fddb admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:10.875102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78311152-713e-452b-86bd-a232e707fddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:10.879081 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78311152-713e-452b-86bd-a232e707fddb admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:10.910443 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-4384586b-32d5-448c-b0c5-cd4f25a1edc0 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:10.914323 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-4384586b-32d5-448c-b0c5-cd4f25a1edc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:10.924480 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 854/1701] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:26:10.925709 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78311152-713e-452b-86bd-a232e707fddb admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:10.948478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78311152-713e-452b-86bd-a232e707fddb admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:11.103253 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 848/1702] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:11.122310 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f39c1d-a214-494e-8acb-5c97ca2ed99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:11.123075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f39c1d-a214-494e-8acb-5c97ca2ed99c admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:11.123511 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f39c1d-a214-494e-8acb-5c97ca2ed99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:11.123659 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f39c1d-a214-494e-8acb-5c97ca2ed99c admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:11.125571 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f39c1d-a214-494e-8acb-5c97ca2ed99c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:11.127478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f39c1d-a214-494e-8acb-5c97ca2ed99c admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:11.157034 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 855/1703] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:26:11.158188 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384586b-32d5-448c-b0c5-cd4f25a1edc0 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:11.165747 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f39c1d-a214-494e-8acb-5c97ca2ed99c admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:11.167581 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-95f39c1d-a214-494e-8acb-5c97ca2ed99c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:11.190932 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384586b-32d5-448c-b0c5-cd4f25a1edc0 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:11.207463 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a73ea4-525e-479a-8892-ed324d0ead15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:11.212099 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a73ea4-525e-479a-8892-ed324d0ead15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:11.212446 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a73ea4-525e-479a-8892-ed324d0ead15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:11.212737 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a73ea4-525e-479a-8892-ed324d0ead15 admin admin] PATH_INFO: `/v3/projects/67878e1ba4ba41c7bc81faa19162d765/users/0d32948a710e42fdb363368fdef67cc4/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:11.268402 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a73ea4-525e-479a-8892-ed324d0ead15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67878e1ba4ba41c7bc81faa19162d765, user_id=0d32948a710e42fdb363368fdef67cc4, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:11.280731 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a73ea4-525e-479a-8892-ed324d0ead15 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:11.293017 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f39c1d-a214-494e-8acb-5c97ca2ed99c admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:11.298036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac0cb1-bcac-4937-a36e-422b00a163f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:11.299090 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac0cb1-bcac-4937-a36e-422b00a163f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:11.299907 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac0cb1-bcac-4937-a36e-422b00a163f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:11.300372 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac0cb1-bcac-4937-a36e-422b00a163f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:11.318838 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac0cb1-bcac-4937-a36e-422b00a163f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:11.320909 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac0cb1-bcac-4937-a36e-422b00a163f3 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:11.338700 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 856/1704] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:26:11.410459 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 849/1705] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:26:11 2022] PUT /identity/v3/projects/67878e1ba4ba41c7bc81faa19162d765/users/0d32948a710e42fdb363368fdef67cc4/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:26:11.415616 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65f792-4dc0-472f-9989-59cc4ab8308a None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:11.416097 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65f792-4dc0-472f-9989-59cc4ab8308a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:11.416545 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65f792-4dc0-472f-9989-59cc4ab8308a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:11.464128 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:11.488225 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-ab65f792-4dc0-472f-9989-59cc4ab8308a None None] MFA Rules not processed for user `0d32948a710e42fdb363368fdef67cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:11.489705 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ab65f792-4dc0-472f-9989-59cc4ab8308a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:11.594411 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f81e43-ae46-49cf-81fc-89b593bf1a6c None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:11.595029 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f81e43-ae46-49cf-81fc-89b593bf1a6c None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:11.595908 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f81e43-ae46-49cf-81fc-89b593bf1a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:11.671181 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 857/1706] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:11.671306 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:11.672114 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65f792-4dc0-472f-9989-59cc4ab8308a None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:11.708131 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-28f81e43-ae46-49cf-81fc-89b593bf1a6c None None] MFA Rules not processed for user `0cbaec8b28f9449dab0d5175c8034f50`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:11.710159 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-28f81e43-ae46-49cf-81fc-89b593bf1a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:11.872662 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65f792-4dc0-472f-9989-59cc4ab8308a None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:11.893279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f53f8f-3c28-42ac-80d1-fe52e8a87ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:11.900871 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f53f8f-3c28-42ac-80d1-fe52e8a87ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:11.901326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f53f8f-3c28-42ac-80d1-fe52e8a87ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:11.901811 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f53f8f-3c28-42ac-80d1-fe52e8a87ce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:11.902580 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f53f8f-3c28-42ac-80d1-fe52e8a87ce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:11.912754 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f53f8f-3c28-42ac-80d1-fe52e8a87ce8 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:11.931093 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 850/1707] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:11.940299 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f81e43-ae46-49cf-81fc-89b593bf1a6c None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:11.940299 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-28f81e43-ae46-49cf-81fc-89b593bf1a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:11.975464 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f81e43-ae46-49cf-81fc-89b593bf1a6c None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:11.994311 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a474c-687d-42ad-b081-258948eb49a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:11.997790 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a474c-687d-42ad-b081-258948eb49a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:11.997790 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a474c-687d-42ad-b081-258948eb49a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:11.997790 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a474c-687d-42ad-b081-258948eb49a9 admin admin] PATH_INFO: `/v3/users/dd463fe37aa04694a02a2776d4d45dfe` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:11.997790 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a474c-687d-42ad-b081-258948eb49a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd463fe37aa04694a02a2776d4d45dfe)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:12.000002 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a474c-687d-42ad-b081-258948eb49a9 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:12.090051 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 858/1708] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:26:11 2022] POST /identity/v3/projects => generated 383 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:12.091040 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f53f8f-3c28-42ac-80d1-fe52e8a87ce8 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:12.092933 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c8f53f8f-3c28-42ac-80d1-fe52e8a87ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:12.262300 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-7e7a474c-687d-42ad-b081-258948eb49a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd463fe37aa04694a02a2776d4d45dfe'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:12.323663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:12.325107 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f53f8f-3c28-42ac-80d1-fe52e8a87ce8 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:12.345165 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eebd8f-4e26-4302-8e3d-7735ccd0dc93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:12.346963 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eebd8f-4e26-4302-8e3d-7735ccd0dc93 service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:12.349172 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eebd8f-4e26-4302-8e3d-7735ccd0dc93 service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:12.349724 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eebd8f-4e26-4302-8e3d-7735ccd0dc93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:12.352471 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-7e7a474c-687d-42ad-b081-258948eb49a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd463fe37aa04694a02a2776d4d45dfe'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:12.364871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-7e7a474c-687d-42ad-b081-258948eb49a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd463fe37aa04694a02a2776d4d45dfe'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:12.369160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-7e7a474c-687d-42ad-b081-258948eb49a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd463fe37aa04694a02a2776d4d45dfe'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:12.370209 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-7e7a474c-687d-42ad-b081-258948eb49a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd463fe37aa04694a02a2776d4d45dfe'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:12.452556 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 851/1709] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:26:11 2022] DELETE /identity/v3/users/dd463fe37aa04694a02a2776d4d45dfe => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:12.456782 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd126e-9e8d-4725-aa3a-87f6b27047af None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:12.457048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd126e-9e8d-4725-aa3a-87f6b27047af None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:12.457333 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd126e-9e8d-4725-aa3a-87f6b27047af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:12.504510 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eebd8f-4e26-4302-8e3d-7735ccd0dc93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:12.506866 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eebd8f-4e26-4302-8e3d-7735ccd0dc93 service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:12.514092 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-63bd126e-9e8d-4725-aa3a-87f6b27047af None None] MFA Rules not processed for user `d5d47cb8d622421195d3eed6bfcf2e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:12.515386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-63bd126e-9e8d-4725-aa3a-87f6b27047af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:12.522254 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 859/1710] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:26:12.523328 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eebd8f-4e26-4302-8e3d-7735ccd0dc93 service nova] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:12.605117 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:12.641800 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 852/1711] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:12.644045 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42415d67-1ce6-4c99-98c1-69f02228b088 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:12.645007 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42415d67-1ce6-4c99-98c1-69f02228b088 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:12.646112 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42415d67-1ce6-4c99-98c1-69f02228b088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:12.671630 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eebd8f-4e26-4302-8e3d-7735ccd0dc93 service nova] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:12.692978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-42415d67-1ce6-4c99-98c1-69f02228b088 None None] MFA Rules not processed for user `62bacc0d6a2342deac533c4de67041b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:12.695846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-42415d67-1ce6-4c99-98c1-69f02228b088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:12.795572 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae71e86-a2ea-4d2e-b089-65082e617284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:12.796487 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae71e86-a2ea-4d2e-b089-65082e617284 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:12.796991 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae71e86-a2ea-4d2e-b089-65082e617284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:12.797330 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae71e86-a2ea-4d2e-b089-65082e617284 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:12.798808 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae71e86-a2ea-4d2e-b089-65082e617284 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:12.802925 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae71e86-a2ea-4d2e-b089-65082e617284 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:12.832544 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 853/1712] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:12.834266 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b0231-9d55-49b3-8b15-f55ae49a0c7e None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:12.834738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b0231-9d55-49b3-8b15-f55ae49a0c7e None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:12.835194 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b0231-9d55-49b3-8b15-f55ae49a0c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:12.882199 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-954b0231-9d55-49b3-8b15-f55ae49a0c7e None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:12.883645 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-954b0231-9d55-49b3-8b15-f55ae49a0c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:12.892446 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 854/1713] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:12.893601 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5513ab-7d5f-4d76-8cfc-7e3f9745ec02 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:12.894080 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5513ab-7d5f-4d76-8cfc-7e3f9745ec02 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:12.894363 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5513ab-7d5f-4d76-8cfc-7e3f9745ec02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:12.916345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-6a5513ab-7d5f-4d76-8cfc-7e3f9745ec02 None None] MFA Rules not processed for user `1d322f9350b7475b94493d4bbcd61349`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:12.917910 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-6a5513ab-7d5f-4d76-8cfc-7e3f9745ec02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:12.959921 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 860/1714] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:26:12 2022] POST /identity/v3/users => generated 298 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:12.960611 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae71e86-a2ea-4d2e-b089-65082e617284 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:12.966689 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-cae71e86-a2ea-4d2e-b089-65082e617284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:13.008846 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae71e86-a2ea-4d2e-b089-65082e617284 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:13.020976 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cea309-4444-4da4-9cf9-d848c544176b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:13.023589 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cea309-4444-4da4-9cf9-d848c544176b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:13.024291 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cea309-4444-4da4-9cf9-d848c544176b admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:13.024759 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cea309-4444-4da4-9cf9-d848c544176b admin admin] PATH_INFO: `/v3/projects/a199f8d3cceb43db9cee303d9c501b05` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:13.026298 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cea309-4444-4da4-9cf9-d848c544176b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a199f8d3cceb43db9cee303d9c501b05)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:13.030497 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cea309-4444-4da4-9cf9-d848c544176b admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:13.073634 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 855/1715] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:13.076086 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6888b4-0970-4e62-9742-943fad90eccf None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:13.078753 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6888b4-0970-4e62-9742-943fad90eccf None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:13.082709 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6888b4-0970-4e62-9742-943fad90eccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:13.105916 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-4e6888b4-0970-4e62-9742-943fad90eccf None None] MFA Rules not processed for user `d5d47cb8d622421195d3eed6bfcf2e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:13.107211 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-4e6888b4-0970-4e62-9742-943fad90eccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:13.118358 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 856/1716] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:13.120159 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a238543-1b81-4ac9-86cd-23575b7b442a None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:13.120278 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a238543-1b81-4ac9-86cd-23575b7b442a None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:13.120667 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a238543-1b81-4ac9-86cd-23575b7b442a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:13.172787 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-7a238543-1b81-4ac9-86cd-23575b7b442a None None] MFA Rules not processed for user `62bacc0d6a2342deac533c4de67041b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:13.174160 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b8cea309-4444-4da4-9cf9-d848c544176b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a199f8d3cceb43db9cee303d9c501b05', 'request_id': 'req-b8cea309-4444-4da4-9cf9-d848c544176b'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:13.183315 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-7a238543-1b81-4ac9-86cd-23575b7b442a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:13.184636 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b8cea309-4444-4da4-9cf9-d848c544176b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a199f8d3cceb43db9cee303d9c501b05', 'request_id': 'req-b8cea309-4444-4da4-9cf9-d848c544176b'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:13.273207 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b8cea309-4444-4da4-9cf9-d848c544176b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a199f8d3cceb43db9cee303d9c501b05', 'request_id': 'req-b8cea309-4444-4da4-9cf9-d848c544176b'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:13.280723 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 857/1717] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:13.282488 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a238543-1b81-4ac9-86cd-23575b7b442a None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:13.287747 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-7a238543-1b81-4ac9-86cd-23575b7b442a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:13.314122 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b8cea309-4444-4da4-9cf9-d848c544176b admin admin] The token cache is being invalidate because project a199f8d3cceb43db9cee303d9c501b05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:26:13.316787 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b8cea309-4444-4da4-9cf9-d848c544176b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:13.317882 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b8cea309-4444-4da4-9cf9-d848c544176b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:13.345332 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 861/1718] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:26:12 2022] DELETE /identity/v3/projects/a199f8d3cceb43db9cee303d9c501b05 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:13.345332 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cea309-4444-4da4-9cf9-d848c544176b admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:13.346016 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b8cea309-4444-4da4-9cf9-d848c544176b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:13.431886 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a238543-1b81-4ac9-86cd-23575b7b442a None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:13.440259 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c12090-be98-45c5-b293-8d13afcd6cc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:13.440674 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c12090-be98-45c5-b293-8d13afcd6cc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:13.442925 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c12090-be98-45c5-b293-8d13afcd6cc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:13.443220 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c12090-be98-45c5-b293-8d13afcd6cc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:13.449091 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-91c12090-be98-45c5-b293-8d13afcd6cc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:13.505385 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cea309-4444-4da4-9cf9-d848c544176b admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:13.518622 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f136e6-ffce-468b-8be8-0f348fc44801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:13.519324 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f136e6-ffce-468b-8be8-0f348fc44801 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:13.519613 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f136e6-ffce-468b-8be8-0f348fc44801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:13.519896 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f136e6-ffce-468b-8be8-0f348fc44801 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:13.520730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f136e6-ffce-468b-8be8-0f348fc44801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:13.522441 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f136e6-ffce-468b-8be8-0f348fc44801 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:13.544669 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 862/1719] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:26:13.545629 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f136e6-ffce-468b-8be8-0f348fc44801 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:13.558680 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c4f136e6-ffce-468b-8be8-0f348fc44801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:13.646779 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c12090-be98-45c5-b293-8d13afcd6cc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:13.649746 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c12090-be98-45c5-b293-8d13afcd6cc9 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:13.669520 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 858/1720] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:26:13.671046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c12090-be98-45c5-b293-8d13afcd6cc9 service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:13.672564 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-91c12090-be98-45c5-b293-8d13afcd6cc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:13.689503 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c12090-be98-45c5-b293-8d13afcd6cc9 service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:13.696825 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ab129-530f-4ad0-b71d-14254ae62dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:13.697722 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ab129-530f-4ad0-b71d-14254ae62dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:13.698042 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ab129-530f-4ad0-b71d-14254ae62dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:13.698901 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ab129-530f-4ad0-b71d-14254ae62dc7 admin admin] PATH_INFO: `/v3/users/b72182edcbb046b9935d78dffa4a402f` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:13.701532 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ab129-530f-4ad0-b71d-14254ae62dc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b72182edcbb046b9935d78dffa4a402f)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:13.703820 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ab129-530f-4ad0-b71d-14254ae62dc7 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:13.782902 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f136e6-ffce-468b-8be8-0f348fc44801 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:13.798255 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67dbfb-cdd7-4fc3-82c3-b744e47eb781 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:13.798950 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67dbfb-cdd7-4fc3-82c3-b744e47eb781 service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:13.799397 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67dbfb-cdd7-4fc3-82c3-b744e47eb781 service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:13.799689 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67dbfb-cdd7-4fc3-82c3-b744e47eb781 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:13.803944 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3f67dbfb-cdd7-4fc3-82c3-b744e47eb781 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:13.934830 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67dbfb-cdd7-4fc3-82c3-b744e47eb781 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:13.936682 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67dbfb-cdd7-4fc3-82c3-b744e47eb781 service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:13.948421 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 863/1721] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:26:13.949326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67dbfb-cdd7-4fc3-82c3-b744e47eb781 service nova] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:13.968151 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67dbfb-cdd7-4fc3-82c3-b744e47eb781 service nova] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:13.974576 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a12c2-95b3-433b-a3fc-0ad80610f296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:13.975497 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a12c2-95b3-433b-a3fc-0ad80610f296 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:13.975786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a12c2-95b3-433b-a3fc-0ad80610f296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:13.976145 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a12c2-95b3-433b-a3fc-0ad80610f296 admin admin] PATH_INFO: `/v3/projects/062b0177f1744177827a070d2f85916c/users/5eb75c9cbc1b4a96b1a46c60615f4778/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:13.982649 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:13.986648 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-df1ab129-530f-4ad0-b71d-14254ae62dc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b72182edcbb046b9935d78dffa4a402f'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:13.999719 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a12c2-95b3-433b-a3fc-0ad80610f296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=062b0177f1744177827a070d2f85916c, user_id=5eb75c9cbc1b4a96b1a46c60615f4778, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:14.004079 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a12c2-95b3-433b-a3fc-0ad80610f296 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:14.079383 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-df1ab129-530f-4ad0-b71d-14254ae62dc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b72182edcbb046b9935d78dffa4a402f'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:14.100822 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-df1ab129-530f-4ad0-b71d-14254ae62dc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b72182edcbb046b9935d78dffa4a402f'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:14.101643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-df1ab129-530f-4ad0-b71d-14254ae62dc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b72182edcbb046b9935d78dffa4a402f'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:14.102309 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-df1ab129-530f-4ad0-b71d-14254ae62dc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b72182edcbb046b9935d78dffa4a402f'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:14.140536 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 859/1722] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:26:13 2022] DELETE /identity/v3/users/b72182edcbb046b9935d78dffa4a402f => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:14.140936 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b249ec9-d58a-415e-aedf-34406044785b None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:14.141229 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b249ec9-d58a-415e-aedf-34406044785b None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:14.141508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b249ec9-d58a-415e-aedf-34406044785b None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:14.142896 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 860/1723] 10.222.0.23 () {54 vars in 912 bytes} [Mon Jul 11 11:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:26:14.155060 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d8635-c96a-4148-868c-81f3e01eb010 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:14.155317 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d8635-c96a-4148-868c-81f3e01eb010 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:14.155594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d8635-c96a-4148-868c-81f3e01eb010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:14.166384 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 864/1724] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:26:13 2022] PUT /identity/v3/projects/062b0177f1744177827a070d2f85916c/users/5eb75c9cbc1b4a96b1a46c60615f4778/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:14.172022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a12c2-95b3-433b-a3fc-0ad80610f296 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:14.175768 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-551a12c2-95b3-433b-a3fc-0ad80610f296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:14.275811 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-967d8635-c96a-4148-868c-81f3e01eb010 None None] MFA Rules not processed for user `79b8c08920b0417097bebd23344ffe64`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:14.277050 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-967d8635-c96a-4148-868c-81f3e01eb010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:14.351870 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a12c2-95b3-433b-a3fc-0ad80610f296 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:14.369142 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706fd384-7682-4c0f-bd51-51876bf7b8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:14.377680 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fd384-7682-4c0f-bd51-51876bf7b8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:14.377680 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fd384-7682-4c0f-bd51-51876bf7b8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:14.377680 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fd384-7682-4c0f-bd51-51876bf7b8d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:14.378202 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706fd384-7682-4c0f-bd51-51876bf7b8d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:14.384626 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 861/1725] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Jul 11 11:26:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:14.385386 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706fd384-7682-4c0f-bd51-51876bf7b8d4 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:14.417394 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d8635-c96a-4148-868c-81f3e01eb010 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:14.419318 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-967d8635-c96a-4148-868c-81f3e01eb010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:14.433193 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 865/1726] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:26:14.440464 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706fd384-7682-4c0f-bd51-51876bf7b8d4 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:14.448004 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d8635-c96a-4148-868c-81f3e01eb010 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:14.459085 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a6d4b-fa0f-4601-9971-5ee92eb8f098 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:14.461244 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a6d4b-fa0f-4601-9971-5ee92eb8f098 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:14.463770 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a6d4b-fa0f-4601-9971-5ee92eb8f098 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:14.464524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a6d4b-fa0f-4601-9971-5ee92eb8f098 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:14.466231 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706fd384-7682-4c0f-bd51-51876bf7b8d4 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:14.484515 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a6d4b-fa0f-4601-9971-5ee92eb8f098 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:14.487340 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a6d4b-fa0f-4601-9971-5ee92eb8f098 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:14.490020 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d45e57-f65e-45f2-b68e-7045f7da6f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:14.490958 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d45e57-f65e-45f2-b68e-7045f7da6f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:14.491244 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d45e57-f65e-45f2-b68e-7045f7da6f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:14.491526 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d45e57-f65e-45f2-b68e-7045f7da6f97 admin admin] PATH_INFO: `/v3/projects/062b0177f1744177827a070d2f85916c/users/5eb75c9cbc1b4a96b1a46c60615f4778/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:14.496106 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d45e57-f65e-45f2-b68e-7045f7da6f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=062b0177f1744177827a070d2f85916c, user_id=5eb75c9cbc1b4a96b1a46c60615f4778, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:14.498998 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d45e57-f65e-45f2-b68e-7045f7da6f97 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:14.512478 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 862/1727] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:26:14.523151 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 866/1728] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:26:14 2022] PUT /identity/v3/projects/062b0177f1744177827a070d2f85916c/users/5eb75c9cbc1b4a96b1a46c60615f4778/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:14.534108 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38f1cd-0b6a-4a81-a589-27e9672e8c93 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:14.534415 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38f1cd-0b6a-4a81-a589-27e9672e8c93 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:14.534702 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38f1cd-0b6a-4a81-a589-27e9672e8c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:14.575215 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-8d38f1cd-0b6a-4a81-a589-27e9672e8c93 None None] MFA Rules not processed for user `5eb75c9cbc1b4a96b1a46c60615f4778`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:14.577583 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-8d38f1cd-0b6a-4a81-a589-27e9672e8c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:14.691047 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 863/1729] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:14.704433 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d45e57-f65e-45f2-b68e-7045f7da6f97 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:14.706326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-23d45e57-f65e-45f2-b68e-7045f7da6f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:14.887035 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d45e57-f65e-45f2-b68e-7045f7da6f97 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:14.936026 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df170e-de90-4d10-b369-08a55a32e72f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:14.936704 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df170e-de90-4d10-b369-08a55a32e72f service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:14.936993 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df170e-de90-4d10-b369-08a55a32e72f service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:14.937269 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df170e-de90-4d10-b369-08a55a32e72f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:14.949268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-45df170e-de90-4d10-b369-08a55a32e72f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:15.093631 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd5dff-2769-4cd1-81d6-3045d83a1213 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:15.094224 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd5dff-2769-4cd1-81d6-3045d83a1213 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:15.095150 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd5dff-2769-4cd1-81d6-3045d83a1213 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:15.098120 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 864/1730] 10.222.0.23 () {54 vars in 912 bytes} [Mon Jul 11 11:26:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:26:15.107692 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df170e-de90-4d10-b369-08a55a32e72f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:15.109541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df170e-de90-4d10-b369-08a55a32e72f service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:15.116255 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4c264-d8e9-4119-b8f5-0e110f03a39e None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:15.116578 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4c264-d8e9-4119-b8f5-0e110f03a39e None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:15.116892 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4c264-d8e9-4119-b8f5-0e110f03a39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:15.135650 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 867/1731] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:26:15.233219 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:15.241130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-1ca4c264-d8e9-4119-b8f5-0e110f03a39e None None] MFA Rules not processed for user `79b8c08920b0417097bebd23344ffe64`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:15.247131 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-1ca4c264-d8e9-4119-b8f5-0e110f03a39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:15.518656 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df170e-de90-4d10-b369-08a55a32e72f service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:15.519238 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 865/1732] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Jul 11 11:26:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:15.522821 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-45df170e-de90-4d10-b369-08a55a32e72f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:15.540302 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df170e-de90-4d10-b369-08a55a32e72f service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:15.547973 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1335935-8801-4e63-82eb-dd7e651c50f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:15.548952 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1335935-8801-4e63-82eb-dd7e651c50f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:15.549955 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1335935-8801-4e63-82eb-dd7e651c50f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:15.549955 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1335935-8801-4e63-82eb-dd7e651c50f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:15.563158 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1335935-8801-4e63-82eb-dd7e651c50f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:15.565441 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1335935-8801-4e63-82eb-dd7e651c50f7 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:15.576615 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 868/1733] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:26:15.771074 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4c264-d8e9-4119-b8f5-0e110f03a39e None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:15.774139 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-1ca4c264-d8e9-4119-b8f5-0e110f03a39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:15.895155 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4c264-d8e9-4119-b8f5-0e110f03a39e None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:15.908194 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a56304-f54e-42d4-b035-ba643a385dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:15.909092 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a56304-f54e-42d4-b035-ba643a385dbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:15.909833 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a56304-f54e-42d4-b035-ba643a385dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:15.915101 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a56304-f54e-42d4-b035-ba643a385dbc admin admin] PATH_INFO: `/v3/projects/b6833cf709bf450a886c72104be2cca3` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:15.919107 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a56304-f54e-42d4-b035-ba643a385dbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6833cf709bf450a886c72104be2cca3)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:15.920767 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a56304-f54e-42d4-b035-ba643a385dbc admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:16.111628 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e9a56304-f54e-42d4-b035-ba643a385dbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6833cf709bf450a886c72104be2cca3', 'request_id': 'req-e9a56304-f54e-42d4-b035-ba643a385dbc'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:16.165321 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1335935-8801-4e63-82eb-dd7e651c50f7 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:16.166852 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f1335935-8801-4e63-82eb-dd7e651c50f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:16.204675 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1335935-8801-4e63-82eb-dd7e651c50f7 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:16.219899 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e9a56304-f54e-42d4-b035-ba643a385dbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6833cf709bf450a886c72104be2cca3', 'request_id': 'req-e9a56304-f54e-42d4-b035-ba643a385dbc'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:16.229040 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e9a56304-f54e-42d4-b035-ba643a385dbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6833cf709bf450a886c72104be2cca3', 'request_id': 'req-e9a56304-f54e-42d4-b035-ba643a385dbc'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:16.261707 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e9a56304-f54e-42d4-b035-ba643a385dbc admin admin] The token cache is being invalidate because project b6833cf709bf450a886c72104be2cca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:26:16.262055 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e9a56304-f54e-42d4-b035-ba643a385dbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:16.262904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e9a56304-f54e-42d4-b035-ba643a385dbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:16.266798 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 866/1734] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:26:15 2022] DELETE /identity/v3/projects/b6833cf709bf450a886c72104be2cca3 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:16.267897 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a56304-f54e-42d4-b035-ba643a385dbc admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:16.281038 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:16.282602 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-e9a56304-f54e-42d4-b035-ba643a385dbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:16.352557 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ba0da-30ce-4c91-8a89-d4213eb7e068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:16.353641 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ba0da-30ce-4c91-8a89-d4213eb7e068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:16.354330 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ba0da-30ce-4c91-8a89-d4213eb7e068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:16.355461 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ba0da-30ce-4c91-8a89-d4213eb7e068 admin admin] PATH_INFO: `/v3/projects/ded33f8d334b422a91bc71df0f5192e8` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:16.362284 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ba0da-30ce-4c91-8a89-d4213eb7e068 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ded33f8d334b422a91bc71df0f5192e8)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:16.373606 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ba0da-30ce-4c91-8a89-d4213eb7e068 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:16.456456 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a56304-f54e-42d4-b035-ba643a385dbc admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:16.470307 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d0cc3-3001-4c0a-b2e7-ab0553209e6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:16.471200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d0cc3-3001-4c0a-b2e7-ab0553209e6e service nova] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:16.471478 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d0cc3-3001-4c0a-b2e7-ab0553209e6e service nova] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:16.471852 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d0cc3-3001-4c0a-b2e7-ab0553209e6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:16.475662 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-1e9d0cc3-3001-4c0a-b2e7-ab0553209e6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:16.543753 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f71ba0da-30ce-4c91-8a89-d4213eb7e068 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ded33f8d334b422a91bc71df0f5192e8', 'request_id': 'req-f71ba0da-30ce-4c91-8a89-d4213eb7e068'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:16.579274 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f71ba0da-30ce-4c91-8a89-d4213eb7e068 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ded33f8d334b422a91bc71df0f5192e8', 'request_id': 'req-f71ba0da-30ce-4c91-8a89-d4213eb7e068'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:16.594016 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d0cc3-3001-4c0a-b2e7-ab0553209e6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:16.596631 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d0cc3-3001-4c0a-b2e7-ab0553209e6e service nova] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:16.611392 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 867/1735] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:26:16.612941 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3afc28-996a-4ce9-a9f2-dc942dd8b5a8 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:16.628984 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3afc28-996a-4ce9-a9f2-dc942dd8b5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:16.630834 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3afc28-996a-4ce9-a9f2-dc942dd8b5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:16.649884 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f71ba0da-30ce-4c91-8a89-d4213eb7e068 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ded33f8d334b422a91bc71df0f5192e8', 'request_id': 'req-f71ba0da-30ce-4c91-8a89-d4213eb7e068'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:16.659246 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-7a3afc28-996a-4ce9-a9f2-dc942dd8b5a8 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:16.661370 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-7a3afc28-996a-4ce9-a9f2-dc942dd8b5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:16.667232 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f71ba0da-30ce-4c91-8a89-d4213eb7e068 admin admin] The token cache is being invalidate because project ded33f8d334b422a91bc71df0f5192e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:26:16.667534 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f71ba0da-30ce-4c91-8a89-d4213eb7e068 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:16.671841 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f71ba0da-30ce-4c91-8a89-d4213eb7e068 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:16.683339 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 869/1736] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:26:16 2022] DELETE /identity/v3/projects/ded33f8d334b422a91bc71df0f5192e8 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:26:16.685590 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717a0c4-4362-406a-8d3e-dbe66b11e78d None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:16.685590 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717a0c4-4362-406a-8d3e-dbe66b11e78d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:16.685590 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717a0c4-4362-406a-8d3e-dbe66b11e78d None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:16.691808 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 870/1737] 10.222.0.23 () {54 vars in 960 bytes} [Mon Jul 11 11:26:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:26:16.693436 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717a0c4-4362-406a-8d3e-dbe66b11e78d None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:16.696768 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b717a0c4-4362-406a-8d3e-dbe66b11e78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:16.766711 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 868/1738] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:16.768760 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0859262-f227-4b6f-9115-cef19f7c8c54 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:16.788606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0859262-f227-4b6f-9115-cef19f7c8c54 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:16.788959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0859262-f227-4b6f-9115-cef19f7c8c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:16.837361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-f0859262-f227-4b6f-9115-cef19f7c8c54 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:16.842233 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-f0859262-f227-4b6f-9115-cef19f7c8c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:16.865062 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 869/1739] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:16.866580 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e3a08-dc8c-49a1-9737-dacde3a20ac9 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:16.871121 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e3a08-dc8c-49a1-9737-dacde3a20ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:16.871121 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e3a08-dc8c-49a1-9737-dacde3a20ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:16.880898 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717a0c4-4362-406a-8d3e-dbe66b11e78d None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:16.894968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c3da0-1939-4ce3-983e-8212313d241b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b7c9264495433985185332778dbc8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:16.896819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-964e3a08-dc8c-49a1-9737-dacde3a20ac9 None None] MFA Rules not processed for user `12b7c9264495433985185332778dbc8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:16.897366 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c3da0-1939-4ce3-983e-8212313d241b service placement] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:16.899674 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c3da0-1939-4ce3-983e-8212313d241b service placement] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:16.899674 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c3da0-1939-4ce3-983e-8212313d241b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:16.899849 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-964e3a08-dc8c-49a1-9737-dacde3a20ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:16.904034 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b17c3da0-1939-4ce3-983e-8212313d241b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:16.911832 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 870/1740] 10.222.0.23 () {58 vars in 1057 bytes} [Mon Jul 11 11:26:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:16.914103 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557881d7-13d6-4fef-a7d6-a783b4a476c6 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:16.914396 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557881d7-13d6-4fef-a7d6-a783b4a476c6 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:16.914780 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557881d7-13d6-4fef-a7d6-a783b4a476c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:16.943410 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-557881d7-13d6-4fef-a7d6-a783b4a476c6 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:16.943955 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c3da0-1939-4ce3-983e-8212313d241b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:16.944815 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-557881d7-13d6-4fef-a7d6-a783b4a476c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:16.946257 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c3da0-1939-4ce3-983e-8212313d241b service placement] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:16.963860 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 871/1741] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:16.965446 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d841792-6cad-4c83-a5bf-0c4f84fd3baf None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:16.965958 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d841792-6cad-4c83-a5bf-0c4f84fd3baf None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:16.966544 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d841792-6cad-4c83-a5bf-0c4f84fd3baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:16.970577 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 871/1742] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:26:16.971401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c3da0-1939-4ce3-983e-8212313d241b service placement] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:16.995972 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c3da0-1939-4ce3-983e-8212313d241b service placement] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:17.008017 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-8d841792-6cad-4c83-a5bf-0c4f84fd3baf None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:17.009979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-8d841792-6cad-4c83-a5bf-0c4f84fd3baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:17.016350 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0fbfc-985d-4508-baef-5c4cd542866d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b7c9264495433985185332778dbc8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:17.017342 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0fbfc-985d-4508-baef-5c4cd542866d service placement] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:17.017641 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0fbfc-985d-4508-baef-5c4cd542866d service placement] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:17.017947 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0fbfc-985d-4508-baef-5c4cd542866d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:17.030298 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 872/1743] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:17.032498 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d841792-6cad-4c83-a5bf-0c4f84fd3baf None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:17.035307 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0fbfc-985d-4508-baef-5c4cd542866d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:17.037657 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0fbfc-985d-4508-baef-5c4cd542866d service placement] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:17.048523 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d841792-6cad-4c83-a5bf-0c4f84fd3baf None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:17.056871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff1cd7-e371-4057-9416-f600ea6b76ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:17.058270 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff1cd7-e371-4057-9416-f600ea6b76ed admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:17.058579 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff1cd7-e371-4057-9416-f600ea6b76ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:17.060260 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff1cd7-e371-4057-9416-f600ea6b76ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:17.060260 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff1cd7-e371-4057-9416-f600ea6b76ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:26:17.060260 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff1cd7-e371-4057-9416-f600ea6b76ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:17.062165 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff1cd7-e371-4057-9416-f600ea6b76ed admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:17.075425 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 872/1744] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:26:17.076594 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0fbfc-985d-4508-baef-5c4cd542866d service placement] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:17.084487 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 873/1745] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:26:17.085912 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff1cd7-e371-4057-9416-f600ea6b76ed admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:17.103269 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff1cd7-e371-4057-9416-f600ea6b76ed admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:17.104711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0fbfc-985d-4508-baef-5c4cd542866d service placement] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:17.117560 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e546fbb-1da2-488e-ab93-05659a934bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:17.118562 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e546fbb-1da2-488e-ab93-05659a934bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:17.119030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e546fbb-1da2-488e-ab93-05659a934bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:17.119483 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e546fbb-1da2-488e-ab93-05659a934bb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:17.120442 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e546fbb-1da2-488e-ab93-05659a934bb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:26:17.120980 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e546fbb-1da2-488e-ab93-05659a934bb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:17.125272 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e546fbb-1da2-488e-ab93-05659a934bb8 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:17.138889 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24603db3-9b6c-4020-85b1-64275605c6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:17.139826 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24603db3-9b6c-4020-85b1-64275605c6a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:17.140197 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24603db3-9b6c-4020-85b1-64275605c6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:17.140392 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24603db3-9b6c-4020-85b1-64275605c6a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:17.141108 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24603db3-9b6c-4020-85b1-64275605c6a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:17.152021 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24603db3-9b6c-4020-85b1-64275605c6a7 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:17.166656 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 873/1746] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:26:17.170991 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e546fbb-1da2-488e-ab93-05659a934bb8 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:17.196139 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e546fbb-1da2-488e-ab93-05659a934bb8 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:17.224707 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725d020-a1b6-4fe4-a842-76d2f26689d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:17.226320 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725d020-a1b6-4fe4-a842-76d2f26689d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:17.227706 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725d020-a1b6-4fe4-a842-76d2f26689d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:17.228412 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725d020-a1b6-4fe4-a842-76d2f26689d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:17.231183 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725d020-a1b6-4fe4-a842-76d2f26689d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:17.240288 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725d020-a1b6-4fe4-a842-76d2f26689d8 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:17.300050 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 874/1747] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:26:17 2022] POST /identity/v3/projects => generated 365 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:17.302666 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24603db3-9b6c-4020-85b1-64275605c6a7 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:17.373632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 874/1748] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:26:17 2022] POST /identity/v3/projects => generated 377 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:17.381322 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725d020-a1b6-4fe4-a842-76d2f26689d8 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:17.464862 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24603db3-9b6c-4020-85b1-64275605c6a7 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:17.574701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725d020-a1b6-4fe4-a842-76d2f26689d8 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:17.606321 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9738e8-1b2a-410f-a754-e8b64ab3f0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:17.610064 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9738e8-1b2a-410f-a754-e8b64ab3f0af admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:17.610354 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9738e8-1b2a-410f-a754-e8b64ab3f0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:17.610635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9738e8-1b2a-410f-a754-e8b64ab3f0af admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:17.618531 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9738e8-1b2a-410f-a754-e8b64ab3f0af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:17.622631 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9738e8-1b2a-410f-a754-e8b64ab3f0af admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:17.660162 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9b5ed-96da-46fd-b8ce-7c7a26d3b89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:17.661138 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9b5ed-96da-46fd-b8ce-7c7a26d3b89f admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:17.661568 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9b5ed-96da-46fd-b8ce-7c7a26d3b89f admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:17.662406 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9b5ed-96da-46fd-b8ce-7c7a26d3b89f admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:17.662798 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9b5ed-96da-46fd-b8ce-7c7a26d3b89f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:17.664796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9b5ed-96da-46fd-b8ce-7c7a26d3b89f admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:17.771260 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:17.783659 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 875/1749] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:26:17 2022] POST /identity/v3/users => generated 289 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:17.787990 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9738e8-1b2a-410f-a754-e8b64ab3f0af admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:17.800720 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9738e8-1b2a-410f-a754-e8b64ab3f0af admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:17.811268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7feab5-4c0c-4470-b5c6-0bc483aba314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:17.812047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7feab5-4c0c-4470-b5c6-0bc483aba314 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:17.812347 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7feab5-4c0c-4470-b5c6-0bc483aba314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:17.812786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7feab5-4c0c-4470-b5c6-0bc483aba314 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:17.813540 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7feab5-4c0c-4470-b5c6-0bc483aba314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:17.817904 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7feab5-4c0c-4470-b5c6-0bc483aba314 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:17.833882 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 876/1750] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:26:17.834422 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 875/1751] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:26:17 2022] POST /identity/v3/users => generated 283 bytes in 534 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:17.837206 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7feab5-4c0c-4470-b5c6-0bc483aba314 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:17.838884 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9b5ed-96da-46fd-b8ce-7c7a26d3b89f admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:17.859625 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7feab5-4c0c-4470-b5c6-0bc483aba314 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:17.867016 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4476a9d-0009-472d-81d1-c961805e2b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:17.868063 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4476a9d-0009-472d-81d1-c961805e2b00 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:17.868428 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4476a9d-0009-472d-81d1-c961805e2b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:17.868772 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4476a9d-0009-472d-81d1-c961805e2b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:17.869826 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4476a9d-0009-472d-81d1-c961805e2b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:17.871775 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4476a9d-0009-472d-81d1-c961805e2b00 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:17.888636 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 877/1752] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:26:17.892911 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4476a9d-0009-472d-81d1-c961805e2b00 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:17.893260 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9b5ed-96da-46fd-b8ce-7c7a26d3b89f admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:17.904695 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95334f9a-2ca8-4575-9fbd-bc45cf5ee5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:17.905608 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4476a9d-0009-472d-81d1-c961805e2b00 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:17.906048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95334f9a-2ca8-4575-9fbd-bc45cf5ee5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:17.906644 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95334f9a-2ca8-4575-9fbd-bc45cf5ee5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:17.907246 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95334f9a-2ca8-4575-9fbd-bc45cf5ee5d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:17.908268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95334f9a-2ca8-4575-9fbd-bc45cf5ee5d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:17.911645 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3de8f-c7b2-4979-b275-8ba56e39af63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:17.912133 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95334f9a-2ca8-4575-9fbd-bc45cf5ee5d0 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:17.912562 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3de8f-c7b2-4979-b275-8ba56e39af63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:17.912845 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3de8f-c7b2-4979-b275-8ba56e39af63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:17.913110 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3de8f-c7b2-4979-b275-8ba56e39af63 admin admin] PATH_INFO: `/v3/projects/99d1a147a20a4152a6807000d9d237d4/users/89363d96771349288eefae5a7ddcb413/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:17.933090 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 876/1753] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:26:17.936695 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95334f9a-2ca8-4575-9fbd-bc45cf5ee5d0 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:17.936919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3de8f-c7b2-4979-b275-8ba56e39af63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99d1a147a20a4152a6807000d9d237d4, user_id=89363d96771349288eefae5a7ddcb413, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:17.940990 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3de8f-c7b2-4979-b275-8ba56e39af63 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:17.966034 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95334f9a-2ca8-4575-9fbd-bc45cf5ee5d0 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:17.975359 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da576b17-8c20-4c34-9286-7d06cb0f07f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:17.976319 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da576b17-8c20-4c34-9286-7d06cb0f07f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:17.976798 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da576b17-8c20-4c34-9286-7d06cb0f07f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:17.977302 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da576b17-8c20-4c34-9286-7d06cb0f07f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:17.978256 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da576b17-8c20-4c34-9286-7d06cb0f07f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:17.980361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da576b17-8c20-4c34-9286-7d06cb0f07f2 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:17.997869 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 877/1754] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:26:18.002382 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da576b17-8c20-4c34-9286-7d06cb0f07f2 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:18.019560 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da576b17-8c20-4c34-9286-7d06cb0f07f2 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:18.026742 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5435743-9757-40ad-9ba3-ff59ddff8fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:18.028698 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5435743-9757-40ad-9ba3-ff59ddff8fa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:18.029144 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5435743-9757-40ad-9ba3-ff59ddff8fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:18.029421 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5435743-9757-40ad-9ba3-ff59ddff8fa9 admin admin] PATH_INFO: `/v3/projects/6fbc00ff11a84b2ba4c82fd75fd542ca/users/aa112cccfb59428a878b72e4b61621a7/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:18.059957 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5435743-9757-40ad-9ba3-ff59ddff8fa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fbc00ff11a84b2ba4c82fd75fd542ca, user_id=aa112cccfb59428a878b72e4b61621a7, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:18.062619 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 878/1755] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:26:17 2022] PUT /identity/v3/projects/99d1a147a20a4152a6807000d9d237d4/users/89363d96771349288eefae5a7ddcb413/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:26:18.064284 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddf9e4-9c80-40f6-8491-d618366bd1c6 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:18.064582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddf9e4-9c80-40f6-8491-d618366bd1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:18.064867 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddf9e4-9c80-40f6-8491-d618366bd1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:18.070901 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5435743-9757-40ad-9ba3-ff59ddff8fa9 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:18.141158 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-45ddf9e4-9c80-40f6-8491-d618366bd1c6 None None] MFA Rules not processed for user `89363d96771349288eefae5a7ddcb413`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:18.142508 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-45ddf9e4-9c80-40f6-8491-d618366bd1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:18.182600 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 878/1756] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:26:18 2022] PUT /identity/v3/projects/6fbc00ff11a84b2ba4c82fd75fd542ca/users/aa112cccfb59428a878b72e4b61621a7/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:18.188207 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ce52c-4b1e-4b26-b680-0fec1278f1bf None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:18.188564 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ce52c-4b1e-4b26-b680-0fec1278f1bf None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:18.188849 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ce52c-4b1e-4b26-b680-0fec1278f1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:18.258547 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-c48ce52c-4b1e-4b26-b680-0fec1278f1bf None None] MFA Rules not processed for user `0cbaec8b28f9449dab0d5175c8034f50`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:18.262242 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-c48ce52c-4b1e-4b26-b680-0fec1278f1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:18.287126 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 879/1757] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:18.323574 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f822fc-fa93-44df-a2c4-d793b80b2425 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:18.336108 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f822fc-fa93-44df-a2c4-d793b80b2425 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:18.340990 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f822fc-fa93-44df-a2c4-d793b80b2425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:18.452175 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 879/1758] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:18.453891 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cd4c4-b5ad-4216-9529-8f93da20b9d2 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:18.454195 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cd4c4-b5ad-4216-9529-8f93da20b9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:18.454518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cd4c4-b5ad-4216-9529-8f93da20b9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:18.469228 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-63f822fc-fa93-44df-a2c4-d793b80b2425 None None] MFA Rules not processed for user `aa112cccfb59428a878b72e4b61621a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:18.472529 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-63f822fc-fa93-44df-a2c4-d793b80b2425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:18.548845 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-0e9cd4c4-b5ad-4216-9529-8f93da20b9d2 None None] MFA Rules not processed for user `62bacc0d6a2342deac533c4de67041b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:18.550670 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-0e9cd4c4-b5ad-4216-9529-8f93da20b9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:18.750812 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 880/1759] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:18.752014 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cd4c4-b5ad-4216-9529-8f93da20b9d2 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:18.787619 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 880/1760] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 500 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:18.788624 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f822fc-fa93-44df-a2c4-d793b80b2425 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:18.929703 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cd4c4-b5ad-4216-9529-8f93da20b9d2 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:18.939776 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc706bc-8ad9-4879-a1fc-a5feef0eb1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:18.944257 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc706bc-8ad9-4879-a1fc-a5feef0eb1f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:18.944257 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc706bc-8ad9-4879-a1fc-a5feef0eb1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:18.944686 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc706bc-8ad9-4879-a1fc-a5feef0eb1f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:18.946507 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc706bc-8ad9-4879-a1fc-a5feef0eb1f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:18.949962 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc706bc-8ad9-4879-a1fc-a5feef0eb1f6 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:19.090278 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f822fc-fa93-44df-a2c4-d793b80b2425 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:19.111956 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cda979-0562-44ec-9b4c-085b378584b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:19.111956 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cda979-0562-44ec-9b4c-085b378584b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:19.111956 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cda979-0562-44ec-9b4c-085b378584b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:19.111956 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cda979-0562-44ec-9b4c-085b378584b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:19.127369 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cda979-0562-44ec-9b4c-085b378584b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:19.127369 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cda979-0562-44ec-9b4c-085b378584b6 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:19.128444 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 881/1761] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:26:18 2022] POST /identity/v3/projects => generated 377 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:19.132985 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc706bc-8ad9-4879-a1fc-a5feef0eb1f6 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:19.299795 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc706bc-8ad9-4879-a1fc-a5feef0eb1f6 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:19.305922 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:19.316400 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 881/1762] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:26:18 2022] POST /identity/v3/projects => generated 365 bytes in 528 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:19.321634 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cda979-0562-44ec-9b4c-085b378584b6 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:19.321753 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1176f6-4335-45d9-b058-92b3e9c86731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:19.321986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-08cda979-0562-44ec-9b4c-085b378584b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:19.323009 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1176f6-4335-45d9-b058-92b3e9c86731 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:19.323303 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1176f6-4335-45d9-b058-92b3e9c86731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:19.323581 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1176f6-4335-45d9-b058-92b3e9c86731 admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:19.325640 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1176f6-4335-45d9-b058-92b3e9c86731 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:19.334231 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1176f6-4335-45d9-b058-92b3e9c86731 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:19.491729 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cda979-0562-44ec-9b4c-085b378584b6 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:19.503585 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051a3a7-3246-40d9-817e-49f3d6b9a3d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:19.505058 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051a3a7-3246-40d9-817e-49f3d6b9a3d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:19.505475 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051a3a7-3246-40d9-817e-49f3d6b9a3d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:19.505893 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051a3a7-3246-40d9-817e-49f3d6b9a3d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:19.515568 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f051a3a7-3246-40d9-817e-49f3d6b9a3d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:19.567665 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 882/1763] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:26:19 2022] POST /identity/v3/users => generated 295 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:19.567665 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1176f6-4335-45d9-b058-92b3e9c86731 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:19.592861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1176f6-4335-45d9-b058-92b3e9c86731 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:19.703798 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051a3a7-3246-40d9-817e-49f3d6b9a3d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:19.706158 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051a3a7-3246-40d9-817e-49f3d6b9a3d1 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:19.744707 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 882/1764] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:26:19.746636 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051a3a7-3246-40d9-817e-49f3d6b9a3d1 service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:19.812023 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad5fe6-f688-4af2-9ea0-b02da2eec08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:19.812732 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad5fe6-f688-4af2-9ea0-b02da2eec08e admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:19.813020 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad5fe6-f688-4af2-9ea0-b02da2eec08e admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:19.813305 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad5fe6-f688-4af2-9ea0-b02da2eec08e admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:19.814043 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad5fe6-f688-4af2-9ea0-b02da2eec08e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:19.824846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad5fe6-f688-4af2-9ea0-b02da2eec08e admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:19.898345 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051a3a7-3246-40d9-817e-49f3d6b9a3d1 service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:19.904045 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d32fb-3061-46a2-8de6-1d88aeb76914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:19.904862 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d32fb-3061-46a2-8de6-1d88aeb76914 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:19.905635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d32fb-3061-46a2-8de6-1d88aeb76914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:19.906088 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d32fb-3061-46a2-8de6-1d88aeb76914 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:19.907229 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d32fb-3061-46a2-8de6-1d88aeb76914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:19.909471 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d32fb-3061-46a2-8de6-1d88aeb76914 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:19.939931 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 883/1765] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:26:19 2022] POST /identity/v3/users => generated 289 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:19.941021 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad5fe6-f688-4af2-9ea0-b02da2eec08e admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:19.949435 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 883/1766] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:26:19.956663 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d32fb-3061-46a2-8de6-1d88aeb76914 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:19.984742 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d32fb-3061-46a2-8de6-1d88aeb76914 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:19.992768 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad5fe6-f688-4af2-9ea0-b02da2eec08e admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:19.995890 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356889ec-60ee-402f-9b67-5feecb44dcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:19.998896 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356889ec-60ee-402f-9b67-5feecb44dcd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:19.998896 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356889ec-60ee-402f-9b67-5feecb44dcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:19.998896 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356889ec-60ee-402f-9b67-5feecb44dcd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:19.998896 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356889ec-60ee-402f-9b67-5feecb44dcd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:20.001385 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356889ec-60ee-402f-9b67-5feecb44dcd2 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:20.008641 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208789a-dda7-4f8e-9e4f-e96568e0be96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:20.010515 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208789a-dda7-4f8e-9e4f-e96568e0be96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:20.011783 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208789a-dda7-4f8e-9e4f-e96568e0be96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:20.012295 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208789a-dda7-4f8e-9e4f-e96568e0be96 admin admin] PATH_INFO: `/v3/projects/5deb18710a974b01a27336ff2d782cf2/users/12ea4fcb20bd4c68a7664f1bbde427ff/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:20.022498 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 884/1767] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:26:20.022663 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356889ec-60ee-402f-9b67-5feecb44dcd2 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:20.036017 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356889ec-60ee-402f-9b67-5feecb44dcd2 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:20.040842 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208789a-dda7-4f8e-9e4f-e96568e0be96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5deb18710a974b01a27336ff2d782cf2, user_id=12ea4fcb20bd4c68a7664f1bbde427ff, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:20.046670 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208789a-dda7-4f8e-9e4f-e96568e0be96 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:20.049724 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d98cc5-fb6a-4918-aee4-45d70f060727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:20.063888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d98cc5-fb6a-4918-aee4-45d70f060727 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:20.063888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d98cc5-fb6a-4918-aee4-45d70f060727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:20.063888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d98cc5-fb6a-4918-aee4-45d70f060727 admin admin] PATH_INFO: `/v3/projects/0cff8c7040b74206a70ff245389b8071/users/39e166abe9a440c881f6dfee53d25591/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:20.078899 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d98cc5-fb6a-4918-aee4-45d70f060727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cff8c7040b74206a70ff245389b8071, user_id=39e166abe9a440c881f6dfee53d25591, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:20.083976 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d98cc5-fb6a-4918-aee4-45d70f060727 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:20.194802 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 885/1768] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:26:20 2022] PUT /identity/v3/projects/0cff8c7040b74206a70ff245389b8071/users/39e166abe9a440c881f6dfee53d25591/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:20.198955 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d98cc5-fb6a-4918-aee4-45d70f060727 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:20.210234 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 884/1769] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:26:19 2022] PUT /identity/v3/projects/5deb18710a974b01a27336ff2d782cf2/users/12ea4fcb20bd4c68a7664f1bbde427ff/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:20.211553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208789a-dda7-4f8e-9e4f-e96568e0be96 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:20.328884 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:20.384417 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208789a-dda7-4f8e-9e4f-e96568e0be96 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:20.390017 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3abdec-2354-4d6b-bd20-18ffe3a853ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:20.392715 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d98cc5-fb6a-4918-aee4-45d70f060727 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:20.393645 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3abdec-2354-4d6b-bd20-18ffe3a853ec admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:20.393789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3abdec-2354-4d6b-bd20-18ffe3a853ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:20.394225 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3abdec-2354-4d6b-bd20-18ffe3a853ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:20.394995 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3abdec-2354-4d6b-bd20-18ffe3a853ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:20.396915 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3abdec-2354-4d6b-bd20-18ffe3a853ec admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:20.423806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 885/1770] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:26:20.425357 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3abdec-2354-4d6b-bd20-18ffe3a853ec admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:20.431237 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217128d-17ab-4f09-aa1a-db569807f200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:20.433457 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217128d-17ab-4f09-aa1a-db569807f200 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:20.434311 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217128d-17ab-4f09-aa1a-db569807f200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:20.434617 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217128d-17ab-4f09-aa1a-db569807f200 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:20.435425 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217128d-17ab-4f09-aa1a-db569807f200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:20.437266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217128d-17ab-4f09-aa1a-db569807f200 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:20.446384 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3abdec-2354-4d6b-bd20-18ffe3a853ec admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:20.453549 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 886/1771] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:26:20.457980 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217128d-17ab-4f09-aa1a-db569807f200 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:20.477328 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8606b4-47ee-4e94-9289-ba7d8fd9b4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:20.477949 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8606b4-47ee-4e94-9289-ba7d8fd9b4a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:20.478240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8606b4-47ee-4e94-9289-ba7d8fd9b4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:20.478702 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8606b4-47ee-4e94-9289-ba7d8fd9b4a4 admin admin] PATH_INFO: `/v3/projects/5deb18710a974b01a27336ff2d782cf2/users/12ea4fcb20bd4c68a7664f1bbde427ff/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:20.483136 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8606b4-47ee-4e94-9289-ba7d8fd9b4a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5deb18710a974b01a27336ff2d782cf2, user_id=12ea4fcb20bd4c68a7664f1bbde427ff, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:20.487284 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8606b4-47ee-4e94-9289-ba7d8fd9b4a4 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:20.511562 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217128d-17ab-4f09-aa1a-db569807f200 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:20.519144 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 886/1772] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:26:20 2022] PUT /identity/v3/projects/5deb18710a974b01a27336ff2d782cf2/users/12ea4fcb20bd4c68a7664f1bbde427ff/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:20.535878 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b0ef0-22b7-4378-b99f-4e917670fe2a None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:20.535878 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b0ef0-22b7-4378-b99f-4e917670fe2a None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:20.536153 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b0ef0-22b7-4378-b99f-4e917670fe2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:20.635179 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-de5b0ef0-22b7-4378-b99f-4e917670fe2a None None] MFA Rules not processed for user `12ea4fcb20bd4c68a7664f1bbde427ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:20.660176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7bee38-196d-4ad4-90fd-a8ef6b81dfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:20.661353 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bee38-196d-4ad4-90fd-a8ef6b81dfc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:20.661700 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bee38-196d-4ad4-90fd-a8ef6b81dfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:20.662148 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bee38-196d-4ad4-90fd-a8ef6b81dfc1 admin admin] PATH_INFO: `/v3/projects/0cff8c7040b74206a70ff245389b8071/users/39e166abe9a440c881f6dfee53d25591/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:20.663621 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-de5b0ef0-22b7-4378-b99f-4e917670fe2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:20.671244 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7bee38-196d-4ad4-90fd-a8ef6b81dfc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cff8c7040b74206a70ff245389b8071, user_id=39e166abe9a440c881f6dfee53d25591, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:20.674913 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7bee38-196d-4ad4-90fd-a8ef6b81dfc1 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:20.697673 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 887/1773] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:26:20 2022] PUT /identity/v3/projects/0cff8c7040b74206a70ff245389b8071/users/39e166abe9a440c881f6dfee53d25591/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:20.708578 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a711ff-a850-4cf3-8107-951d288efb93 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:20.708949 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a711ff-a850-4cf3-8107-951d288efb93 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:20.709709 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a711ff-a850-4cf3-8107-951d288efb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:20.732684 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:20.746449 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-c3a711ff-a850-4cf3-8107-951d288efb93 None None] MFA Rules not processed for user `39e166abe9a440c881f6dfee53d25591`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:20.747966 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c3a711ff-a850-4cf3-8107-951d288efb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:20.793059 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 887/1774] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:26:20.803408 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b0ef0-22b7-4378-b99f-4e917670fe2a None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:20.808865 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-de5b0ef0-22b7-4378-b99f-4e917670fe2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:20.876707 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 888/1775] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:20 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:26:20.905378 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b0ef0-22b7-4378-b99f-4e917670fe2a None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:21.000098 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806625c-a75e-4d12-b817-cfd6253e3e63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:21.000750 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806625c-a75e-4d12-b817-cfd6253e3e63 service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:21.001038 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806625c-a75e-4d12-b817-cfd6253e3e63 service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:21.001350 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806625c-a75e-4d12-b817-cfd6253e3e63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:21.062406 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806625c-a75e-4d12-b817-cfd6253e3e63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:21.064109 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806625c-a75e-4d12-b817-cfd6253e3e63 service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:21.076937 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 888/1776] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:26:22.350736 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a711ff-a850-4cf3-8107-951d288efb93 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:22.371655 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a711ff-a850-4cf3-8107-951d288efb93 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:22.391433 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9421fb-e2c2-44a7-a158-a7e11395cfb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:22.392961 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9421fb-e2c2-44a7-a158-a7e11395cfb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:22.393260 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9421fb-e2c2-44a7-a158-a7e11395cfb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:22.393547 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9421fb-e2c2-44a7-a158-a7e11395cfb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:22.432198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9421fb-e2c2-44a7-a158-a7e11395cfb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:22.434661 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9421fb-e2c2-44a7-a158-a7e11395cfb4 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:22.459091 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 889/1777] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:22 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:26:22.821035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806625c-a75e-4d12-b817-cfd6253e3e63 service cinder] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:22.836187 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806625c-a75e-4d12-b817-cfd6253e3e63 service cinder] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:22.862195 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049cb6b3-152c-4070-8ca9-c0f0f9a011a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:22.873876 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cb6b3-152c-4070-8ca9-c0f0f9a011a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:22.879881 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cb6b3-152c-4070-8ca9-c0f0f9a011a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:22.880639 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cb6b3-152c-4070-8ca9-c0f0f9a011a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:22.886088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-049cb6b3-152c-4070-8ca9-c0f0f9a011a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:23.088251 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049cb6b3-152c-4070-8ca9-c0f0f9a011a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:23.089802 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049cb6b3-152c-4070-8ca9-c0f0f9a011a9 service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:23.103552 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 889/1778] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:26:23.211161 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:23.708297 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2672de-5603-4d9c-bc96-7b9124fec5b3 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:23.708872 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2672de-5603-4d9c-bc96-7b9124fec5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:23.709089 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2672de-5603-4d9c-bc96-7b9124fec5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:23.753448 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea73e62-a7fc-43f9-b830-d460f0ef148c None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:23.753742 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea73e62-a7fc-43f9-b830-d460f0ef148c None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:23.754065 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea73e62-a7fc-43f9-b830-d460f0ef148c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:23.776244 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-5ea73e62-a7fc-43f9-b830-d460f0ef148c None None] MFA Rules not processed for user `79b8c08920b0417097bebd23344ffe64`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:23.778246 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-5ea73e62-a7fc-43f9-b830-d460f0ef148c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:23.822545 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-bb2672de-5603-4d9c-bc96-7b9124fec5b3 None None] MFA Rules not processed for user `cdfa8f4012c2471b81f8749b013d3117`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:23.826141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-bb2672de-5603-4d9c-bc96-7b9124fec5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:23.846185 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 890/1779] 10.222.0.47 () {58 vars in 1015 bytes} [Mon Jul 11 11:26:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:23.980742 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 890/1780] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Jul 11 11:26:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:24.037196 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea73e62-a7fc-43f9-b830-d460f0ef148c None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:24.039045 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-5ea73e62-a7fc-43f9-b830-d460f0ef148c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:24.065339 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea73e62-a7fc-43f9-b830-d460f0ef148c None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:24.085224 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d9fdc-877b-4dbb-a058-408ef2a6a1d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:24.090358 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d9fdc-877b-4dbb-a058-408ef2a6a1d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:24.093183 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d9fdc-877b-4dbb-a058-408ef2a6a1d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:24.093667 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d9fdc-877b-4dbb-a058-408ef2a6a1d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:24.118057 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d9fdc-877b-4dbb-a058-408ef2a6a1d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:24.123349 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d9fdc-877b-4dbb-a058-408ef2a6a1d8 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:24.158096 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 891/1781] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:26:24.514817 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2672de-5603-4d9c-bc96-7b9124fec5b3 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:24.516382 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-bb2672de-5603-4d9c-bc96-7b9124fec5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:24.687831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:24.688883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d9fdc-877b-4dbb-a058-408ef2a6a1d8 service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:24.698997 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2672de-5603-4d9c-bc96-7b9124fec5b3 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:24.712560 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb9fd5-9dde-4af9-a01c-9e39ac2e15a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736f6d4d1dbb47ff98bc67e53614d49c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:24.712560 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb9fd5-9dde-4af9-a01c-9e39ac2e15a0 service swift] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:24.712560 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb9fd5-9dde-4af9-a01c-9e39ac2e15a0 service swift] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:24.712560 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb9fd5-9dde-4af9-a01c-9e39ac2e15a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:24.718327 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb9fd5-9dde-4af9-a01c-9e39ac2e15a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:24.720134 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb9fd5-9dde-4af9-a01c-9e39ac2e15a0 service swift] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:24.730863 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 891/1782] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jul 11 11:26:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 11:26:24.934671 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d9fdc-877b-4dbb-a058-408ef2a6a1d8 service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:24.947588 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b684f5-ea6d-42d9-8a9e-ea9e22f6f730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:24.948756 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b684f5-ea6d-42d9-8a9e-ea9e22f6f730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:24.949220 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b684f5-ea6d-42d9-8a9e-ea9e22f6f730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:24.949693 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b684f5-ea6d-42d9-8a9e-ea9e22f6f730 admin admin] PATH_INFO: `/v3/users/aa112cccfb59428a878b72e4b61621a7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:24.964360 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b684f5-ea6d-42d9-8a9e-ea9e22f6f730 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa112cccfb59428a878b72e4b61621a7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:24.967603 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b684f5-ea6d-42d9-8a9e-ea9e22f6f730 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:25.277136 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-26b684f5-ea6d-42d9-8a9e-ea9e22f6f730 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa112cccfb59428a878b72e4b61621a7'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:25.413191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-26b684f5-ea6d-42d9-8a9e-ea9e22f6f730 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa112cccfb59428a878b72e4b61621a7'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:25.422869 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-26b684f5-ea6d-42d9-8a9e-ea9e22f6f730 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa112cccfb59428a878b72e4b61621a7'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:25.423492 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-26b684f5-ea6d-42d9-8a9e-ea9e22f6f730 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa112cccfb59428a878b72e4b61621a7'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:25.424122 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-26b684f5-ea6d-42d9-8a9e-ea9e22f6f730 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa112cccfb59428a878b72e4b61621a7'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:25.484153 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 892/1783] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:26:24 2022] DELETE /identity/v3/users/aa112cccfb59428a878b72e4b61621a7 => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:25.489609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032c6df-99f3-4715-bf62-9e4501304fc4 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:25.490003 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032c6df-99f3-4715-bf62-9e4501304fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:25.490366 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032c6df-99f3-4715-bf62-9e4501304fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:25.557531 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-1032c6df-99f3-4715-bf62-9e4501304fc4 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:25.558937 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1032c6df-99f3-4715-bf62-9e4501304fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:25.743660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 892/1784] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:26.055801 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b684f5-ea6d-42d9-8a9e-ea9e22f6f730 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:26.055801 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-26b684f5-ea6d-42d9-8a9e-ea9e22f6f730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:26.055801 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b684f5-ea6d-42d9-8a9e-ea9e22f6f730 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:26.057426 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84158ac-e27f-4efb-8209-0d16aef40c2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:26.057426 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84158ac-e27f-4efb-8209-0d16aef40c2b service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:26.057426 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84158ac-e27f-4efb-8209-0d16aef40c2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:26.057426 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84158ac-e27f-4efb-8209-0d16aef40c2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:26.058531 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84158ac-e27f-4efb-8209-0d16aef40c2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:26.058531 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84158ac-e27f-4efb-8209-0d16aef40c2b service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:26.058531 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 893/1785] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:26:26.574616 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:26.754785 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbff96-8a2f-411f-a71f-b642995372b6 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:26.758621 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbff96-8a2f-411f-a71f-b642995372b6 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:26.758621 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbff96-8a2f-411f-a71f-b642995372b6 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:26.758621 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 893/1786] 10.222.0.23 () {54 vars in 921 bytes} [Mon Jul 11 11:26:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:26:26.824404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a97cc3-ef88-4ce3-9b28-dc4344b155c4 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:26.824702 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a97cc3-ef88-4ce3-9b28-dc4344b155c4 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:26.825170 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a97cc3-ef88-4ce3-9b28-dc4344b155c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:26.867922 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-c8a97cc3-ef88-4ce3-9b28-dc4344b155c4 None None] MFA Rules not processed for user `5b9e7594afc346e593ef3e6c579e237b`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:26.869266 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-c8a97cc3-ef88-4ce3-9b28-dc4344b155c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:27.072566 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 894/1787] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Jul 11 11:26:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:27.194164 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bbff96-8a2f-411f-a71f-b642995372b6 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:27.196176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d5bbff96-8a2f-411f-a71f-b642995372b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:27.274503 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bbff96-8a2f-411f-a71f-b642995372b6 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:27.310546 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966afa8-6698-4420-b258-6b5a07dcd263 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:27.311294 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966afa8-6698-4420-b258-6b5a07dcd263 service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:27.311526 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966afa8-6698-4420-b258-6b5a07dcd263 service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:27.311810 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966afa8-6698-4420-b258-6b5a07dcd263 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:27.352525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966afa8-6698-4420-b258-6b5a07dcd263 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:27.352525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966afa8-6698-4420-b258-6b5a07dcd263 service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:27.376624 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 894/1788] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:26:27.756993 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:28.208538 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a97cc3-ef88-4ce3-9b28-dc4344b155c4 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:28.209992 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-c8a97cc3-ef88-4ce3-9b28-dc4344b155c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:28.355245 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a97cc3-ef88-4ce3-9b28-dc4344b155c4 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:28.362430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0337b-484f-4a78-a9bc-f21a14fef099 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:28.363463 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0337b-484f-4a78-a9bc-f21a14fef099 service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:28.364186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0337b-484f-4a78-a9bc-f21a14fef099 service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:28.364845 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0337b-484f-4a78-a9bc-f21a14fef099 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:28.368810 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-ded0337b-484f-4a78-a9bc-f21a14fef099 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:28.696707 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0337b-484f-4a78-a9bc-f21a14fef099 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:28.698829 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0337b-484f-4a78-a9bc-f21a14fef099 service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:28.732270 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 895/1789] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:26:28.872441 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966afa8-6698-4420-b258-6b5a07dcd263 service nova] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:28.872441 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e966afa8-6698-4420-b258-6b5a07dcd263 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:28.899869 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966afa8-6698-4420-b258-6b5a07dcd263 service nova] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:28.916598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70837be7-fe96-464b-9a6b-6c780af19b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:28.917106 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70837be7-fe96-464b-9a6b-6c780af19b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:28.917558 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70837be7-fe96-464b-9a6b-6c780af19b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:28.918037 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70837be7-fe96-464b-9a6b-6c780af19b18 admin admin] PATH_INFO: `/v3/projects/6fbc00ff11a84b2ba4c82fd75fd542ca` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:28.919536 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70837be7-fe96-464b-9a6b-6c780af19b18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fbc00ff11a84b2ba4c82fd75fd542ca)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:28.923037 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70837be7-fe96-464b-9a6b-6c780af19b18 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:29.088103 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-70837be7-fe96-464b-9a6b-6c780af19b18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fbc00ff11a84b2ba4c82fd75fd542ca', 'request_id': 'req-70837be7-fe96-464b-9a6b-6c780af19b18'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:29.108299 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-70837be7-fe96-464b-9a6b-6c780af19b18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fbc00ff11a84b2ba4c82fd75fd542ca', 'request_id': 'req-70837be7-fe96-464b-9a6b-6c780af19b18'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:29.265756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-70837be7-fe96-464b-9a6b-6c780af19b18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fbc00ff11a84b2ba4c82fd75fd542ca', 'request_id': 'req-70837be7-fe96-464b-9a6b-6c780af19b18'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:29.289727 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-70837be7-fe96-464b-9a6b-6c780af19b18 admin admin] The token cache is being invalidate because project 6fbc00ff11a84b2ba4c82fd75fd542ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:26:29.290942 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-70837be7-fe96-464b-9a6b-6c780af19b18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:29.307892 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-70837be7-fe96-464b-9a6b-6c780af19b18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:29.317613 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 895/1790] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:26:28 2022] DELETE /identity/v3/projects/6fbc00ff11a84b2ba4c82fd75fd542ca => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:29.322171 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0337b-484f-4a78-a9bc-f21a14fef099 service cinder] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:29.341585 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0337b-484f-4a78-a9bc-f21a14fef099 service cinder] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:29.532742 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7034719-de02-4275-85e7-8b9b9a0efb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:29.539065 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7034719-de02-4275-85e7-8b9b9a0efb27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:29.539065 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7034719-de02-4275-85e7-8b9b9a0efb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:29.539065 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7034719-de02-4275-85e7-8b9b9a0efb27 admin admin] PATH_INFO: `/v3/users/39e166abe9a440c881f6dfee53d25591` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:29.539065 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7034719-de02-4275-85e7-8b9b9a0efb27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39e166abe9a440c881f6dfee53d25591)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:29.540017 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7034719-de02-4275-85e7-8b9b9a0efb27 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:29.916255 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-c7034719-de02-4275-85e7-8b9b9a0efb27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39e166abe9a440c881f6dfee53d25591'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:30.038006 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-c7034719-de02-4275-85e7-8b9b9a0efb27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39e166abe9a440c881f6dfee53d25591'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:30.051244 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-c7034719-de02-4275-85e7-8b9b9a0efb27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39e166abe9a440c881f6dfee53d25591'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:30.054419 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-c7034719-de02-4275-85e7-8b9b9a0efb27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39e166abe9a440c881f6dfee53d25591'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:30.056042 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-c7034719-de02-4275-85e7-8b9b9a0efb27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39e166abe9a440c881f6dfee53d25591'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:30.156536 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 896/1791] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:26:29 2022] DELETE /identity/v3/users/39e166abe9a440c881f6dfee53d25591 => generated 0 bytes in 835 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:30.502901 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf266de-f8c1-45fd-a1b2-4f5594dc860d None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:30.503865 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf266de-f8c1-45fd-a1b2-4f5594dc860d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:30.504437 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf266de-f8c1-45fd-a1b2-4f5594dc860d None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:30.508175 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 896/1792] 10.222.0.23 () {54 vars in 921 bytes} [Mon Jul 11 11:26:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:26:30.548120 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbcbfb-8b4f-4a3c-8c71-eadc01efbd2a None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:30.549011 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbcbfb-8b4f-4a3c-8c71-eadc01efbd2a None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:30.549466 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbcbfb-8b4f-4a3c-8c71-eadc01efbd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:30.604997 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:30.647227 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-12dbcbfb-8b4f-4a3c-8c71-eadc01efbd2a None None] MFA Rules not processed for user `5b9e7594afc346e593ef3e6c579e237b`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:30.653090 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-12dbcbfb-8b4f-4a3c-8c71-eadc01efbd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:30.805670 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 897/1793] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Jul 11 11:26:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:30.991152 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf266de-f8c1-45fd-a1b2-4f5594dc860d None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:30.993003 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-bbf266de-f8c1-45fd-a1b2-4f5594dc860d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:31.031601 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf266de-f8c1-45fd-a1b2-4f5594dc860d None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:31.045708 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796590c-4643-4abe-97a2-ffee78723e5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:31.047165 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796590c-4643-4abe-97a2-ffee78723e5a service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:31.047734 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796590c-4643-4abe-97a2-ffee78723e5a service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:31.048227 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796590c-4643-4abe-97a2-ffee78723e5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:31.061257 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796590c-4643-4abe-97a2-ffee78723e5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:31.063306 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796590c-4643-4abe-97a2-ffee78723e5a service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:31.097474 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 897/1794] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:26:31.220037 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:31.234093 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbcbfb-8b4f-4a3c-8c71-eadc01efbd2a None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:31.236351 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-12dbcbfb-8b4f-4a3c-8c71-eadc01efbd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:31.481043 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbcbfb-8b4f-4a3c-8c71-eadc01efbd2a None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:31.496287 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ec7ee-7c22-4762-9ed3-cae0ccdb05ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:31.497198 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ec7ee-7c22-4762-9ed3-cae0ccdb05ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:31.497481 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ec7ee-7c22-4762-9ed3-cae0ccdb05ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:31.497783 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ec7ee-7c22-4762-9ed3-cae0ccdb05ef admin admin] PATH_INFO: `/v3/users/2f30b7bdd9df4cb38de93bfd4f407907` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:31.500255 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ec7ee-7c22-4762-9ed3-cae0ccdb05ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f30b7bdd9df4cb38de93bfd4f407907)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:31.502352 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ec7ee-7c22-4762-9ed3-cae0ccdb05ef admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:31.841726 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-f24ec7ee-7c22-4762-9ed3-cae0ccdb05ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f30b7bdd9df4cb38de93bfd4f407907'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:31.928808 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-f24ec7ee-7c22-4762-9ed3-cae0ccdb05ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f30b7bdd9df4cb38de93bfd4f407907'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:31.953918 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-f24ec7ee-7c22-4762-9ed3-cae0ccdb05ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f30b7bdd9df4cb38de93bfd4f407907'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:31.962476 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-f24ec7ee-7c22-4762-9ed3-cae0ccdb05ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f30b7bdd9df4cb38de93bfd4f407907'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:31.963581 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-f24ec7ee-7c22-4762-9ed3-cae0ccdb05ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f30b7bdd9df4cb38de93bfd4f407907'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:32.015836 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 898/1795] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:26:31 2022] DELETE /identity/v3/users/2f30b7bdd9df4cb38de93bfd4f407907 => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:32.021133 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d49cf-d8c9-4482-ae49-2d0df5620359 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:32.021673 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d49cf-d8c9-4482-ae49-2d0df5620359 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:32.021987 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d49cf-d8c9-4482-ae49-2d0df5620359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:32.061111 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-688d49cf-d8c9-4482-ae49-2d0df5620359 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:32.063425 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-688d49cf-d8c9-4482-ae49-2d0df5620359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:32.151354 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 898/1796] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:32.175449 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ec7ee-7c22-4762-9ed3-cae0ccdb05ef admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:32.180305 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-f24ec7ee-7c22-4762-9ed3-cae0ccdb05ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:32.311431 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ec7ee-7c22-4762-9ed3-cae0ccdb05ef admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:32.317802 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f531d8-f76a-4610-a62f-cfd5de4cbccc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:32.319252 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f531d8-f76a-4610-a62f-cfd5de4cbccc service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:32.320103 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f531d8-f76a-4610-a62f-cfd5de4cbccc service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:32.320537 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f531d8-f76a-4610-a62f-cfd5de4cbccc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:32.335852 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d49cf-d8c9-4482-ae49-2d0df5620359 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:32.339987 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-688d49cf-d8c9-4482-ae49-2d0df5620359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:32.370934 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f531d8-f76a-4610-a62f-cfd5de4cbccc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:32.374785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f531d8-f76a-4610-a62f-cfd5de4cbccc service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:32.399943 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d49cf-d8c9-4482-ae49-2d0df5620359 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:32.417185 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 899/1797] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:26:32.426954 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954da736-e9be-4e40-8e93-ba1a7451f21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:32.427936 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954da736-e9be-4e40-8e93-ba1a7451f21b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:32.428567 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954da736-e9be-4e40-8e93-ba1a7451f21b admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:32.428972 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954da736-e9be-4e40-8e93-ba1a7451f21b admin admin] PATH_INFO: `/v3/projects/0cff8c7040b74206a70ff245389b8071` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:32.431660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954da736-e9be-4e40-8e93-ba1a7451f21b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cff8c7040b74206a70ff245389b8071)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:32.443891 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954da736-e9be-4e40-8e93-ba1a7451f21b admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:32.688040 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-954da736-e9be-4e40-8e93-ba1a7451f21b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cff8c7040b74206a70ff245389b8071', 'request_id': 'req-954da736-e9be-4e40-8e93-ba1a7451f21b'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:32.701819 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-954da736-e9be-4e40-8e93-ba1a7451f21b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cff8c7040b74206a70ff245389b8071', 'request_id': 'req-954da736-e9be-4e40-8e93-ba1a7451f21b'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:32.859658 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-954da736-e9be-4e40-8e93-ba1a7451f21b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cff8c7040b74206a70ff245389b8071', 'request_id': 'req-954da736-e9be-4e40-8e93-ba1a7451f21b'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:32.886269 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-954da736-e9be-4e40-8e93-ba1a7451f21b admin admin] The token cache is being invalidate because project 0cff8c7040b74206a70ff245389b8071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:26:32.886498 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-954da736-e9be-4e40-8e93-ba1a7451f21b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:32.888342 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-954da736-e9be-4e40-8e93-ba1a7451f21b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:32.891779 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 899/1798] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:26:32 2022] DELETE /identity/v3/projects/0cff8c7040b74206a70ff245389b8071 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:32.897606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65d9c3-e86c-49a2-acac-fc2b4763f38b None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:32.898593 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65d9c3-e86c-49a2-acac-fc2b4763f38b None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:32.899032 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65d9c3-e86c-49a2-acac-fc2b4763f38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:32.930362 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-8e65d9c3-e86c-49a2-acac-fc2b4763f38b None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:32.931852 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-8e65d9c3-e86c-49a2-acac-fc2b4763f38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:33.022479 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 900/1799] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:33.030206 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a9c6c-41ca-459c-aaa3-c9df55449e98 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:33.030843 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a9c6c-41ca-459c-aaa3-c9df55449e98 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:33.030843 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a9c6c-41ca-459c-aaa3-c9df55449e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:33.057535 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-388a9c6c-41ca-459c-aaa3-c9df55449e98 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:33.060042 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-388a9c6c-41ca-459c-aaa3-c9df55449e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:33.086229 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 900/1800] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:33.089737 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65d9c3-e86c-49a2-acac-fc2b4763f38b None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:33.122636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65d9c3-e86c-49a2-acac-fc2b4763f38b None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:33.136430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db803474-3aa9-4521-967e-98011b0175d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:33.139342 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db803474-3aa9-4521-967e-98011b0175d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:33.139864 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db803474-3aa9-4521-967e-98011b0175d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:33.140156 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db803474-3aa9-4521-967e-98011b0175d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:33.140918 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db803474-3aa9-4521-967e-98011b0175d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:26:33.141234 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db803474-3aa9-4521-967e-98011b0175d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:33.144172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db803474-3aa9-4521-967e-98011b0175d8 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:33.163464 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 901/1801] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:26:33.167527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a9c6c-41ca-459c-aaa3-c9df55449e98 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:33.183593 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a9c6c-41ca-459c-aaa3-c9df55449e98 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:33.212082 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07735c-a81b-4811-9327-e71916956d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:33.214237 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07735c-a81b-4811-9327-e71916956d0c admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:33.214906 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07735c-a81b-4811-9327-e71916956d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:33.221949 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07735c-a81b-4811-9327-e71916956d0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:33.226432 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e07735c-a81b-4811-9327-e71916956d0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:33.235188 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e07735c-a81b-4811-9327-e71916956d0c admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:33.372667 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 901/1802] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:26:33 2022] POST /identity/v3/projects => generated 367 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:26:33.376635 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db803474-3aa9-4521-967e-98011b0175d8 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:33.413245 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db803474-3aa9-4521-967e-98011b0175d8 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:33.645465 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cd12a-e199-446c-a7da-14f5b4703a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:33.645465 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cd12a-e199-446c-a7da-14f5b4703a0c admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:33.645465 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cd12a-e199-446c-a7da-14f5b4703a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:33.645465 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cd12a-e199-446c-a7da-14f5b4703a0c admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:33.645850 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1cd12a-e199-446c-a7da-14f5b4703a0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:33.645850 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1cd12a-e199-446c-a7da-14f5b4703a0c admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:33.795323 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 902/1803] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:26:33 2022] POST /identity/v3/users => generated 284 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:33.797024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07735c-a81b-4811-9327-e71916956d0c admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:33.826051 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07735c-a81b-4811-9327-e71916956d0c admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:33.832204 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64d968-3f11-4f23-9a09-a0981866b447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:33.833689 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64d968-3f11-4f23-9a09-a0981866b447 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:33.834960 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64d968-3f11-4f23-9a09-a0981866b447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:33.835654 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64d968-3f11-4f23-9a09-a0981866b447 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:33.836713 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64d968-3f11-4f23-9a09-a0981866b447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:33.839081 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64d968-3f11-4f23-9a09-a0981866b447 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:33.882095 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 902/1804] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:26:33.885892 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cd12a-e199-446c-a7da-14f5b4703a0c admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:33.906216 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cd12a-e199-446c-a7da-14f5b4703a0c admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:33.930371 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc6e4b-637d-4e84-8226-82bade022fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:33.931262 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc6e4b-637d-4e84-8226-82bade022fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:33.947549 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc6e4b-637d-4e84-8226-82bade022fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:33.947549 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc6e4b-637d-4e84-8226-82bade022fd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:33.947549 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc6e4b-637d-4e84-8226-82bade022fd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:33.947549 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc6e4b-637d-4e84-8226-82bade022fd1 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:33.960949 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64d968-3f11-4f23-9a09-a0981866b447 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:33.964377 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 903/1805] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:26:33.973880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:33.977458 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64d968-3f11-4f23-9a09-a0981866b447 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:33.983679 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46392ceb-9dc9-4679-aa8d-4d47d5ba611a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:33.984760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46392ceb-9dc9-4679-aa8d-4d47d5ba611a admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:33.985134 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46392ceb-9dc9-4679-aa8d-4d47d5ba611a admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:33.986151 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46392ceb-9dc9-4679-aa8d-4d47d5ba611a admin admin] PATH_INFO: `/v3/projects/a1a4e3e9819c4c04a823f4edda3202ef/users/f4938fbcc05b4766b75053c249555887/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:34.009791 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46392ceb-9dc9-4679-aa8d-4d47d5ba611a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1a4e3e9819c4c04a823f4edda3202ef, user_id=f4938fbcc05b4766b75053c249555887, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:34.037413 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46392ceb-9dc9-4679-aa8d-4d47d5ba611a admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:34.147764 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f22c59-f843-4fe1-a486-b30640369e5c None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:34.149887 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f22c59-f843-4fe1-a486-b30640369e5c None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:34.153551 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f22c59-f843-4fe1-a486-b30640369e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:34.170013 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 903/1806] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:26:33 2022] PUT /identity/v3/projects/a1a4e3e9819c4c04a823f4edda3202ef/users/f4938fbcc05b4766b75053c249555887/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:34.191445 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:34.202275 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-b3f22c59-f843-4fe1-a486-b30640369e5c None None] MFA Rules not processed for user `f4938fbcc05b4766b75053c249555887`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:34.202275 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-b3f22c59-f843-4fe1-a486-b30640369e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:34.394165 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 904/1807] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:34 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:26:34.400091 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46392ceb-9dc9-4679-aa8d-4d47d5ba611a admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:34.416870 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f22c59-f843-4fe1-a486-b30640369e5c None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:34.418562 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-b3f22c59-f843-4fe1-a486-b30640369e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:34.518857 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46392ceb-9dc9-4679-aa8d-4d47d5ba611a admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:34.535040 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868065d-e173-4b9e-9ee6-fae84bbc059a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:34.537080 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868065d-e173-4b9e-9ee6-fae84bbc059a admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:34.537379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868065d-e173-4b9e-9ee6-fae84bbc059a admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:34.537718 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868065d-e173-4b9e-9ee6-fae84bbc059a admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:34.544754 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868065d-e173-4b9e-9ee6-fae84bbc059a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:34.547575 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868065d-e173-4b9e-9ee6-fae84bbc059a admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:34.587676 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f22c59-f843-4fe1-a486-b30640369e5c None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:34.603836 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76745b-23df-459a-8d25-749f5f15f28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:34.604752 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76745b-23df-459a-8d25-749f5f15f28e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:34.605114 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76745b-23df-459a-8d25-749f5f15f28e admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:34.605800 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76745b-23df-459a-8d25-749f5f15f28e admin admin] PATH_INFO: `/v3/projects/e89ccb78f4ab4886a3adab7b9d40b641` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:34.607851 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76745b-23df-459a-8d25-749f5f15f28e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e89ccb78f4ab4886a3adab7b9d40b641)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:34.611530 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76745b-23df-459a-8d25-749f5f15f28e admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:34.833346 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 904/1808] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:26:34 2022] POST /identity/v3/projects => generated 369 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:34.837690 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868065d-e173-4b9e-9ee6-fae84bbc059a admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:34.912481 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868065d-e173-4b9e-9ee6-fae84bbc059a admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:34.920961 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ac76745b-23df-459a-8d25-749f5f15f28e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e89ccb78f4ab4886a3adab7b9d40b641', 'request_id': 'req-ac76745b-23df-459a-8d25-749f5f15f28e'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:35.006171 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ac76745b-23df-459a-8d25-749f5f15f28e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e89ccb78f4ab4886a3adab7b9d40b641', 'request_id': 'req-ac76745b-23df-459a-8d25-749f5f15f28e'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:35.026002 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ac76745b-23df-459a-8d25-749f5f15f28e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e89ccb78f4ab4886a3adab7b9d40b641', 'request_id': 'req-ac76745b-23df-459a-8d25-749f5f15f28e'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:35.026367 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb5489-343e-4c93-8a73-eda8010108fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:35.026367 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb5489-343e-4c93-8a73-eda8010108fd admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:35.026367 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb5489-343e-4c93-8a73-eda8010108fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:35.026367 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb5489-343e-4c93-8a73-eda8010108fd admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:35.026699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb5489-343e-4c93-8a73-eda8010108fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:35.026699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb5489-343e-4c93-8a73-eda8010108fd admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:35.032537 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ac76745b-23df-459a-8d25-749f5f15f28e admin admin] The token cache is being invalidate because project e89ccb78f4ab4886a3adab7b9d40b641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:26:35.032861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ac76745b-23df-459a-8d25-749f5f15f28e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:35.033636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ac76745b-23df-459a-8d25-749f5f15f28e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:35.035646 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 905/1809] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:26:34 2022] DELETE /identity/v3/projects/e89ccb78f4ab4886a3adab7b9d40b641 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:26:35.039905 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76745b-23df-459a-8d25-749f5f15f28e admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:35.041657 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-ac76745b-23df-459a-8d25-749f5f15f28e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:35.056039 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76745b-23df-459a-8d25-749f5f15f28e admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:35.061715 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98b468-76cc-4cef-b384-4d8026568822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:35.066250 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98b468-76cc-4cef-b384-4d8026568822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:35.066250 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98b468-76cc-4cef-b384-4d8026568822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:35.066250 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98b468-76cc-4cef-b384-4d8026568822 admin admin] PATH_INFO: `/v3/users/0d32948a710e42fdb363368fdef67cc4` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:35.066250 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98b468-76cc-4cef-b384-4d8026568822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d32948a710e42fdb363368fdef67cc4)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:35.066617 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98b468-76cc-4cef-b384-4d8026568822 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:35.136561 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 905/1810] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:26:34 2022] POST /identity/v3/users => generated 291 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:35.140507 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb5489-343e-4c93-8a73-eda8010108fd admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:35.142380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-fffb5489-343e-4c93-8a73-eda8010108fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:35.155559 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb5489-343e-4c93-8a73-eda8010108fd admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:35.162038 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6842152-415c-4035-b4fa-85c2c4547211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:35.163129 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6842152-415c-4035-b4fa-85c2c4547211 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:35.172911 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6842152-415c-4035-b4fa-85c2c4547211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:35.173248 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6842152-415c-4035-b4fa-85c2c4547211 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:35.175364 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6842152-415c-4035-b4fa-85c2c4547211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:35.176497 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6842152-415c-4035-b4fa-85c2c4547211 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:35.189379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 906/1811] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:26:35.194788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6842152-415c-4035-b4fa-85c2c4547211 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:35.206833 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6842152-415c-4035-b4fa-85c2c4547211 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:35.213981 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f1828-b27b-4925-963c-1ba772996967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:35.215276 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f1828-b27b-4925-963c-1ba772996967 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:35.215702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f1828-b27b-4925-963c-1ba772996967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:35.216123 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f1828-b27b-4925-963c-1ba772996967 admin admin] PATH_INFO: `/v3/projects/65b92b9827a54ec9b590fe4dc31313bf/users/0427238ce13c4d6284c5994ef9b53d1c/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:35.235960 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f1828-b27b-4925-963c-1ba772996967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65b92b9827a54ec9b590fe4dc31313bf, user_id=0427238ce13c4d6284c5994ef9b53d1c, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:35.239780 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f1828-b27b-4925-963c-1ba772996967 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:35.333178 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ca98b468-76cc-4cef-b384-4d8026568822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d32948a710e42fdb363368fdef67cc4'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:35.352944 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 907/1812] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:26:35 2022] PUT /identity/v3/projects/65b92b9827a54ec9b590fe4dc31313bf/users/0427238ce13c4d6284c5994ef9b53d1c/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:35.357346 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f1828-b27b-4925-963c-1ba772996967 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:35.398667 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ca98b468-76cc-4cef-b384-4d8026568822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d32948a710e42fdb363368fdef67cc4'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:35.411693 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ca98b468-76cc-4cef-b384-4d8026568822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d32948a710e42fdb363368fdef67cc4'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:35.414766 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ca98b468-76cc-4cef-b384-4d8026568822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d32948a710e42fdb363368fdef67cc4'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:35.415774 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ca98b468-76cc-4cef-b384-4d8026568822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d32948a710e42fdb363368fdef67cc4'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:35.451333 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f1828-b27b-4925-963c-1ba772996967 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:35.451738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 906/1813] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:26:35 2022] DELETE /identity/v3/users/0d32948a710e42fdb363368fdef67cc4 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:35.546347 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad9269-7047-4364-bf1a-4a7d1c4bf065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:35.547077 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad9269-7047-4364-bf1a-4a7d1c4bf065 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:35.547553 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad9269-7047-4364-bf1a-4a7d1c4bf065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:35.547948 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad9269-7047-4364-bf1a-4a7d1c4bf065 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:35.548804 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad9269-7047-4364-bf1a-4a7d1c4bf065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:35.552164 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad9269-7047-4364-bf1a-4a7d1c4bf065 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:35.572331 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 908/1814] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:26:35.576397 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98b468-76cc-4cef-b384-4d8026568822 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:35.578008 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-ca98b468-76cc-4cef-b384-4d8026568822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:35.599763 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98b468-76cc-4cef-b384-4d8026568822 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:35.616652 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28113d5-fc48-49f7-9aef-31337fdda5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:35.619741 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28113d5-fc48-49f7-9aef-31337fdda5fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:35.620031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28113d5-fc48-49f7-9aef-31337fdda5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:35.620310 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28113d5-fc48-49f7-9aef-31337fdda5fa admin admin] PATH_INFO: `/v3/projects/65b92b9827a54ec9b590fe4dc31313bf/users/0427238ce13c4d6284c5994ef9b53d1c/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:35.626980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28113d5-fc48-49f7-9aef-31337fdda5fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=65b92b9827a54ec9b590fe4dc31313bf, user_id=0427238ce13c4d6284c5994ef9b53d1c, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:35.637126 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28113d5-fc48-49f7-9aef-31337fdda5fa admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:35.658979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 907/1815] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:26:35 2022] PUT /identity/v3/projects/65b92b9827a54ec9b590fe4dc31313bf/users/0427238ce13c4d6284c5994ef9b53d1c/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:35.669707 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781b2a2-a019-4e99-8542-8d1825163fb2 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:35.670027 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781b2a2-a019-4e99-8542-8d1825163fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:35.670314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781b2a2-a019-4e99-8542-8d1825163fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:35.749047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-d781b2a2-a019-4e99-8542-8d1825163fb2 None None] MFA Rules not processed for user `0427238ce13c4d6284c5994ef9b53d1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:35.758617 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d781b2a2-a019-4e99-8542-8d1825163fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:35.854459 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 909/1816] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:35 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:35.870463 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28113d5-fc48-49f7-9aef-31337fdda5fa admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:35.872809 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-d28113d5-fc48-49f7-9aef-31337fdda5fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:35.951892 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28113d5-fc48-49f7-9aef-31337fdda5fa admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:35.956790 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e55784-45c0-414f-a83a-75d8c3fa94cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:35.957938 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e55784-45c0-414f-a83a-75d8c3fa94cd service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:35.958295 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e55784-45c0-414f-a83a-75d8c3fa94cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:35.959360 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e55784-45c0-414f-a83a-75d8c3fa94cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:35.971873 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e55784-45c0-414f-a83a-75d8c3fa94cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:35.975127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e55784-45c0-414f-a83a-75d8c3fa94cd service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:35.999841 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 908/1817] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:35 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:26:36.162755 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781b2a2-a019-4e99-8542-8d1825163fb2 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:36.171933 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781b2a2-a019-4e99-8542-8d1825163fb2 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:36.194453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43affc-8e77-41ae-bea4-0f5b936c9dac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:36.203244 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43affc-8e77-41ae-bea4-0f5b936c9dac service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:36.203244 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43affc-8e77-41ae-bea4-0f5b936c9dac service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:36.203244 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43affc-8e77-41ae-bea4-0f5b936c9dac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:36.204367 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-fa43affc-8e77-41ae-bea4-0f5b936c9dac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:36.361542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43affc-8e77-41ae-bea4-0f5b936c9dac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:36.361542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43affc-8e77-41ae-bea4-0f5b936c9dac service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:36.376432 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 910/1818] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:36 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:26:36.806830 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e55784-45c0-414f-a83a-75d8c3fa94cd service cinder] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:36.807563 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-88e55784-45c0-414f-a83a-75d8c3fa94cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:36.948216 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e55784-45c0-414f-a83a-75d8c3fa94cd service cinder] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:36.954346 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5e4bf-852e-4f7e-9882-c03e92448612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:36.956145 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5e4bf-852e-4f7e-9882-c03e92448612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:36.956688 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5e4bf-852e-4f7e-9882-c03e92448612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:36.956983 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5e4bf-852e-4f7e-9882-c03e92448612 admin admin] PATH_INFO: `/v3/projects/67878e1ba4ba41c7bc81faa19162d765` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:36.959592 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e5e4bf-852e-4f7e-9882-c03e92448612 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67878e1ba4ba41c7bc81faa19162d765)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:36.962322 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e5e4bf-852e-4f7e-9882-c03e92448612 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:37.395105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-49e5e4bf-852e-4f7e-9882-c03e92448612 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67878e1ba4ba41c7bc81faa19162d765', 'request_id': 'req-49e5e4bf-852e-4f7e-9882-c03e92448612'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:37.716925 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-49e5e4bf-852e-4f7e-9882-c03e92448612 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67878e1ba4ba41c7bc81faa19162d765', 'request_id': 'req-49e5e4bf-852e-4f7e-9882-c03e92448612'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:37.724223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-49e5e4bf-852e-4f7e-9882-c03e92448612 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67878e1ba4ba41c7bc81faa19162d765', 'request_id': 'req-49e5e4bf-852e-4f7e-9882-c03e92448612'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:37.735812 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-49e5e4bf-852e-4f7e-9882-c03e92448612 admin admin] The token cache is being invalidate because project 67878e1ba4ba41c7bc81faa19162d765 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:26:37.736111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-49e5e4bf-852e-4f7e-9882-c03e92448612 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:37.736813 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-49e5e4bf-852e-4f7e-9882-c03e92448612 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:37.738420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 909/1819] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:26:36 2022] DELETE /identity/v3/projects/67878e1ba4ba41c7bc81faa19162d765 => generated 0 bytes in 933 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:37.742492 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43affc-8e77-41ae-bea4-0f5b936c9dac service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:37.746024 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:37.771637 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43affc-8e77-41ae-bea4-0f5b936c9dac service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:37.841228 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf04abd-2a11-40ce-a539-48635eca0eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:37.842307 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf04abd-2a11-40ce-a539-48635eca0eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:37.843297 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf04abd-2a11-40ce-a539-48635eca0eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:37.843743 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf04abd-2a11-40ce-a539-48635eca0eb4 admin admin] PATH_INFO: `/v3/users/5eb75c9cbc1b4a96b1a46c60615f4778` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:37.845064 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf04abd-2a11-40ce-a539-48635eca0eb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eb75c9cbc1b4a96b1a46c60615f4778)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:37.847061 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf04abd-2a11-40ce-a539-48635eca0eb4 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:38.193558 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-abf04abd-2a11-40ce-a539-48635eca0eb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eb75c9cbc1b4a96b1a46c60615f4778'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:38.194308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-abf04abd-2a11-40ce-a539-48635eca0eb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eb75c9cbc1b4a96b1a46c60615f4778'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:38.201507 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-abf04abd-2a11-40ce-a539-48635eca0eb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eb75c9cbc1b4a96b1a46c60615f4778'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:38.294086 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-abf04abd-2a11-40ce-a539-48635eca0eb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eb75c9cbc1b4a96b1a46c60615f4778'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:38.307461 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-abf04abd-2a11-40ce-a539-48635eca0eb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eb75c9cbc1b4a96b1a46c60615f4778'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:38.317077 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 911/1820] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:26:37 2022] DELETE /identity/v3/users/5eb75c9cbc1b4a96b1a46c60615f4778 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:38.832292 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5e4bf-852e-4f7e-9882-c03e92448612 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:38.833958 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-49e5e4bf-852e-4f7e-9882-c03e92448612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:38.847105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5e4bf-852e-4f7e-9882-c03e92448612 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:38.906680 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09759290-dcb9-4b50-ae64-63ef73abe75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:38.907555 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09759290-dcb9-4b50-ae64-63ef73abe75e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:38.907845 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09759290-dcb9-4b50-ae64-63ef73abe75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:38.908201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09759290-dcb9-4b50-ae64-63ef73abe75e admin admin] PATH_INFO: `/v3/projects/062b0177f1744177827a070d2f85916c` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:38.909393 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09759290-dcb9-4b50-ae64-63ef73abe75e admin admin] RBAC: Authorizing `identity:delete_project(project_id=062b0177f1744177827a070d2f85916c)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:38.911985 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09759290-dcb9-4b50-ae64-63ef73abe75e admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:39.025322 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-09759290-dcb9-4b50-ae64-63ef73abe75e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '062b0177f1744177827a070d2f85916c', 'request_id': 'req-09759290-dcb9-4b50-ae64-63ef73abe75e'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:39.116421 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-09759290-dcb9-4b50-ae64-63ef73abe75e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '062b0177f1744177827a070d2f85916c', 'request_id': 'req-09759290-dcb9-4b50-ae64-63ef73abe75e'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:39.124802 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-09759290-dcb9-4b50-ae64-63ef73abe75e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '062b0177f1744177827a070d2f85916c', 'request_id': 'req-09759290-dcb9-4b50-ae64-63ef73abe75e'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:39.137585 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-09759290-dcb9-4b50-ae64-63ef73abe75e admin admin] The token cache is being invalidate because project 062b0177f1744177827a070d2f85916c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:26:39.138743 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-09759290-dcb9-4b50-ae64-63ef73abe75e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:39.139096 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-09759290-dcb9-4b50-ae64-63ef73abe75e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:39.146675 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 910/1821] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:26:38 2022] DELETE /identity/v3/projects/062b0177f1744177827a070d2f85916c => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:39.148442 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f044c27-80d1-49ca-9a2a-89dc9bc1e82b None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:39.148916 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f044c27-80d1-49ca-9a2a-89dc9bc1e82b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:39.149013 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f044c27-80d1-49ca-9a2a-89dc9bc1e82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:39.188031 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-0f044c27-80d1-49ca-9a2a-89dc9bc1e82b None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:39.188031 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-0f044c27-80d1-49ca-9a2a-89dc9bc1e82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:39.250907 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:39.305848 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 912/1822] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:26:39.320261 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f7d96-246d-432d-879d-d6cddf7d654c None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:39.320261 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f7d96-246d-432d-879d-d6cddf7d654c None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:39.320261 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f7d96-246d-432d-879d-d6cddf7d654c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:39.338874 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-270f7d96-246d-432d-879d-d6cddf7d654c None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:39.340099 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-270f7d96-246d-432d-879d-d6cddf7d654c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:39.348801 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 911/1823] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:39.354421 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f044c27-80d1-49ca-9a2a-89dc9bc1e82b None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:39.366014 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f044c27-80d1-49ca-9a2a-89dc9bc1e82b None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:39.371012 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d144d5-8bd6-46e7-97c3-65d3e7699bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:39.371701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d144d5-8bd6-46e7-97c3-65d3e7699bca admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:39.372111 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d144d5-8bd6-46e7-97c3-65d3e7699bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:39.372429 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d144d5-8bd6-46e7-97c3-65d3e7699bca admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:39.373529 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d144d5-8bd6-46e7-97c3-65d3e7699bca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:26:39.374041 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d144d5-8bd6-46e7-97c3-65d3e7699bca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:39.376327 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d144d5-8bd6-46e7-97c3-65d3e7699bca admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:39.392541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 913/1824] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:26:39.396587 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f7d96-246d-432d-879d-d6cddf7d654c None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:39.405632 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f7d96-246d-432d-879d-d6cddf7d654c None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:39.411036 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2030e-98c9-47cb-bd23-f13573024d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:39.411825 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2030e-98c9-47cb-bd23-f13573024d98 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:39.412123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2030e-98c9-47cb-bd23-f13573024d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:39.412416 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2030e-98c9-47cb-bd23-f13573024d98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:39.413112 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2030e-98c9-47cb-bd23-f13573024d98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:39.415064 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2030e-98c9-47cb-bd23-f13573024d98 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:39.530550 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 912/1825] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:26:39 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:39.534960 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d144d5-8bd6-46e7-97c3-65d3e7699bca admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:39.546929 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d144d5-8bd6-46e7-97c3-65d3e7699bca admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:39.604636 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c95a6c-4552-4d20-9257-2af644d1c91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:39.605317 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c95a6c-4552-4d20-9257-2af644d1c91e admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:39.605613 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c95a6c-4552-4d20-9257-2af644d1c91e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:39.605935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c95a6c-4552-4d20-9257-2af644d1c91e admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:39.606629 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c95a6c-4552-4d20-9257-2af644d1c91e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:39.608570 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c95a6c-4552-4d20-9257-2af644d1c91e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:39.689660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 914/1826] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:26:39 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:26:39.694772 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2030e-98c9-47cb-bd23-f13573024d98 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:39.705521 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2030e-98c9-47cb-bd23-f13573024d98 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:39.717495 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b049ee-cb68-433d-9a30-e10e64ac4329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:39.717495 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b049ee-cb68-433d-9a30-e10e64ac4329 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:39.717495 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b049ee-cb68-433d-9a30-e10e64ac4329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:39.717495 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b049ee-cb68-433d-9a30-e10e64ac4329 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:39.718132 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b049ee-cb68-433d-9a30-e10e64ac4329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:39.718132 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b049ee-cb68-433d-9a30-e10e64ac4329 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:39.728376 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 913/1827] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:26:39.732816 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c95a6c-4552-4d20-9257-2af644d1c91e admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:39.743493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c95a6c-4552-4d20-9257-2af644d1c91e admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:39.750496 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6fd5a6-4b1d-4cd7-bd9c-786fe05e5e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:39.751557 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6fd5a6-4b1d-4cd7-bd9c-786fe05e5e00 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:39.751938 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6fd5a6-4b1d-4cd7-bd9c-786fe05e5e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:39.752334 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6fd5a6-4b1d-4cd7-bd9c-786fe05e5e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:39.753431 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6fd5a6-4b1d-4cd7-bd9c-786fe05e5e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:39.755960 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6fd5a6-4b1d-4cd7-bd9c-786fe05e5e00 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:39.793842 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 915/1828] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:26:39.794826 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b049ee-cb68-433d-9a30-e10e64ac4329 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:39.805672 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b049ee-cb68-433d-9a30-e10e64ac4329 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:39.810972 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb5800-80da-46c3-b241-2d085d33df53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:39.812435 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb5800-80da-46c3-b241-2d085d33df53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:39.812435 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb5800-80da-46c3-b241-2d085d33df53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:39.812606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb5800-80da-46c3-b241-2d085d33df53 admin admin] PATH_INFO: `/v3/projects/99ede82e12c34b91824faedad11895e4/users/479dabc7413d44d1943fc4230b0725a5/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:39.830051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb5800-80da-46c3-b241-2d085d33df53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99ede82e12c34b91824faedad11895e4, user_id=479dabc7413d44d1943fc4230b0725a5, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:39.833466 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb5800-80da-46c3-b241-2d085d33df53 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:39.963297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 914/1829] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:26:39 2022] PUT /identity/v3/projects/99ede82e12c34b91824faedad11895e4/users/479dabc7413d44d1943fc4230b0725a5/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:26:39.972920 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3ac00-ecbe-4c71-baa9-015f08a3947c None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:39.973217 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3ac00-ecbe-4c71-baa9-015f08a3947c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:39.973575 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3ac00-ecbe-4c71-baa9-015f08a3947c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:40.004763 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-bbf3ac00-ecbe-4c71-baa9-015f08a3947c None None] MFA Rules not processed for user `479dabc7413d44d1943fc4230b0725a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:40.006054 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-bbf3ac00-ecbe-4c71-baa9-015f08a3947c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:40.111228 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 916/1830] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:40.140140 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb5800-80da-46c3-b241-2d085d33df53 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:40.142016 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-6bcb5800-80da-46c3-b241-2d085d33df53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:40.215221 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb5800-80da-46c3-b241-2d085d33df53 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:40.221713 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6fab8-c87c-42c6-a79b-b7ce6c46717b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:40.227420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6fab8-c87c-42c6-a79b-b7ce6c46717b service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:40.227420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6fab8-c87c-42c6-a79b-b7ce6c46717b service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:40.227420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6fab8-c87c-42c6-a79b-b7ce6c46717b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:40.241362 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6fab8-c87c-42c6-a79b-b7ce6c46717b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:40.244699 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6fab8-c87c-42c6-a79b-b7ce6c46717b service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:40.261486 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 915/1831] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:26:40.300293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3ac00-ecbe-4c71-baa9-015f08a3947c None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:40.379473 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3ac00-ecbe-4c71-baa9-015f08a3947c None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:40.385408 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1dc3f-56b0-49ba-ac28-75c2f819f212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:40.387195 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1dc3f-56b0-49ba-ac28-75c2f819f212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:40.387582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1dc3f-56b0-49ba-ac28-75c2f819f212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:40.388046 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1dc3f-56b0-49ba-ac28-75c2f819f212 admin admin] PATH_INFO: `/v3/users/479dabc7413d44d1943fc4230b0725a5` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:40.390411 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1dc3f-56b0-49ba-ac28-75c2f819f212 admin admin] RBAC: Authorizing `identity:delete_user(user_id=479dabc7413d44d1943fc4230b0725a5)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:40.393930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1dc3f-56b0-49ba-ac28-75c2f819f212 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:40.767074 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ccb1dc3f-56b0-49ba-ac28-75c2f819f212 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '479dabc7413d44d1943fc4230b0725a5'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:40.767074 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ccb1dc3f-56b0-49ba-ac28-75c2f819f212 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '479dabc7413d44d1943fc4230b0725a5'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:40.774217 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ccb1dc3f-56b0-49ba-ac28-75c2f819f212 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '479dabc7413d44d1943fc4230b0725a5'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:40.893868 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ccb1dc3f-56b0-49ba-ac28-75c2f819f212 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '479dabc7413d44d1943fc4230b0725a5'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:40.913595 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ccb1dc3f-56b0-49ba-ac28-75c2f819f212 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '479dabc7413d44d1943fc4230b0725a5'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:40.921004 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 917/1832] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:26:40 2022] DELETE /identity/v3/users/479dabc7413d44d1943fc4230b0725a5 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:26:40.926262 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0b031-1086-46ab-b66f-65768fe71753 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:40.926855 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0b031-1086-46ab-b66f-65768fe71753 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:40.926855 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0b031-1086-46ab-b66f-65768fe71753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:40.948677 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-22a0b031-1086-46ab-b66f-65768fe71753 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:40.949950 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-22a0b031-1086-46ab-b66f-65768fe71753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:40.976993 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:41.026190 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 916/1833] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:26:41.038449 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1dc3f-56b0-49ba-ac28-75c2f819f212 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:41.040692 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ccb1dc3f-56b0-49ba-ac28-75c2f819f212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:41.112794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1dc3f-56b0-49ba-ac28-75c2f819f212 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:41.117138 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ac5a6-a7b8-47a4-968f-3920d02ec817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:41.117833 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ac5a6-a7b8-47a4-968f-3920d02ec817 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:41.118123 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ac5a6-a7b8-47a4-968f-3920d02ec817 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:41.118405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ac5a6-a7b8-47a4-968f-3920d02ec817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:41.128326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ac5a6-a7b8-47a4-968f-3920d02ec817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:41.130579 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ac5a6-a7b8-47a4-968f-3920d02ec817 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:41.141077 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 918/1834] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:26:41.648074 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0b031-1086-46ab-b66f-65768fe71753 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:41.651781 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-22a0b031-1086-46ab-b66f-65768fe71753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:41.680107 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0b031-1086-46ab-b66f-65768fe71753 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:41.690064 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bf8f1-2c72-4059-ac9a-727d438b8b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:41.690949 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bf8f1-2c72-4059-ac9a-727d438b8b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:41.691234 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bf8f1-2c72-4059-ac9a-727d438b8b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:41.694941 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bf8f1-2c72-4059-ac9a-727d438b8b13 admin admin] PATH_INFO: `/v3/projects/99ede82e12c34b91824faedad11895e4` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:41.696913 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8bf8f1-2c72-4059-ac9a-727d438b8b13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99ede82e12c34b91824faedad11895e4)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:41.703959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8bf8f1-2c72-4059-ac9a-727d438b8b13 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:41.904947 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-0b8bf8f1-2c72-4059-ac9a-727d438b8b13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99ede82e12c34b91824faedad11895e4', 'request_id': 'req-0b8bf8f1-2c72-4059-ac9a-727d438b8b13'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:42.041839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-0b8bf8f1-2c72-4059-ac9a-727d438b8b13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99ede82e12c34b91824faedad11895e4', 'request_id': 'req-0b8bf8f1-2c72-4059-ac9a-727d438b8b13'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:42.048863 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-0b8bf8f1-2c72-4059-ac9a-727d438b8b13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99ede82e12c34b91824faedad11895e4', 'request_id': 'req-0b8bf8f1-2c72-4059-ac9a-727d438b8b13'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:42.059770 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-0b8bf8f1-2c72-4059-ac9a-727d438b8b13 admin admin] The token cache is being invalidate because project 99ede82e12c34b91824faedad11895e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:26:42.060064 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-0b8bf8f1-2c72-4059-ac9a-727d438b8b13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:42.060704 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-0b8bf8f1-2c72-4059-ac9a-727d438b8b13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:42.062313 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 917/1835] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:26:41 2022] DELETE /identity/v3/projects/99ede82e12c34b91824faedad11895e4 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:42.067691 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b9d43-cde9-41cd-8474-5e748ee31a52 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:42.069102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b9d43-cde9-41cd-8474-5e748ee31a52 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:42.069102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b9d43-cde9-41cd-8474-5e748ee31a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:42.088032 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-e30b9d43-cde9-41cd-8474-5e748ee31a52 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:42.089412 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e30b9d43-cde9-41cd-8474-5e748ee31a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:42.151393 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:42.161377 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 919/1836] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:26:42.168814 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614ea1b-3106-4c01-bc90-3fa0f6c0b619 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:42.169115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614ea1b-3106-4c01-bc90-3fa0f6c0b619 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:42.169401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614ea1b-3106-4c01-bc90-3fa0f6c0b619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:42.207876 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-c614ea1b-3106-4c01-bc90-3fa0f6c0b619 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:42.209097 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-c614ea1b-3106-4c01-bc90-3fa0f6c0b619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:42.222134 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 918/1837] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:42.228731 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b9d43-cde9-41cd-8474-5e748ee31a52 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:42.241067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b9d43-cde9-41cd-8474-5e748ee31a52 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:42.246817 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23036f03-8036-42a8-b9a2-7f9bac815097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:42.247520 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23036f03-8036-42a8-b9a2-7f9bac815097 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:42.250800 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23036f03-8036-42a8-b9a2-7f9bac815097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:42.250800 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23036f03-8036-42a8-b9a2-7f9bac815097 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:42.250800 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23036f03-8036-42a8-b9a2-7f9bac815097 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:26:42.250800 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23036f03-8036-42a8-b9a2-7f9bac815097 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:42.251287 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23036f03-8036-42a8-b9a2-7f9bac815097 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:42.265644 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 920/1838] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:26:42.270962 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614ea1b-3106-4c01-bc90-3fa0f6c0b619 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:42.281889 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614ea1b-3106-4c01-bc90-3fa0f6c0b619 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:42.289487 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8ce3a-2ec2-4a52-a755-ca999ae1087b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:42.289487 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8ce3a-2ec2-4a52-a755-ca999ae1087b admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:42.289487 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8ce3a-2ec2-4a52-a755-ca999ae1087b admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:42.289487 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8ce3a-2ec2-4a52-a755-ca999ae1087b admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:42.289999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c8ce3a-2ec2-4a52-a755-ca999ae1087b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:42.291533 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c8ce3a-2ec2-4a52-a755-ca999ae1087b admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:42.434817 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 919/1839] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:26:42 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:42.437505 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23036f03-8036-42a8-b9a2-7f9bac815097 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:42.449052 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23036f03-8036-42a8-b9a2-7f9bac815097 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:42.487459 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8ce3a-2ec2-4a52-a755-ca999ae1087b admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:42.490094 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-55c8ce3a-2ec2-4a52-a755-ca999ae1087b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:42.511428 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d74c49-964a-493e-a6f0-6fa58a88320f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:42.512315 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d74c49-964a-493e-a6f0-6fa58a88320f admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:42.512606 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d74c49-964a-493e-a6f0-6fa58a88320f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:42.512871 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d74c49-964a-493e-a6f0-6fa58a88320f admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:42.513582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d74c49-964a-493e-a6f0-6fa58a88320f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:42.515554 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d74c49-964a-493e-a6f0-6fa58a88320f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:42.565090 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8ce3a-2ec2-4a52-a755-ca999ae1087b admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:42.570491 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48337d88-270c-4247-8f0a-43042caf6377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:42.571681 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48337d88-270c-4247-8f0a-43042caf6377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:42.571961 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48337d88-270c-4247-8f0a-43042caf6377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:42.572234 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48337d88-270c-4247-8f0a-43042caf6377 admin admin] PATH_INFO: `/v3/users/f4938fbcc05b4766b75053c249555887` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:42.573423 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48337d88-270c-4247-8f0a-43042caf6377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4938fbcc05b4766b75053c249555887)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:42.575485 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48337d88-270c-4247-8f0a-43042caf6377 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:43.729972 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 921/1840] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:26:42 2022] POST /identity/v3/users => generated 287 bytes in 1293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:26:43.733992 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d74c49-964a-493e-a6f0-6fa58a88320f admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:43.743763 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d74c49-964a-493e-a6f0-6fa58a88320f admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:43.748334 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7780ac-6780-4753-b7cf-1d4dc57255ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:43.748996 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7780ac-6780-4753-b7cf-1d4dc57255ae admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:43.749311 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7780ac-6780-4753-b7cf-1d4dc57255ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:43.749591 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7780ac-6780-4753-b7cf-1d4dc57255ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:43.750396 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7780ac-6780-4753-b7cf-1d4dc57255ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:43.752050 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7780ac-6780-4753-b7cf-1d4dc57255ae admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:43.766297 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 922/1841] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:26:43.767270 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7780ac-6780-4753-b7cf-1d4dc57255ae admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:43.778372 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7780ac-6780-4753-b7cf-1d4dc57255ae admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:43.783097 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c05585-abb0-454c-9cab-110316dc1307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:43.783763 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c05585-abb0-454c-9cab-110316dc1307 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:43.784053 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c05585-abb0-454c-9cab-110316dc1307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:43.784421 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c05585-abb0-454c-9cab-110316dc1307 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:43.785700 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c05585-abb0-454c-9cab-110316dc1307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:43.787337 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c05585-abb0-454c-9cab-110316dc1307 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:43.798313 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 923/1842] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:26:43.802948 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c05585-abb0-454c-9cab-110316dc1307 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:43.812635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c05585-abb0-454c-9cab-110316dc1307 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:43.818396 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a6877-b416-47b8-9301-0658173a0a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:43.819280 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a6877-b416-47b8-9301-0658173a0a45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:43.819570 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a6877-b416-47b8-9301-0658173a0a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:43.819857 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a6877-b416-47b8-9301-0658173a0a45 admin admin] PATH_INFO: `/v3/projects/6fcefda8be6c4727a93645075e72c217/users/24e42e0322a1480baadc090a57b7a80b/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:43.837318 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a6877-b416-47b8-9301-0658173a0a45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fcefda8be6c4727a93645075e72c217, user_id=24e42e0322a1480baadc090a57b7a80b, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:43.840318 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a6877-b416-47b8-9301-0658173a0a45 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:43.840459 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-48337d88-270c-4247-8f0a-43042caf6377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4938fbcc05b4766b75053c249555887'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:43.933799 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-48337d88-270c-4247-8f0a-43042caf6377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4938fbcc05b4766b75053c249555887'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:43.943584 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-48337d88-270c-4247-8f0a-43042caf6377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4938fbcc05b4766b75053c249555887'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:43.946055 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 924/1843] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:26:43 2022] PUT /identity/v3/projects/6fcefda8be6c4727a93645075e72c217/users/24e42e0322a1480baadc090a57b7a80b/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:43.947524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-48337d88-270c-4247-8f0a-43042caf6377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4938fbcc05b4766b75053c249555887'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:43.953129 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-48337d88-270c-4247-8f0a-43042caf6377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4938fbcc05b4766b75053c249555887'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:43.972535 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac552d-bcc5-4622-a5cf-06dbc1736abb None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:43.972940 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac552d-bcc5-4622-a5cf-06dbc1736abb None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:43.973623 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac552d-bcc5-4622-a5cf-06dbc1736abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:43.983642 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 920/1844] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:26:42 2022] DELETE /identity/v3/users/f4938fbcc05b4766b75053c249555887 => generated 0 bytes in 1494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:26:43.985074 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae1e5f-3295-404b-a7ed-3f5b9bb09b71 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:43.985378 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae1e5f-3295-404b-a7ed-3f5b9bb09b71 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:43.985668 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae1e5f-3295-404b-a7ed-3f5b9bb09b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:44.015911 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-bbae1e5f-3295-404b-a7ed-3f5b9bb09b71 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:44.015911 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-bbae1e5f-3295-404b-a7ed-3f5b9bb09b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:44.022471 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-7cac552d-bcc5-4622-a5cf-06dbc1736abb None None] MFA Rules not processed for user `24e42e0322a1480baadc090a57b7a80b`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:44.023775 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7cac552d-bcc5-4622-a5cf-06dbc1736abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:44.085277 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 921/1845] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:44.092831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae1e5f-3295-404b-a7ed-3f5b9bb09b71 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:44.094562 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-bbae1e5f-3295-404b-a7ed-3f5b9bb09b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:44.116705 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 925/1846] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:44.127992 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac552d-bcc5-4622-a5cf-06dbc1736abb None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:44.130673 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7cac552d-bcc5-4622-a5cf-06dbc1736abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:44.161589 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae1e5f-3295-404b-a7ed-3f5b9bb09b71 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:44.165323 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ead84-238c-4898-baa1-6452cbb24701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:44.166049 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ead84-238c-4898-baa1-6452cbb24701 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:44.166339 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ead84-238c-4898-baa1-6452cbb24701 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:44.166615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ead84-238c-4898-baa1-6452cbb24701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:44.176428 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ead84-238c-4898-baa1-6452cbb24701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:44.178115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ead84-238c-4898-baa1-6452cbb24701 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:44.183813 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:44.187396 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac552d-bcc5-4622-a5cf-06dbc1736abb None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:44.190111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 922/1847] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:26:44.191117 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668e5ae-c683-4381-b3e7-19eabe6aab42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:44.192042 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668e5ae-c683-4381-b3e7-19eabe6aab42 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:44.192341 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668e5ae-c683-4381-b3e7-19eabe6aab42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:44.192621 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668e5ae-c683-4381-b3e7-19eabe6aab42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:44.201597 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668e5ae-c683-4381-b3e7-19eabe6aab42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:44.204645 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668e5ae-c683-4381-b3e7-19eabe6aab42 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:44.214094 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 926/1848] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:26:44.677555 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ead84-238c-4898-baa1-6452cbb24701 service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:44.679415 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-925ead84-238c-4898-baa1-6452cbb24701 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:44.695465 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ead84-238c-4898-baa1-6452cbb24701 service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:44.712362 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046ef2a-fa15-43b3-9838-c8d23afc36d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:44.712362 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046ef2a-fa15-43b3-9838-c8d23afc36d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:44.712362 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046ef2a-fa15-43b3-9838-c8d23afc36d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:44.712362 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046ef2a-fa15-43b3-9838-c8d23afc36d5 admin admin] PATH_INFO: `/v3/projects/a1a4e3e9819c4c04a823f4edda3202ef` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:44.712722 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f046ef2a-fa15-43b3-9838-c8d23afc36d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1a4e3e9819c4c04a823f4edda3202ef)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:44.712722 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f046ef2a-fa15-43b3-9838-c8d23afc36d5 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:44.881326 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-f046ef2a-fa15-43b3-9838-c8d23afc36d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1a4e3e9819c4c04a823f4edda3202ef', 'request_id': 'req-f046ef2a-fa15-43b3-9838-c8d23afc36d5'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:44.939585 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:44.974142 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-f046ef2a-fa15-43b3-9838-c8d23afc36d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1a4e3e9819c4c04a823f4edda3202ef', 'request_id': 'req-f046ef2a-fa15-43b3-9838-c8d23afc36d5'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:44.989347 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-f046ef2a-fa15-43b3-9838-c8d23afc36d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1a4e3e9819c4c04a823f4edda3202ef', 'request_id': 'req-f046ef2a-fa15-43b3-9838-c8d23afc36d5'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:44.999906 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:45.011929 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-f046ef2a-fa15-43b3-9838-c8d23afc36d5 admin admin] The token cache is being invalidate because project a1a4e3e9819c4c04a823f4edda3202ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:26:45.012233 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-f046ef2a-fa15-43b3-9838-c8d23afc36d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:45.012921 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-f046ef2a-fa15-43b3-9838-c8d23afc36d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:45.017429 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 923/1849] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:26:44 2022] DELETE /identity/v3/projects/a1a4e3e9819c4c04a823f4edda3202ef => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:45.020075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668e5ae-c683-4381-b3e7-19eabe6aab42 service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:45.033513 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668e5ae-c683-4381-b3e7-19eabe6aab42 service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:45.110520 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc9021-33d7-4352-9890-15a3ba3fe4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:45.112094 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc9021-33d7-4352-9890-15a3ba3fe4c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:45.113830 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc9021-33d7-4352-9890-15a3ba3fe4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:45.113830 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc9021-33d7-4352-9890-15a3ba3fe4c0 admin admin] PATH_INFO: `/v3/users/0427238ce13c4d6284c5994ef9b53d1c` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:45.114750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc9021-33d7-4352-9890-15a3ba3fe4c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0427238ce13c4d6284c5994ef9b53d1c)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:45.116975 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc9021-33d7-4352-9890-15a3ba3fe4c0 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:45.336551 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-9fcc9021-33d7-4352-9890-15a3ba3fe4c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0427238ce13c4d6284c5994ef9b53d1c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:45.337138 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-9fcc9021-33d7-4352-9890-15a3ba3fe4c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0427238ce13c4d6284c5994ef9b53d1c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:45.344621 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-9fcc9021-33d7-4352-9890-15a3ba3fe4c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0427238ce13c4d6284c5994ef9b53d1c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:45.476233 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-9fcc9021-33d7-4352-9890-15a3ba3fe4c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0427238ce13c4d6284c5994ef9b53d1c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:45.488996 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-9fcc9021-33d7-4352-9890-15a3ba3fe4c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0427238ce13c4d6284c5994ef9b53d1c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:45.495212 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 927/1850] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:26:45 2022] DELETE /identity/v3/users/0427238ce13c4d6284c5994ef9b53d1c => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:46.140972 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046ef2a-fa15-43b3-9838-c8d23afc36d5 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:46.142544 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-f046ef2a-fa15-43b3-9838-c8d23afc36d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:46.156675 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046ef2a-fa15-43b3-9838-c8d23afc36d5 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:46.217684 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a49fc-9191-4a8e-b144-4c9ddeb557d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:46.218638 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a49fc-9191-4a8e-b144-4c9ddeb557d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:46.218968 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a49fc-9191-4a8e-b144-4c9ddeb557d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:46.219253 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a49fc-9191-4a8e-b144-4c9ddeb557d7 admin admin] PATH_INFO: `/v3/projects/65b92b9827a54ec9b590fe4dc31313bf` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:46.220488 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a49fc-9191-4a8e-b144-4c9ddeb557d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65b92b9827a54ec9b590fe4dc31313bf)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:46.223076 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a49fc-9191-4a8e-b144-4c9ddeb557d7 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:46.363564 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-5d5a49fc-9191-4a8e-b144-4c9ddeb557d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65b92b9827a54ec9b590fe4dc31313bf', 'request_id': 'req-5d5a49fc-9191-4a8e-b144-4c9ddeb557d7'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:46.447643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-5d5a49fc-9191-4a8e-b144-4c9ddeb557d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65b92b9827a54ec9b590fe4dc31313bf', 'request_id': 'req-5d5a49fc-9191-4a8e-b144-4c9ddeb557d7'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:46.448793 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:46.456159 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-5d5a49fc-9191-4a8e-b144-4c9ddeb557d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65b92b9827a54ec9b590fe4dc31313bf', 'request_id': 'req-5d5a49fc-9191-4a8e-b144-4c9ddeb557d7'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:46.470014 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-5d5a49fc-9191-4a8e-b144-4c9ddeb557d7 admin admin] The token cache is being invalidate because project 65b92b9827a54ec9b590fe4dc31313bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:26:46.470366 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-5d5a49fc-9191-4a8e-b144-4c9ddeb557d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:46.471062 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-5d5a49fc-9191-4a8e-b144-4c9ddeb557d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:46.476305 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 924/1851] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:26:46 2022] DELETE /identity/v3/projects/65b92b9827a54ec9b590fe4dc31313bf => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:46.478091 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee179ff3-cc3f-4fc6-a01a-e8faa8b7ee24 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:46.482753 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee179ff3-cc3f-4fc6-a01a-e8faa8b7ee24 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:46.483082 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee179ff3-cc3f-4fc6-a01a-e8faa8b7ee24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:46.501733 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-ee179ff3-cc3f-4fc6-a01a-e8faa8b7ee24 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:46.502997 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ee179ff3-cc3f-4fc6-a01a-e8faa8b7ee24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:46.567590 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 928/1852] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:26:46.575730 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d0098-b8e5-4747-99dc-3c819b65c971 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:46.576029 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d0098-b8e5-4747-99dc-3c819b65c971 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:46.576344 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d0098-b8e5-4747-99dc-3c819b65c971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:46.597050 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-979d0098-b8e5-4747-99dc-3c819b65c971 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:46.599019 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-979d0098-b8e5-4747-99dc-3c819b65c971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:46.607631 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 925/1853] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:46.611960 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee179ff3-cc3f-4fc6-a01a-e8faa8b7ee24 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:46.627539 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee179ff3-cc3f-4fc6-a01a-e8faa8b7ee24 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:46.627539 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e14678-70ac-4c92-b934-ba153e9cdefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:46.627539 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e14678-70ac-4c92-b934-ba153e9cdefa admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:46.627539 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e14678-70ac-4c92-b934-ba153e9cdefa admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:46.627911 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e14678-70ac-4c92-b934-ba153e9cdefa admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:46.628358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e14678-70ac-4c92-b934-ba153e9cdefa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:26:46.629177 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e14678-70ac-4c92-b934-ba153e9cdefa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:46.630851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e14678-70ac-4c92-b934-ba153e9cdefa admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:46.642279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 929/1854] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:26:46.647380 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d0098-b8e5-4747-99dc-3c819b65c971 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:46.656463 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d0098-b8e5-4747-99dc-3c819b65c971 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:46.661314 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d984607-440d-4e75-ab06-4893caf2b599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:46.661992 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d984607-440d-4e75-ab06-4893caf2b599 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:46.662324 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d984607-440d-4e75-ab06-4893caf2b599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:46.662992 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d984607-440d-4e75-ab06-4893caf2b599 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:46.663715 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d984607-440d-4e75-ab06-4893caf2b599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:46.665599 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d984607-440d-4e75-ab06-4893caf2b599 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:46.786749 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 926/1855] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:26:46 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:46.791478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e14678-70ac-4c92-b934-ba153e9cdefa admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:46.801932 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e14678-70ac-4c92-b934-ba153e9cdefa admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:46.856882 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9464a3-5568-4d19-8838-cd73ea651cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:46.857562 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9464a3-5568-4d19-8838-cd73ea651cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:46.857876 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9464a3-5568-4d19-8838-cd73ea651cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:46.858160 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9464a3-5568-4d19-8838-cd73ea651cb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:46.858850 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9464a3-5568-4d19-8838-cd73ea651cb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:46.860790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9464a3-5568-4d19-8838-cd73ea651cb6 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:46.977028 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 930/1856] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:26:46 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:46.980967 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d984607-440d-4e75-ab06-4893caf2b599 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:46.993039 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d984607-440d-4e75-ab06-4893caf2b599 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:46.998188 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6099305-6c3a-4a73-8372-aa00459d7fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:46.998870 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6099305-6c3a-4a73-8372-aa00459d7fbd admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:46.999307 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6099305-6c3a-4a73-8372-aa00459d7fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:46.999783 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6099305-6c3a-4a73-8372-aa00459d7fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:47.000713 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6099305-6c3a-4a73-8372-aa00459d7fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:47.003299 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6099305-6c3a-4a73-8372-aa00459d7fbd admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:47.016078 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 927/1857] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:26:47.020010 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9464a3-5568-4d19-8838-cd73ea651cb6 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:47.030532 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9464a3-5568-4d19-8838-cd73ea651cb6 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:47.035661 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06b97b-8dc5-416b-baa4-c59c0b25a18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:47.036534 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06b97b-8dc5-416b-baa4-c59c0b25a18a admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:47.036825 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06b97b-8dc5-416b-baa4-c59c0b25a18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:47.037295 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06b97b-8dc5-416b-baa4-c59c0b25a18a admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:47.037981 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06b97b-8dc5-416b-baa4-c59c0b25a18a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:47.039701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06b97b-8dc5-416b-baa4-c59c0b25a18a admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:47.058288 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 931/1858] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:26:47.059828 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6099305-6c3a-4a73-8372-aa00459d7fbd admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:47.061704 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:47.072175 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6099305-6c3a-4a73-8372-aa00459d7fbd admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:47.077543 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00e32e-ad24-4df0-87ad-62c1216cd861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:47.078496 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00e32e-ad24-4df0-87ad-62c1216cd861 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:47.078828 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00e32e-ad24-4df0-87ad-62c1216cd861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:47.079110 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00e32e-ad24-4df0-87ad-62c1216cd861 admin admin] PATH_INFO: `/v3/projects/a280f2e6017e4cc7b141a0c92a80c303/users/6a5d7b0b179a4034b84b9af5ff2dfcc3/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:47.101176 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00e32e-ad24-4df0-87ad-62c1216cd861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a280f2e6017e4cc7b141a0c92a80c303, user_id=6a5d7b0b179a4034b84b9af5ff2dfcc3, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:47.104090 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00e32e-ad24-4df0-87ad-62c1216cd861 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:47.157191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:47.174843 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1f5e2-9445-4664-9291-26b7f8e3f9a6 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:47.175136 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1f5e2-9445-4664-9291-26b7f8e3f9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:47.175420 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1f5e2-9445-4664-9291-26b7f8e3f9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:47.194980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 928/1859] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:26:47 2022] PUT /identity/v3/projects/a280f2e6017e4cc7b141a0c92a80c303/users/6a5d7b0b179a4034b84b9af5ff2dfcc3/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:47.206442 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78533f59-530c-48c8-923f-7a930679c70d None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:47.206726 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78533f59-530c-48c8-923f-7a930679c70d None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:47.213141 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78533f59-530c-48c8-923f-7a930679c70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:47.219388 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-d8a1f5e2-9445-4664-9291-26b7f8e3f9a6 None None] MFA Rules not processed for user `24e42e0322a1480baadc090a57b7a80b`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:47.223173 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d8a1f5e2-9445-4664-9291-26b7f8e3f9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:47.257854 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-78533f59-530c-48c8-923f-7a930679c70d None None] MFA Rules not processed for user `6a5d7b0b179a4034b84b9af5ff2dfcc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:47.259363 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-78533f59-530c-48c8-923f-7a930679c70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:47.310420 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 932/1860] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:26:47.388787 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 929/1861] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:47.395014 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1f5e2-9445-4664-9291-26b7f8e3f9a6 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:47.435875 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b66a9-8d3f-4297-9b05-80dd7dbe5792 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:47.436228 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b66a9-8d3f-4297-9b05-80dd7dbe5792 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:47.436434 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b66a9-8d3f-4297-9b05-80dd7dbe5792 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:47.438936 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 930/1862] 10.222.0.23 () {54 vars in 921 bytes} [Mon Jul 11 11:26:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:26:47.470868 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ff7ba-db17-4807-abbd-b1b4f7af8975 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:47.473508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ff7ba-db17-4807-abbd-b1b4f7af8975 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:47.473508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ff7ba-db17-4807-abbd-b1b4f7af8975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:47.500968 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-b09ff7ba-db17-4807-abbd-b1b4f7af8975 None None] MFA Rules not processed for user `5b9e7594afc346e593ef3e6c579e237b`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:47.502528 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-b09ff7ba-db17-4807-abbd-b1b4f7af8975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:47.527601 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1f5e2-9445-4664-9291-26b7f8e3f9a6 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:47.534484 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a3e04-3a61-411b-b1e6-bb7ebc815a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:47.535203 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a3e04-3a61-411b-b1e6-bb7ebc815a9f admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:47.535493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a3e04-3a61-411b-b1e6-bb7ebc815a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:47.535781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a3e04-3a61-411b-b1e6-bb7ebc815a9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:47.537853 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a3e04-3a61-411b-b1e6-bb7ebc815a9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:47.540140 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a3e04-3a61-411b-b1e6-bb7ebc815a9f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:47.608701 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 931/1863] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Jul 11 11:26:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:47.658015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 933/1864] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:26:47 2022] POST /identity/v3/projects => generated 387 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:47.662929 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ff7ba-db17-4807-abbd-b1b4f7af8975 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:47.674065 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ff7ba-db17-4807-abbd-b1b4f7af8975 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:47.823148 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04f282-3494-4cea-9fe1-ad7c0ce3a9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:47.824145 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04f282-3494-4cea-9fe1-ad7c0ce3a9bc admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:47.824432 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04f282-3494-4cea-9fe1-ad7c0ce3a9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:47.824712 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04f282-3494-4cea-9fe1-ad7c0ce3a9bc admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:47.825991 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04f282-3494-4cea-9fe1-ad7c0ce3a9bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:47.830520 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04f282-3494-4cea-9fe1-ad7c0ce3a9bc admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:47.831716 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a3e04-3a61-411b-b1e6-bb7ebc815a9f admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:47.841289 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d69a3e04-3a61-411b-b1e6-bb7ebc815a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:47.912827 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a3e04-3a61-411b-b1e6-bb7ebc815a9f admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:47.918446 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f4f90-3b54-431c-a362-6516b219b4ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:47.921413 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f4f90-3b54-431c-a362-6516b219b4ff service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:47.921413 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f4f90-3b54-431c-a362-6516b219b4ff service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:47.921413 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f4f90-3b54-431c-a362-6516b219b4ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:47.929106 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f4f90-3b54-431c-a362-6516b219b4ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:47.930715 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f4f90-3b54-431c-a362-6516b219b4ff service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:47.940851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 934/1865] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:26:48.038067 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 932/1866] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:26:47 2022] POST /identity/v3/users => generated 300 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:48.043537 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f4f90-3b54-431c-a362-6516b219b4ff service nova] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:48.055866 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f4f90-3b54-431c-a362-6516b219b4ff service nova] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:48.062503 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77ed6c-2e81-41a6-a839-2994ad1459c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:48.063278 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77ed6c-2e81-41a6-a839-2994ad1459c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:48.063570 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77ed6c-2e81-41a6-a839-2994ad1459c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:48.063863 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77ed6c-2e81-41a6-a839-2994ad1459c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:48.064596 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77ed6c-2e81-41a6-a839-2994ad1459c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:48.077052 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77ed6c-2e81-41a6-a839-2994ad1459c4 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:48.088916 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 935/1867] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:26:48.093868 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04f282-3494-4cea-9fe1-ad7c0ce3a9bc admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:48.105036 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04f282-3494-4cea-9fe1-ad7c0ce3a9bc admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:48.110270 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c616a32-de5d-4c1a-a4bc-5b71938046d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:48.111190 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c616a32-de5d-4c1a-a4bc-5b71938046d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:48.111478 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c616a32-de5d-4c1a-a4bc-5b71938046d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:48.111757 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c616a32-de5d-4c1a-a4bc-5b71938046d3 admin admin] PATH_INFO: `/v3/projects/ae527db0454e4152a657c3a82b5fbc55/users/dc7eb81f090e432481be2e7b286e97eb/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:48.152365 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c616a32-de5d-4c1a-a4bc-5b71938046d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae527db0454e4152a657c3a82b5fbc55, user_id=dc7eb81f090e432481be2e7b286e97eb, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:48.156345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c616a32-de5d-4c1a-a4bc-5b71938046d3 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:48.273879 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 933/1868] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:26:48 2022] PUT /identity/v3/projects/ae527db0454e4152a657c3a82b5fbc55/users/dc7eb81f090e432481be2e7b286e97eb/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:48.277814 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77ed6c-2e81-41a6-a839-2994ad1459c4 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:48.288485 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77ed6c-2e81-41a6-a839-2994ad1459c4 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:48.349663 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffd510-fcbc-4fed-8ad1-f714061b4d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:48.350380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffd510-fcbc-4fed-8ad1-f714061b4d52 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:48.350668 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffd510-fcbc-4fed-8ad1-f714061b4d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:48.350949 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffd510-fcbc-4fed-8ad1-f714061b4d52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:48.351819 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ffd510-fcbc-4fed-8ad1-f714061b4d52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:48.353423 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ffd510-fcbc-4fed-8ad1-f714061b4d52 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:48.369090 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 936/1869] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:26:48.370670 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c616a32-de5d-4c1a-a4bc-5b71938046d3 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:48.382310 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c616a32-de5d-4c1a-a4bc-5b71938046d3 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:48.387033 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76bef3-6c9c-48b8-985b-975bbe4aa6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:48.387924 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76bef3-6c9c-48b8-985b-975bbe4aa6a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:48.388330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76bef3-6c9c-48b8-985b-975bbe4aa6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:48.388612 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76bef3-6c9c-48b8-985b-975bbe4aa6a2 admin admin] PATH_INFO: `/v3/projects/ae527db0454e4152a657c3a82b5fbc55/users/dc7eb81f090e432481be2e7b286e97eb/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:48.390668 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76bef3-6c9c-48b8-985b-975bbe4aa6a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae527db0454e4152a657c3a82b5fbc55, user_id=dc7eb81f090e432481be2e7b286e97eb, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:48.393390 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76bef3-6c9c-48b8-985b-975bbe4aa6a2 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:48.404568 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 934/1870] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:26:48 2022] PUT /identity/v3/projects/ae527db0454e4152a657c3a82b5fbc55/users/dc7eb81f090e432481be2e7b286e97eb/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:26:48.415657 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29206e-b0fa-4929-bc5c-e9bf4a363481 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:48.416017 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29206e-b0fa-4929-bc5c-e9bf4a363481 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:48.416315 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29206e-b0fa-4929-bc5c-e9bf4a363481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:48.444465 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-1e29206e-b0fa-4929-bc5c-e9bf4a363481 None None] MFA Rules not processed for user `dc7eb81f090e432481be2e7b286e97eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:48.446020 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1e29206e-b0fa-4929-bc5c-e9bf4a363481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:48.514628 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 937/1871] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:26:48.526312 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76bef3-6c9c-48b8-985b-975bbe4aa6a2 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:48.528588 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-8d76bef3-6c9c-48b8-985b-975bbe4aa6a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:48.595474 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76bef3-6c9c-48b8-985b-975bbe4aa6a2 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:48.599346 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f475de-a0ea-4edd-a410-9fc05693282d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:48.599994 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f475de-a0ea-4edd-a410-9fc05693282d service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:48.600278 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f475de-a0ea-4edd-a410-9fc05693282d service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:48.600554 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f475de-a0ea-4edd-a410-9fc05693282d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:48.610414 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f475de-a0ea-4edd-a410-9fc05693282d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:48.614752 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f475de-a0ea-4edd-a410-9fc05693282d service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:48.622897 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 935/1872] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:26:48.652096 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29206e-b0fa-4929-bc5c-e9bf4a363481 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:48.729961 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29206e-b0fa-4929-bc5c-e9bf4a363481 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:48.734621 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c255d30-1f70-424b-bf8c-2a35f1e46c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:48.735506 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c255d30-1f70-424b-bf8c-2a35f1e46c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:48.738634 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c255d30-1f70-424b-bf8c-2a35f1e46c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:48.739398 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c255d30-1f70-424b-bf8c-2a35f1e46c6b admin admin] PATH_INFO: `/v3/users/6a5d7b0b179a4034b84b9af5ff2dfcc3` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:48.740683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c255d30-1f70-424b-bf8c-2a35f1e46c6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a5d7b0b179a4034b84b9af5ff2dfcc3)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:48.742800 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c255d30-1f70-424b-bf8c-2a35f1e46c6b admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:49.130450 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8c255d30-1f70-424b-bf8c-2a35f1e46c6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a5d7b0b179a4034b84b9af5ff2dfcc3'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:49.131111 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8c255d30-1f70-424b-bf8c-2a35f1e46c6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a5d7b0b179a4034b84b9af5ff2dfcc3'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:49.139041 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8c255d30-1f70-424b-bf8c-2a35f1e46c6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a5d7b0b179a4034b84b9af5ff2dfcc3'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:49.239473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f475de-a0ea-4edd-a410-9fc05693282d service cinder] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:49.240894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-54f475de-a0ea-4edd-a410-9fc05693282d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:49.255330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f475de-a0ea-4edd-a410-9fc05693282d service cinder] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:49.260509 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e9ac4-a933-49ec-9bd0-d29714bdcc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:49.260879 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8c255d30-1f70-424b-bf8c-2a35f1e46c6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a5d7b0b179a4034b84b9af5ff2dfcc3'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:49.265599 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e9ac4-a933-49ec-9bd0-d29714bdcc86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:49.265599 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e9ac4-a933-49ec-9bd0-d29714bdcc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:49.265599 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e9ac4-a933-49ec-9bd0-d29714bdcc86 admin admin] PATH_INFO: `/v3/users/89363d96771349288eefae5a7ddcb413` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:49.265599 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e9ac4-a933-49ec-9bd0-d29714bdcc86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89363d96771349288eefae5a7ddcb413)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:49.266455 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e9ac4-a933-49ec-9bd0-d29714bdcc86 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:49.279216 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8c255d30-1f70-424b-bf8c-2a35f1e46c6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a5d7b0b179a4034b84b9af5ff2dfcc3'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:49.286072 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 938/1873] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:26:48 2022] DELETE /identity/v3/users/6a5d7b0b179a4034b84b9af5ff2dfcc3 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:49.290593 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d092c5-c92c-4b57-86f5-0e6df00d0634 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:49.290891 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d092c5-c92c-4b57-86f5-0e6df00d0634 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:49.291179 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d092c5-c92c-4b57-86f5-0e6df00d0634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:49.308796 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-e7d092c5-c92c-4b57-86f5-0e6df00d0634 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:49.310080 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e7d092c5-c92c-4b57-86f5-0e6df00d0634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:49.385056 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 939/1874] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:26:49.396754 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d092c5-c92c-4b57-86f5-0e6df00d0634 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:49.398291 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e7d092c5-c92c-4b57-86f5-0e6df00d0634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:49.473268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d092c5-c92c-4b57-86f5-0e6df00d0634 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:49.473268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6b1f2-beeb-46a3-88d7-30464de72dd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:49.473941 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6b1f2-beeb-46a3-88d7-30464de72dd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:49.474241 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6b1f2-beeb-46a3-88d7-30464de72dd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:49.474504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6b1f2-beeb-46a3-88d7-30464de72dd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:49.487707 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6b1f2-beeb-46a3-88d7-30464de72dd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:49.489448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6b1f2-beeb-46a3-88d7-30464de72dd5 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:49.499435 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 940/1875] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:26:49.574309 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-811e9ac4-a933-49ec-9bd0-d29714bdcc86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89363d96771349288eefae5a7ddcb413'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:49.647654 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-811e9ac4-a933-49ec-9bd0-d29714bdcc86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89363d96771349288eefae5a7ddcb413'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:49.655651 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-811e9ac4-a933-49ec-9bd0-d29714bdcc86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89363d96771349288eefae5a7ddcb413'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:49.656317 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-811e9ac4-a933-49ec-9bd0-d29714bdcc86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89363d96771349288eefae5a7ddcb413'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:49.662185 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-811e9ac4-a933-49ec-9bd0-d29714bdcc86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89363d96771349288eefae5a7ddcb413'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:49.676885 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 936/1876] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:26:49 2022] DELETE /identity/v3/users/89363d96771349288eefae5a7ddcb413 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:26:49.681796 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db5702-5c15-4102-b075-be533d384b66 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:49.682376 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db5702-5c15-4102-b075-be533d384b66 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:49.682837 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db5702-5c15-4102-b075-be533d384b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:49.684182 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:49.702017 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-19db5702-5c15-4102-b075-be533d384b66 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:49.703342 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-19db5702-5c15-4102-b075-be533d384b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:49.778876 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 941/1877] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:49.790368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e9ac4-a933-49ec-9bd0-d29714bdcc86 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:49.792153 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-811e9ac4-a933-49ec-9bd0-d29714bdcc86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:49.854568 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:49.869510 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e9ac4-a933-49ec-9bd0-d29714bdcc86 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:49.873620 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3def0f-7c68-4ead-9636-54ace52bacf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:49.874541 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3def0f-7c68-4ead-9636-54ace52bacf7 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:49.874990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3def0f-7c68-4ead-9636-54ace52bacf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:49.875181 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3def0f-7c68-4ead-9636-54ace52bacf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:49.886337 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3def0f-7c68-4ead-9636-54ace52bacf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:49.888077 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3def0f-7c68-4ead-9636-54ace52bacf7 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:49.901710 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 937/1878] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:26:50.185138 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db5702-5c15-4102-b075-be533d384b66 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:50.185138 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-19db5702-5c15-4102-b075-be533d384b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:50.191360 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db5702-5c15-4102-b075-be533d384b66 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:50.196879 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a01c19-5684-453e-8138-c2c0eb1f4366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:50.197817 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a01c19-5684-453e-8138-c2c0eb1f4366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:50.198102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a01c19-5684-453e-8138-c2c0eb1f4366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:50.198373 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a01c19-5684-453e-8138-c2c0eb1f4366 admin admin] PATH_INFO: `/v3/projects/a280f2e6017e4cc7b141a0c92a80c303` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:50.199556 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a01c19-5684-453e-8138-c2c0eb1f4366 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a280f2e6017e4cc7b141a0c92a80c303)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:50.202627 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a01c19-5684-453e-8138-c2c0eb1f4366 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:50.320407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-40a01c19-5684-453e-8138-c2c0eb1f4366 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a280f2e6017e4cc7b141a0c92a80c303', 'request_id': 'req-40a01c19-5684-453e-8138-c2c0eb1f4366'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:50.326554 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-40a01c19-5684-453e-8138-c2c0eb1f4366 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a280f2e6017e4cc7b141a0c92a80c303', 'request_id': 'req-40a01c19-5684-453e-8138-c2c0eb1f4366'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:50.385229 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-40a01c19-5684-453e-8138-c2c0eb1f4366 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a280f2e6017e4cc7b141a0c92a80c303', 'request_id': 'req-40a01c19-5684-453e-8138-c2c0eb1f4366'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:50.398748 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-40a01c19-5684-453e-8138-c2c0eb1f4366 admin admin] The token cache is being invalidate because project a280f2e6017e4cc7b141a0c92a80c303 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:26:50.399123 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-40a01c19-5684-453e-8138-c2c0eb1f4366 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:50.399819 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-40a01c19-5684-453e-8138-c2c0eb1f4366 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:50.401399 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 942/1879] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:26:50 2022] DELETE /identity/v3/projects/a280f2e6017e4cc7b141a0c92a80c303 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:50.405524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3def0f-7c68-4ead-9636-54ace52bacf7 service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:50.415339 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3def0f-7c68-4ead-9636-54ace52bacf7 service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:50.472190 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d6674-8d17-4ca5-86d1-5a62889040c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:50.473123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d6674-8d17-4ca5-86d1-5a62889040c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:50.473411 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d6674-8d17-4ca5-86d1-5a62889040c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:50.473793 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d6674-8d17-4ca5-86d1-5a62889040c6 admin admin] PATH_INFO: `/v3/users/dc7eb81f090e432481be2e7b286e97eb` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:50.475028 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d6674-8d17-4ca5-86d1-5a62889040c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc7eb81f090e432481be2e7b286e97eb)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:50.477087 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d6674-8d17-4ca5-86d1-5a62889040c6 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:50.502084 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a01c19-5684-453e-8138-c2c0eb1f4366 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:50.504628 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-40a01c19-5684-453e-8138-c2c0eb1f4366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:50.519008 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a01c19-5684-453e-8138-c2c0eb1f4366 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:50.524629 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d6f78-deea-4c6c-aa0d-6bbbb32a8464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:50.526019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d6f78-deea-4c6c-aa0d-6bbbb32a8464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:50.526605 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d6f78-deea-4c6c-aa0d-6bbbb32a8464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:50.527085 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d6f78-deea-4c6c-aa0d-6bbbb32a8464 admin admin] PATH_INFO: `/v3/projects/99d1a147a20a4152a6807000d9d237d4` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:50.528508 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d6f78-deea-4c6c-aa0d-6bbbb32a8464 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99d1a147a20a4152a6807000d9d237d4)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:50.530670 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d6f78-deea-4c6c-aa0d-6bbbb32a8464 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:50.798109 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-1a9d6674-8d17-4ca5-86d1-5a62889040c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc7eb81f090e432481be2e7b286e97eb'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:50.813306 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-280d6f78-deea-4c6c-aa0d-6bbbb32a8464 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99d1a147a20a4152a6807000d9d237d4', 'request_id': 'req-280d6f78-deea-4c6c-aa0d-6bbbb32a8464'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:50.820533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-280d6f78-deea-4c6c-aa0d-6bbbb32a8464 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99d1a147a20a4152a6807000d9d237d4', 'request_id': 'req-280d6f78-deea-4c6c-aa0d-6bbbb32a8464'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:50.915758 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-1a9d6674-8d17-4ca5-86d1-5a62889040c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc7eb81f090e432481be2e7b286e97eb'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:50.923993 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-1a9d6674-8d17-4ca5-86d1-5a62889040c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc7eb81f090e432481be2e7b286e97eb'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:50.924974 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-1a9d6674-8d17-4ca5-86d1-5a62889040c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc7eb81f090e432481be2e7b286e97eb'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:50.925386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-1a9d6674-8d17-4ca5-86d1-5a62889040c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc7eb81f090e432481be2e7b286e97eb'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:50.943495 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 938/1880] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:26:50 2022] DELETE /identity/v3/users/dc7eb81f090e432481be2e7b286e97eb => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:51.002393 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-280d6f78-deea-4c6c-aa0d-6bbbb32a8464 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99d1a147a20a4152a6807000d9d237d4', 'request_id': 'req-280d6f78-deea-4c6c-aa0d-6bbbb32a8464'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:51.014664 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-280d6f78-deea-4c6c-aa0d-6bbbb32a8464 admin admin] The token cache is being invalidate because project 99d1a147a20a4152a6807000d9d237d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:26:51.015405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-280d6f78-deea-4c6c-aa0d-6bbbb32a8464 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:51.017880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-280d6f78-deea-4c6c-aa0d-6bbbb32a8464 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:51.022732 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 943/1881] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:26:50 2022] DELETE /identity/v3/projects/99d1a147a20a4152a6807000d9d237d4 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:51.023984 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d6674-8d17-4ca5-86d1-5a62889040c6 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:51.025407 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-1a9d6674-8d17-4ca5-86d1-5a62889040c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:51.105166 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d6674-8d17-4ca5-86d1-5a62889040c6 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:51.110032 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb82f34-acec-41c0-935e-81d6ccb6a862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:51.111024 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb82f34-acec-41c0-935e-81d6ccb6a862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:51.111411 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb82f34-acec-41c0-935e-81d6ccb6a862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:51.111789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb82f34-acec-41c0-935e-81d6ccb6a862 admin admin] PATH_INFO: `/v3/users/12ea4fcb20bd4c68a7664f1bbde427ff` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:51.113162 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb82f34-acec-41c0-935e-81d6ccb6a862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12ea4fcb20bd4c68a7664f1bbde427ff)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:51.115688 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb82f34-acec-41c0-935e-81d6ccb6a862 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:51.417621 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-4cb82f34-acec-41c0-935e-81d6ccb6a862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12ea4fcb20bd4c68a7664f1bbde427ff'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:51.502007 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d6f78-deea-4c6c-aa0d-6bbbb32a8464 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:51.503820 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-280d6f78-deea-4c6c-aa0d-6bbbb32a8464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:51.562109 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-4cb82f34-acec-41c0-935e-81d6ccb6a862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12ea4fcb20bd4c68a7664f1bbde427ff'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:51.571558 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-4cb82f34-acec-41c0-935e-81d6ccb6a862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12ea4fcb20bd4c68a7664f1bbde427ff'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:51.572766 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-4cb82f34-acec-41c0-935e-81d6ccb6a862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12ea4fcb20bd4c68a7664f1bbde427ff'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:51.573406 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-4cb82f34-acec-41c0-935e-81d6ccb6a862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12ea4fcb20bd4c68a7664f1bbde427ff'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:51.576021 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d6f78-deea-4c6c-aa0d-6bbbb32a8464 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:51.583195 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086a82a-8634-4404-b19c-30f5431b48e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:51.584974 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086a82a-8634-4404-b19c-30f5431b48e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:51.585458 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086a82a-8634-4404-b19c-30f5431b48e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:51.586202 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086a82a-8634-4404-b19c-30f5431b48e3 admin admin] PATH_INFO: `/v3/projects/ae527db0454e4152a657c3a82b5fbc55` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:51.587868 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086a82a-8634-4404-b19c-30f5431b48e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae527db0454e4152a657c3a82b5fbc55)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:51.591242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086a82a-8634-4404-b19c-30f5431b48e3 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:51.593572 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 939/1882] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:26:51 2022] DELETE /identity/v3/users/12ea4fcb20bd4c68a7664f1bbde427ff => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:51.739647 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3086a82a-8634-4404-b19c-30f5431b48e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae527db0454e4152a657c3a82b5fbc55', 'request_id': 'req-3086a82a-8634-4404-b19c-30f5431b48e3'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:51.749422 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3086a82a-8634-4404-b19c-30f5431b48e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae527db0454e4152a657c3a82b5fbc55', 'request_id': 'req-3086a82a-8634-4404-b19c-30f5431b48e3'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:51.916351 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3086a82a-8634-4404-b19c-30f5431b48e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae527db0454e4152a657c3a82b5fbc55', 'request_id': 'req-3086a82a-8634-4404-b19c-30f5431b48e3'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:51.942052 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3086a82a-8634-4404-b19c-30f5431b48e3 admin admin] The token cache is being invalidate because project ae527db0454e4152a657c3a82b5fbc55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:26:51.942378 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3086a82a-8634-4404-b19c-30f5431b48e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:51.943057 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3086a82a-8634-4404-b19c-30f5431b48e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:51.945547 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 944/1883] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:26:51 2022] DELETE /identity/v3/projects/ae527db0454e4152a657c3a82b5fbc55 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:51.952224 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423695c-f640-4713-8ff4-cf76f81521fe None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:51.953513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423695c-f640-4713-8ff4-cf76f81521fe None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:51.954352 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423695c-f640-4713-8ff4-cf76f81521fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:51.997671 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-d423695c-f640-4713-8ff4-cf76f81521fe None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:51.997671 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-d423695c-f640-4713-8ff4-cf76f81521fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:52.054503 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:52.103898 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 940/1884] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:52.111624 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78aca83-0385-4838-80db-5bea954bca6e None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:52.111940 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78aca83-0385-4838-80db-5bea954bca6e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:52.112219 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78aca83-0385-4838-80db-5bea954bca6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:52.139503 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-e78aca83-0385-4838-80db-5bea954bca6e None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:52.140730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e78aca83-0385-4838-80db-5bea954bca6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:52.150417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 945/1885] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:52.154988 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423695c-f640-4713-8ff4-cf76f81521fe None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:52.166301 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423695c-f640-4713-8ff4-cf76f81521fe None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:52.171160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e529a2-53b0-4526-a834-2a5b7de63568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:52.171858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e529a2-53b0-4526-a834-2a5b7de63568 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:52.172151 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e529a2-53b0-4526-a834-2a5b7de63568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:52.172435 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e529a2-53b0-4526-a834-2a5b7de63568 admin admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:52.173181 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e529a2-53b0-4526-a834-2a5b7de63568 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:26:52.173498 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e529a2-53b0-4526-a834-2a5b7de63568 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:52.175162 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e529a2-53b0-4526-a834-2a5b7de63568 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:52.195083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 941/1886] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:26:52.205199 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78aca83-0385-4838-80db-5bea954bca6e None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:52.205199 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78aca83-0385-4838-80db-5bea954bca6e None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:52.210832 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97be45-502f-4d4e-82b6-cfb8ba20b457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:52.211503 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97be45-502f-4d4e-82b6-cfb8ba20b457 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:52.211952 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97be45-502f-4d4e-82b6-cfb8ba20b457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:52.212194 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97be45-502f-4d4e-82b6-cfb8ba20b457 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:52.212898 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97be45-502f-4d4e-82b6-cfb8ba20b457 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:52.215018 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97be45-502f-4d4e-82b6-cfb8ba20b457 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:52.248059 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:52.335608 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 946/1887] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:26:52 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:26:52.339833 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e529a2-53b0-4526-a834-2a5b7de63568 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:52.351849 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e529a2-53b0-4526-a834-2a5b7de63568 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:52.354789 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97be45-502f-4d4e-82b6-cfb8ba20b457 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:52.356845 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7c97be45-502f-4d4e-82b6-cfb8ba20b457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:52.436621 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc10a78-95bc-4d3d-bb85-4b71c3fe7db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:52.437566 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc10a78-95bc-4d3d-bb85-4b71c3fe7db1 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:52.438198 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc10a78-95bc-4d3d-bb85-4b71c3fe7db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:52.438809 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc10a78-95bc-4d3d-bb85-4b71c3fe7db1 admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:52.439665 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc10a78-95bc-4d3d-bb85-4b71c3fe7db1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:52.440328 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97be45-502f-4d4e-82b6-cfb8ba20b457 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:52.442885 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc10a78-95bc-4d3d-bb85-4b71c3fe7db1 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:52.446282 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816946a-182a-49ca-b5b9-cb1e047fc4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:52.447179 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816946a-182a-49ca-b5b9-cb1e047fc4e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:52.447460 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816946a-182a-49ca-b5b9-cb1e047fc4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:52.447737 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816946a-182a-49ca-b5b9-cb1e047fc4e6 admin admin] PATH_INFO: `/v3/projects/5deb18710a974b01a27336ff2d782cf2` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:52.449082 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816946a-182a-49ca-b5b9-cb1e047fc4e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5deb18710a974b01a27336ff2d782cf2)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:52.451023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816946a-182a-49ca-b5b9-cb1e047fc4e6 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:52.511690 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 942/1888] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:26:52 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:26:52.515690 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc10a78-95bc-4d3d-bb85-4b71c3fe7db1 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:52.526671 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc10a78-95bc-4d3d-bb85-4b71c3fe7db1 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:52.531271 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e1fd2-d909-4675-a446-c58a3889bc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:52.531985 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e1fd2-d909-4675-a446-c58a3889bc6d admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:52.532271 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e1fd2-d909-4675-a446-c58a3889bc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:52.532551 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e1fd2-d909-4675-a446-c58a3889bc6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:52.533281 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e1fd2-d909-4675-a446-c58a3889bc6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:52.534983 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e1fd2-d909-4675-a446-c58a3889bc6d admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:52.545578 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 943/1889] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:26:52.549489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e1fd2-d909-4675-a446-c58a3889bc6d admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:52.559452 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e1fd2-d909-4675-a446-c58a3889bc6d admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:52.564585 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c507b-36e1-4240-8f3f-c23e86c08fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:52.565465 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c507b-36e1-4240-8f3f-c23e86c08fcd admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:52.565757 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c507b-36e1-4240-8f3f-c23e86c08fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:52.567269 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c507b-36e1-4240-8f3f-c23e86c08fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:52.568175 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c507b-36e1-4240-8f3f-c23e86c08fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:52.569812 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c507b-36e1-4240-8f3f-c23e86c08fcd admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:52.585999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 944/1890] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:26:52.587155 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c507b-36e1-4240-8f3f-c23e86c08fcd admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:52.588786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1816946a-182a-49ca-b5b9-cb1e047fc4e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5deb18710a974b01a27336ff2d782cf2', 'request_id': 'req-1816946a-182a-49ca-b5b9-cb1e047fc4e6'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:52.597371 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1816946a-182a-49ca-b5b9-cb1e047fc4e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5deb18710a974b01a27336ff2d782cf2', 'request_id': 'req-1816946a-182a-49ca-b5b9-cb1e047fc4e6'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:52.599158 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c507b-36e1-4240-8f3f-c23e86c08fcd admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:52.671376 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc821f-7354-438a-90de-8238bd2726a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:52.672935 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc821f-7354-438a-90de-8238bd2726a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:52.673227 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc821f-7354-438a-90de-8238bd2726a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:52.673514 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc821f-7354-438a-90de-8238bd2726a2 admin admin] PATH_INFO: `/v3/projects/a6fbee4bd87c4c008d6907e8b5e32dc9/users/6faa33d39cc44e9cb2a3e26bd5eebde6/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:52.690248 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc821f-7354-438a-90de-8238bd2726a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6fbee4bd87c4c008d6907e8b5e32dc9, user_id=6faa33d39cc44e9cb2a3e26bd5eebde6, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:52.693628 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc821f-7354-438a-90de-8238bd2726a2 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:52.710887 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1816946a-182a-49ca-b5b9-cb1e047fc4e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5deb18710a974b01a27336ff2d782cf2', 'request_id': 'req-1816946a-182a-49ca-b5b9-cb1e047fc4e6'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:52.725872 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1816946a-182a-49ca-b5b9-cb1e047fc4e6 admin admin] The token cache is being invalidate because project 5deb18710a974b01a27336ff2d782cf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:26:52.726329 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1816946a-182a-49ca-b5b9-cb1e047fc4e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:52.727600 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1816946a-182a-49ca-b5b9-cb1e047fc4e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:52.729787 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 947/1891] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:26:52 2022] DELETE /identity/v3/projects/5deb18710a974b01a27336ff2d782cf2 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:26:52.734513 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4a996-b520-46aa-b623-fdfbc7fd8387 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:52.734945 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4a996-b520-46aa-b623-fdfbc7fd8387 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:52.735367 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4a996-b520-46aa-b623-fdfbc7fd8387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:52.776252 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-13a4a996-b520-46aa-b623-fdfbc7fd8387 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:52.777893 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-13a4a996-b520-46aa-b623-fdfbc7fd8387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:52.786303 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 948/1892] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:52.795097 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc7a08-5c6e-47f2-bd41-e4d1e7510371 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:52.795388 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc7a08-5c6e-47f2-bd41-e4d1e7510371 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:52.795667 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc7a08-5c6e-47f2-bd41-e4d1e7510371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:52.813820 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-39bc7a08-5c6e-47f2-bd41-e4d1e7510371 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:52.814207 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 945/1893] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:26:52 2022] PUT /identity/v3/projects/a6fbee4bd87c4c008d6907e8b5e32dc9/users/6faa33d39cc44e9cb2a3e26bd5eebde6/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:26:52.815182 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-39bc7a08-5c6e-47f2-bd41-e4d1e7510371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:52.826472 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f6270-3ca1-40ed-9c08-3cd7d48a95f1 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:52.826839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f6270-3ca1-40ed-9c08-3cd7d48a95f1 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:52.827188 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f6270-3ca1-40ed-9c08-3cd7d48a95f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:52.854608 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-0e0f6270-3ca1-40ed-9c08-3cd7d48a95f1 None None] MFA Rules not processed for user `6faa33d39cc44e9cb2a3e26bd5eebde6`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:52.855838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-0e0f6270-3ca1-40ed-9c08-3cd7d48a95f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:52.879417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 949/1894] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:26:52.883866 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc7a08-5c6e-47f2-bd41-e4d1e7510371 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:52.892934 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc7a08-5c6e-47f2-bd41-e4d1e7510371 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:52.898903 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9853d5-72ee-4712-a40d-0fa129c36849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:52.899871 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9853d5-72ee-4712-a40d-0fa129c36849 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:52.900052 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9853d5-72ee-4712-a40d-0fa129c36849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:52.900329 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9853d5-72ee-4712-a40d-0fa129c36849 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:52.903039 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9853d5-72ee-4712-a40d-0fa129c36849 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:26:52.903039 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9853d5-72ee-4712-a40d-0fa129c36849 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:52.903207 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9853d5-72ee-4712-a40d-0fa129c36849 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:52.916543 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 950/1895] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:26:52.921170 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9853d5-72ee-4712-a40d-0fa129c36849 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:52.929823 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 946/1896] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:26:52.934691 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f6270-3ca1-40ed-9c08-3cd7d48a95f1 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:52.936232 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-0e0f6270-3ca1-40ed-9c08-3cd7d48a95f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:52.951480 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9853d5-72ee-4712-a40d-0fa129c36849 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:52.952328 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f6270-3ca1-40ed-9c08-3cd7d48a95f1 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:52.957553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30d443-c2fd-4b38-b446-f095ad3cc980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:52.957754 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9996d-ed6b-4fc2-be3c-302d62177ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:52.958655 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30d443-c2fd-4b38-b446-f095ad3cc980 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:52.958778 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9996d-ed6b-4fc2-be3c-302d62177ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:52.958977 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9996d-ed6b-4fc2-be3c-302d62177ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:52.959081 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30d443-c2fd-4b38-b446-f095ad3cc980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:52.965992 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9996d-ed6b-4fc2-be3c-302d62177ff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:52.966291 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30d443-c2fd-4b38-b446-f095ad3cc980 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:52.966380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9996d-ed6b-4fc2-be3c-302d62177ff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:52.966480 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30d443-c2fd-4b38-b446-f095ad3cc980 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:52.966566 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9996d-ed6b-4fc2-be3c-302d62177ff4 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:52.966646 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30d443-c2fd-4b38-b446-f095ad3cc980 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:53.061176 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 947/1897] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:26:52 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:53.064793 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 951/1898] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:26:52 2022] POST /identity/v3/projects => generated 381 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:53.065975 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30d443-c2fd-4b38-b446-f095ad3cc980 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:53.066196 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9996d-ed6b-4fc2-be3c-302d62177ff4 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:53.146951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9996d-ed6b-4fc2-be3c-302d62177ff4 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:53.148252 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30d443-c2fd-4b38-b446-f095ad3cc980 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:53.152587 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ecac2-8238-4c72-be97-d9cd07328305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:53.153428 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ecac2-8238-4c72-be97-d9cd07328305 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:53.153873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ecac2-8238-4c72-be97-d9cd07328305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:53.154157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ecac2-8238-4c72-be97-d9cd07328305 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:53.154872 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ecac2-8238-4c72-be97-d9cd07328305 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:53.155755 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98362ff5-e930-4c61-8335-4ceadfc68fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:53.156568 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98362ff5-e930-4c61-8335-4ceadfc68fbc admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:53.157100 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98362ff5-e930-4c61-8335-4ceadfc68fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:53.157351 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98362ff5-e930-4c61-8335-4ceadfc68fbc admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:53.157466 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ecac2-8238-4c72-be97-d9cd07328305 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:53.158203 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98362ff5-e930-4c61-8335-4ceadfc68fbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:53.161011 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98362ff5-e930-4c61-8335-4ceadfc68fbc admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:53.309280 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 952/1899] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:26:53 2022] POST /identity/v3/users => generated 291 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:53.313558 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 948/1900] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:26:53 2022] POST /identity/v3/users => generated 298 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:53.313698 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ecac2-8238-4c72-be97-d9cd07328305 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:53.315063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98362ff5-e930-4c61-8335-4ceadfc68fbc admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:53.326833 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ecac2-8238-4c72-be97-d9cd07328305 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:53.333046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98362ff5-e930-4c61-8335-4ceadfc68fbc admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:53.333368 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a61b5-2734-4a30-8b33-aac8748d57f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:53.334184 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a61b5-2734-4a30-8b33-aac8748d57f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:53.334672 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a61b5-2734-4a30-8b33-aac8748d57f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:53.335021 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a61b5-2734-4a30-8b33-aac8748d57f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:53.335831 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a61b5-2734-4a30-8b33-aac8748d57f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:53.337632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a61b5-2734-4a30-8b33-aac8748d57f7 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:53.339043 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0f51f-9bc4-498c-804b-a95b3297181a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:53.340892 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0f51f-9bc4-498c-804b-a95b3297181a admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:53.341601 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0f51f-9bc4-498c-804b-a95b3297181a admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:53.341935 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0f51f-9bc4-498c-804b-a95b3297181a admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:53.342773 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0f51f-9bc4-498c-804b-a95b3297181a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:53.345067 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0f51f-9bc4-498c-804b-a95b3297181a admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:53.355243 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 953/1901] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:26:53.359175 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a61b5-2734-4a30-8b33-aac8748d57f7 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:53.362403 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 949/1902] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:26:53.367064 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0f51f-9bc4-498c-804b-a95b3297181a admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:53.370802 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a61b5-2734-4a30-8b33-aac8748d57f7 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:53.376412 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfc1c2-4edc-4bb3-a6ce-50673faaffe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:53.378663 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfc1c2-4edc-4bb3-a6ce-50673faaffe2 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:53.378663 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfc1c2-4edc-4bb3-a6ce-50673faaffe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:53.378663 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfc1c2-4edc-4bb3-a6ce-50673faaffe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:53.378663 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbfc1c2-4edc-4bb3-a6ce-50673faaffe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:53.379673 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0f51f-9bc4-498c-804b-a95b3297181a admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:53.380412 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbfc1c2-4edc-4bb3-a6ce-50673faaffe2 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:53.395324 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e70fa2-5480-4f81-bcbb-9276bc60a314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:53.395324 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e70fa2-5480-4f81-bcbb-9276bc60a314 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:53.395324 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e70fa2-5480-4f81-bcbb-9276bc60a314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:53.395324 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e70fa2-5480-4f81-bcbb-9276bc60a314 admin admin] PATH_INFO: `/v3/projects/8a5985b50aa4441eb109fc47b5df4a97/users/542128774bc24e3f9d197a416d9ca471/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:53.395677 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 954/1903] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:26:53.396286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfc1c2-4edc-4bb3-a6ce-50673faaffe2 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:53.405778 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e70fa2-5480-4f81-bcbb-9276bc60a314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a5985b50aa4441eb109fc47b5df4a97, user_id=542128774bc24e3f9d197a416d9ca471, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:53.407187 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfc1c2-4edc-4bb3-a6ce-50673faaffe2 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:53.408803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e70fa2-5480-4f81-bcbb-9276bc60a314 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:53.411348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f6784-4176-4285-8921-f60c2870f407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:53.412257 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f6784-4176-4285-8921-f60c2870f407 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:53.412549 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f6784-4176-4285-8921-f60c2870f407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:53.412831 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f6784-4176-4285-8921-f60c2870f407 admin admin] PATH_INFO: `/v3/projects/740bad1d062f44f8ac75cf913309614d/users/1456a9dac7c942fb9642dc84a5c9d193/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:53.428464 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f6784-4176-4285-8921-f60c2870f407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=740bad1d062f44f8ac75cf913309614d, user_id=1456a9dac7c942fb9642dc84a5c9d193, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:53.431382 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f6784-4176-4285-8921-f60c2870f407 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:53.534475 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 950/1904] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:26:53 2022] PUT /identity/v3/projects/8a5985b50aa4441eb109fc47b5df4a97/users/542128774bc24e3f9d197a416d9ca471/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:26:53.539218 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e70fa2-5480-4f81-bcbb-9276bc60a314 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:53.583982 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 955/1905] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:26:53 2022] PUT /identity/v3/projects/740bad1d062f44f8ac75cf913309614d/users/1456a9dac7c942fb9642dc84a5c9d193/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:53.601526 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b70ef-8f78-4ea6-b9aa-ffb5b53b7307 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:53.602098 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b70ef-8f78-4ea6-b9aa-ffb5b53b7307 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:53.602632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b70ef-8f78-4ea6-b9aa-ffb5b53b7307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:53.625738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e70fa2-5480-4f81-bcbb-9276bc60a314 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:53.636189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-512b70ef-8f78-4ea6-b9aa-ffb5b53b7307 None None] MFA Rules not processed for user `1456a9dac7c942fb9642dc84a5c9d193`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:53.637733 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-512b70ef-8f78-4ea6-b9aa-ffb5b53b7307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:53.721073 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b5877-dde4-4b6f-8abe-87e8b72f0f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:53.722058 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b5877-dde4-4b6f-8abe-87e8b72f0f21 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:53.722987 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b5877-dde4-4b6f-8abe-87e8b72f0f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:53.723294 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b5877-dde4-4b6f-8abe-87e8b72f0f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:53.724017 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b5877-dde4-4b6f-8abe-87e8b72f0f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:53.725055 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 956/1906] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:26:53.725614 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b5877-dde4-4b6f-8abe-87e8b72f0f21 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:53.730669 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b70ef-8f78-4ea6-b9aa-ffb5b53b7307 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:53.736884 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 951/1907] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:26:53.742106 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b70ef-8f78-4ea6-b9aa-ffb5b53b7307 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:53.744279 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b5877-dde4-4b6f-8abe-87e8b72f0f21 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:53.763566 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b5877-dde4-4b6f-8abe-87e8b72f0f21 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:53.767291 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3d78a-9867-4abc-b498-59ea06940c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:53.768836 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3d78a-9867-4abc-b498-59ea06940c5d admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:53.769606 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3d78a-9867-4abc-b498-59ea06940c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:53.770019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3d78a-9867-4abc-b498-59ea06940c5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:53.771570 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3d78a-9867-4abc-b498-59ea06940c5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:53.774953 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3d78a-9867-4abc-b498-59ea06940c5d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:53.780643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2e095-68f1-495c-9d58-ad5b273cd17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:53.781562 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2e095-68f1-495c-9d58-ad5b273cd17b admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:53.781881 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2e095-68f1-495c-9d58-ad5b273cd17b admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:53.782751 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2e095-68f1-495c-9d58-ad5b273cd17b admin admin] PATH_INFO: `/v3/projects/8a5985b50aa4441eb109fc47b5df4a97/users/542128774bc24e3f9d197a416d9ca471/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:53.789172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2e095-68f1-495c-9d58-ad5b273cd17b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a5985b50aa4441eb109fc47b5df4a97, user_id=542128774bc24e3f9d197a416d9ca471, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:53.791397 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2e095-68f1-495c-9d58-ad5b273cd17b admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:53.809722 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 952/1908] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:26:53 2022] PUT /identity/v3/projects/8a5985b50aa4441eb109fc47b5df4a97/users/542128774bc24e3f9d197a416d9ca471/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:26:53.820381 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a545f-dcc7-46c2-b253-445c7900f278 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:53.820381 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a545f-dcc7-46c2-b253-445c7900f278 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:53.820616 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a545f-dcc7-46c2-b253-445c7900f278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:53.852467 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-1a2a545f-dcc7-46c2-b253-445c7900f278 None None] MFA Rules not processed for user `542128774bc24e3f9d197a416d9ca471`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:53.853987 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-1a2a545f-dcc7-46c2-b253-445c7900f278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:53.878287 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:53.947729 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 953/1909] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:26:53.959569 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a545f-dcc7-46c2-b253-445c7900f278 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:53.961626 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-1a2a545f-dcc7-46c2-b253-445c7900f278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:53.972020 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 957/1910] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:26:53 2022] POST /identity/v3/projects => generated 381 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:26:53.976036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3d78a-9867-4abc-b498-59ea06940c5d admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:54.071901 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3d78a-9867-4abc-b498-59ea06940c5d admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:54.077052 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11bc5ac-9ae4-4171-bfd5-7426543b94a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:54.077756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bc5ac-9ae4-4171-bfd5-7426543b94a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:54.078099 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bc5ac-9ae4-4171-bfd5-7426543b94a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:54.078381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bc5ac-9ae4-4171-bfd5-7426543b94a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:54.079095 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11bc5ac-9ae4-4171-bfd5-7426543b94a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:54.081346 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11bc5ac-9ae4-4171-bfd5-7426543b94a7 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:54.081817 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a545f-dcc7-46c2-b253-445c7900f278 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:54.135058 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086f6cf-5213-45d1-b7d6-f6510e77a932 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:54.135711 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086f6cf-5213-45d1-b7d6-f6510e77a932 service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:54.135997 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086f6cf-5213-45d1-b7d6-f6510e77a932 service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:54.136272 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086f6cf-5213-45d1-b7d6-f6510e77a932 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:54.208595 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086f6cf-5213-45d1-b7d6-f6510e77a932 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:54.210073 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086f6cf-5213-45d1-b7d6-f6510e77a932 service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:54.220743 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 954/1911] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:26:54.245959 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 958/1912] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:26:53 2022] POST /identity/v3/users => generated 297 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:54.251151 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086f6cf-5213-45d1-b7d6-f6510e77a932 service cinder] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:54.263427 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086f6cf-5213-45d1-b7d6-f6510e77a932 service cinder] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:54.270416 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fbc67-eaad-43aa-a509-bbe7655c7635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:54.271265 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fbc67-eaad-43aa-a509-bbe7655c7635 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:54.271862 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fbc67-eaad-43aa-a509-bbe7655c7635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:54.272664 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fbc67-eaad-43aa-a509-bbe7655c7635 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:54.273452 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9fbc67-eaad-43aa-a509-bbe7655c7635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:54.275188 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9fbc67-eaad-43aa-a509-bbe7655c7635 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:54.299204 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 955/1913] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:26:54.304006 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11bc5ac-9ae4-4171-bfd5-7426543b94a7 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:54.315893 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11bc5ac-9ae4-4171-bfd5-7426543b94a7 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:54.321974 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad38e7-fb3f-46ff-ba86-4ba0fea05f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:54.322879 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad38e7-fb3f-46ff-ba86-4ba0fea05f8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:54.323169 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad38e7-fb3f-46ff-ba86-4ba0fea05f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:54.323447 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad38e7-fb3f-46ff-ba86-4ba0fea05f8e admin admin] PATH_INFO: `/v3/projects/172e4a89d9724201a4aba1b40e37a3fa/users/a4143abcbabd4609a9f330580b873277/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:54.345394 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad38e7-fb3f-46ff-ba86-4ba0fea05f8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=172e4a89d9724201a4aba1b40e37a3fa, user_id=a4143abcbabd4609a9f330580b873277, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:54.350218 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad38e7-fb3f-46ff-ba86-4ba0fea05f8e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:54.361067 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fbc67-eaad-43aa-a509-bbe7655c7635 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:54.371739 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fbc67-eaad-43aa-a509-bbe7655c7635 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:54.375386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2695a8b-6893-4967-beda-3078bf03a9ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:54.376027 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2695a8b-6893-4967-beda-3078bf03a9ba service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:54.376314 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2695a8b-6893-4967-beda-3078bf03a9ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:54.376594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2695a8b-6893-4967-beda-3078bf03a9ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:54.451100 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2695a8b-6893-4967-beda-3078bf03a9ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:54.452645 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2695a8b-6893-4967-beda-3078bf03a9ba service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:54.462870 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 956/1914] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:26:54.483652 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 959/1915] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:26:54 2022] PUT /identity/v3/projects/172e4a89d9724201a4aba1b40e37a3fa/users/a4143abcbabd4609a9f330580b873277/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:54.490395 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2695a8b-6893-4967-beda-3078bf03a9ba service cinder] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:54.504293 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2695a8b-6893-4967-beda-3078bf03a9ba service cinder] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:54.575166 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa96cc-7c18-4a06-811b-77cf54622d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:54.575846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa96cc-7c18-4a06-811b-77cf54622d62 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:54.576327 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa96cc-7c18-4a06-811b-77cf54622d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:54.576609 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa96cc-7c18-4a06-811b-77cf54622d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:54.577489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa96cc-7c18-4a06-811b-77cf54622d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:54.579264 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa96cc-7c18-4a06-811b-77cf54622d62 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:54.590156 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 957/1916] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:26:54.594568 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad38e7-fb3f-46ff-ba86-4ba0fea05f8e admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:54.611879 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad38e7-fb3f-46ff-ba86-4ba0fea05f8e admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:54.618086 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93fa9f-2dea-4b9f-8e6c-2b542df6f82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:54.618992 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93fa9f-2dea-4b9f-8e6c-2b542df6f82e admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:54.619306 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93fa9f-2dea-4b9f-8e6c-2b542df6f82e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:54.619587 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93fa9f-2dea-4b9f-8e6c-2b542df6f82e admin admin] PATH_INFO: `/v3/projects/172e4a89d9724201a4aba1b40e37a3fa/users/a4143abcbabd4609a9f330580b873277/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:54.621635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93fa9f-2dea-4b9f-8e6c-2b542df6f82e admin admin] RBAC: Authorizing `identity:create_grant(project_id=172e4a89d9724201a4aba1b40e37a3fa, user_id=a4143abcbabd4609a9f330580b873277, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:54.624314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93fa9f-2dea-4b9f-8e6c-2b542df6f82e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:54.635402 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 960/1917] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:26:54 2022] PUT /identity/v3/projects/172e4a89d9724201a4aba1b40e37a3fa/users/a4143abcbabd4609a9f330580b873277/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:54.646538 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dabf28-aec2-40d1-89cc-e1a273de1e99 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:54.646767 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dabf28-aec2-40d1-89cc-e1a273de1e99 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:54.647051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dabf28-aec2-40d1-89cc-e1a273de1e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:54.677505 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-73dabf28-aec2-40d1-89cc-e1a273de1e99 None None] MFA Rules not processed for user `a4143abcbabd4609a9f330580b873277`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:54.678752 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-73dabf28-aec2-40d1-89cc-e1a273de1e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:54.749186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 958/1918] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:54.793241 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93fa9f-2dea-4b9f-8e6c-2b542df6f82e admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:54.796043 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8b93fa9f-2dea-4b9f-8e6c-2b542df6f82e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:54.874433 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93fa9f-2dea-4b9f-8e6c-2b542df6f82e admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:54.878452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b4e2e-f801-4b57-9e70-40188a97d8ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:54.879162 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b4e2e-f801-4b57-9e70-40188a97d8ab service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:54.879449 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b4e2e-f801-4b57-9e70-40188a97d8ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:54.879724 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b4e2e-f801-4b57-9e70-40188a97d8ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:54.892741 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b4e2e-f801-4b57-9e70-40188a97d8ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:54.895060 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b4e2e-f801-4b57-9e70-40188a97d8ab service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:54.906792 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 961/1919] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:26:55.193630 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dabf28-aec2-40d1-89cc-e1a273de1e99 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:55.204361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dabf28-aec2-40d1-89cc-e1a273de1e99 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:55.210603 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d43d9-b37d-4640-ad16-4eed0ecc0716 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:55.211318 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d43d9-b37d-4640-ad16-4eed0ecc0716 service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:55.211604 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d43d9-b37d-4640-ad16-4eed0ecc0716 service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:55.212089 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d43d9-b37d-4640-ad16-4eed0ecc0716 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:55.285595 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d43d9-b37d-4640-ad16-4eed0ecc0716 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:55.288671 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d43d9-b37d-4640-ad16-4eed0ecc0716 service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:55.303675 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 959/1920] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:26:55.356420 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:55.705326 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:55.886656 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b4e2e-f801-4b57-9e70-40188a97d8ab service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:55.950191 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b4e2e-f801-4b57-9e70-40188a97d8ab service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:55.954736 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c611e-df2a-4f65-9d77-8f0a72425e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:55.955639 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c611e-df2a-4f65-9d77-8f0a72425e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:55.955891 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c611e-df2a-4f65-9d77-8f0a72425e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:55.956168 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c611e-df2a-4f65-9d77-8f0a72425e27 admin admin] PATH_INFO: `/v3/users/1456a9dac7c942fb9642dc84a5c9d193` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:55.957392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c611e-df2a-4f65-9d77-8f0a72425e27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1456a9dac7c942fb9642dc84a5c9d193)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:55.959321 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c611e-df2a-4f65-9d77-8f0a72425e27 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:56.207953 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-d79c611e-df2a-4f65-9d77-8f0a72425e27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1456a9dac7c942fb9642dc84a5c9d193'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:56.209970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-d79c611e-df2a-4f65-9d77-8f0a72425e27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1456a9dac7c942fb9642dc84a5c9d193'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:56.226259 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-d79c611e-df2a-4f65-9d77-8f0a72425e27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1456a9dac7c942fb9642dc84a5c9d193'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:56.304701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-d79c611e-df2a-4f65-9d77-8f0a72425e27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1456a9dac7c942fb9642dc84a5c9d193'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:56.319089 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-d79c611e-df2a-4f65-9d77-8f0a72425e27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1456a9dac7c942fb9642dc84a5c9d193'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:56.326304 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 962/1921] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:26:55 2022] DELETE /identity/v3/users/1456a9dac7c942fb9642dc84a5c9d193 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:56.330955 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022cd33-6c99-408e-90d0-10d2660a11fb None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:56.332139 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022cd33-6c99-408e-90d0-10d2660a11fb None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:56.332594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022cd33-6c99-408e-90d0-10d2660a11fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:56.351419 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-d022cd33-6c99-408e-90d0-10d2660a11fb None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:56.352627 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-d022cd33-6c99-408e-90d0-10d2660a11fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:56.418115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 960/1922] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:26:56.430888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c611e-df2a-4f65-9d77-8f0a72425e27 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:56.432624 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d79c611e-df2a-4f65-9d77-8f0a72425e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:56.541370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c611e-df2a-4f65-9d77-8f0a72425e27 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:56.545209 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57760855-57e5-437b-a56d-3618a9304606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:56.545979 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57760855-57e5-437b-a56d-3618a9304606 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:56.546338 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57760855-57e5-437b-a56d-3618a9304606 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:56.546677 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57760855-57e5-437b-a56d-3618a9304606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:56.558019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57760855-57e5-437b-a56d-3618a9304606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:56.559541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57760855-57e5-437b-a56d-3618a9304606 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:56.573875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 963/1923] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:26:57.193466 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022cd33-6c99-408e-90d0-10d2660a11fb None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:57.194934 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-d022cd33-6c99-408e-90d0-10d2660a11fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:57.208079 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022cd33-6c99-408e-90d0-10d2660a11fb None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:57.218465 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7cd19-e73f-4620-aad0-260bf91f8bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:57.219372 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7cd19-e73f-4620-aad0-260bf91f8bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:57.219657 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7cd19-e73f-4620-aad0-260bf91f8bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:57.219927 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7cd19-e73f-4620-aad0-260bf91f8bdd admin admin] PATH_INFO: `/v3/projects/740bad1d062f44f8ac75cf913309614d` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:57.221180 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7cd19-e73f-4620-aad0-260bf91f8bdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=740bad1d062f44f8ac75cf913309614d)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:57.223248 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7cd19-e73f-4620-aad0-260bf91f8bdd admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:57.380659 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-13a7cd19-e73f-4620-aad0-260bf91f8bdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '740bad1d062f44f8ac75cf913309614d', 'request_id': 'req-13a7cd19-e73f-4620-aad0-260bf91f8bdd'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:57.495205 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-13a7cd19-e73f-4620-aad0-260bf91f8bdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '740bad1d062f44f8ac75cf913309614d', 'request_id': 'req-13a7cd19-e73f-4620-aad0-260bf91f8bdd'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:57.506457 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-13a7cd19-e73f-4620-aad0-260bf91f8bdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '740bad1d062f44f8ac75cf913309614d', 'request_id': 'req-13a7cd19-e73f-4620-aad0-260bf91f8bdd'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:57.519813 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-13a7cd19-e73f-4620-aad0-260bf91f8bdd admin admin] The token cache is being invalidate because project 740bad1d062f44f8ac75cf913309614d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:26:57.519813 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-13a7cd19-e73f-4620-aad0-260bf91f8bdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:57.520442 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-13a7cd19-e73f-4620-aad0-260bf91f8bdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:57.522846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 961/1924] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:26:57 2022] DELETE /identity/v3/projects/740bad1d062f44f8ac75cf913309614d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:57.526536 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57760855-57e5-437b-a56d-3618a9304606 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:57.548779 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57760855-57e5-437b-a56d-3618a9304606 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:57.633778 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c62a0-6cd8-4982-8c35-59fda50b3b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:57.634682 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c62a0-6cd8-4982-8c35-59fda50b3b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:57.635120 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c62a0-6cd8-4982-8c35-59fda50b3b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:57.635544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c62a0-6cd8-4982-8c35-59fda50b3b69 admin admin] PATH_INFO: `/v3/users/a4143abcbabd4609a9f330580b873277` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:57.637036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c62a0-6cd8-4982-8c35-59fda50b3b69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4143abcbabd4609a9f330580b873277)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:57.638990 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c62a0-6cd8-4982-8c35-59fda50b3b69 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:57.856635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-979c62a0-6cd8-4982-8c35-59fda50b3b69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4143abcbabd4609a9f330580b873277'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:57.857297 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-979c62a0-6cd8-4982-8c35-59fda50b3b69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4143abcbabd4609a9f330580b873277'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:57.865297 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-979c62a0-6cd8-4982-8c35-59fda50b3b69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4143abcbabd4609a9f330580b873277'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:57.984642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-979c62a0-6cd8-4982-8c35-59fda50b3b69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4143abcbabd4609a9f330580b873277'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:57.997993 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-979c62a0-6cd8-4982-8c35-59fda50b3b69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4143abcbabd4609a9f330580b873277'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:58.003869 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 964/1925] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:26:57 2022] DELETE /identity/v3/users/a4143abcbabd4609a9f330580b873277 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:58.037679 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7cd19-e73f-4620-aad0-260bf91f8bdd admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:58.039182 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-13a7cd19-e73f-4620-aad0-260bf91f8bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:58.052496 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7cd19-e73f-4620-aad0-260bf91f8bdd admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:58.120854 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6bbe53-6da0-4b48-86f7-e3fe3e1b9bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:58.121977 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bbe53-6da0-4b48-86f7-e3fe3e1b9bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:58.122269 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bbe53-6da0-4b48-86f7-e3fe3e1b9bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:58.122555 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bbe53-6da0-4b48-86f7-e3fe3e1b9bee admin admin] PATH_INFO: `/v3/users/6faa33d39cc44e9cb2a3e26bd5eebde6` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:58.123807 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6bbe53-6da0-4b48-86f7-e3fe3e1b9bee admin admin] RBAC: Authorizing `identity:delete_user(user_id=6faa33d39cc44e9cb2a3e26bd5eebde6)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:58.125747 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6bbe53-6da0-4b48-86f7-e3fe3e1b9bee admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:58.369220 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ca6bbe53-6da0-4b48-86f7-e3fe3e1b9bee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6faa33d39cc44e9cb2a3e26bd5eebde6'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:58.453426 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ca6bbe53-6da0-4b48-86f7-e3fe3e1b9bee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6faa33d39cc44e9cb2a3e26bd5eebde6'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:58.467166 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ca6bbe53-6da0-4b48-86f7-e3fe3e1b9bee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6faa33d39cc44e9cb2a3e26bd5eebde6'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:58.468887 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ca6bbe53-6da0-4b48-86f7-e3fe3e1b9bee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6faa33d39cc44e9cb2a3e26bd5eebde6'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:58.469798 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ca6bbe53-6da0-4b48-86f7-e3fe3e1b9bee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6faa33d39cc44e9cb2a3e26bd5eebde6'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:58.489086 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:58.501544 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 962/1926] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:26:58 2022] DELETE /identity/v3/users/6faa33d39cc44e9cb2a3e26bd5eebde6 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:26:58.507341 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6bbe53-6da0-4b48-86f7-e3fe3e1b9bee admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:58.507513 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062c61d-cf9f-4b2f-b525-beb8b7782dcd None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:58.507799 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062c61d-cf9f-4b2f-b525-beb8b7782dcd None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:58.508691 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062c61d-cf9f-4b2f-b525-beb8b7782dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:58.509158 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-ca6bbe53-6da0-4b48-86f7-e3fe3e1b9bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:58.554133 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-7062c61d-cf9f-4b2f-b525-beb8b7782dcd None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:58.556029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7062c61d-cf9f-4b2f-b525-beb8b7782dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:58.622994 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6bbe53-6da0-4b48-86f7-e3fe3e1b9bee admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:58.633388 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edfacc-d425-4ab7-8267-6f317383745a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:58.634606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edfacc-d425-4ab7-8267-6f317383745a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:58.635468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edfacc-d425-4ab7-8267-6f317383745a admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:58.636070 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edfacc-d425-4ab7-8267-6f317383745a admin admin] PATH_INFO: `/v3/projects/172e4a89d9724201a4aba1b40e37a3fa` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:58.637653 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edfacc-d425-4ab7-8267-6f317383745a admin admin] RBAC: Authorizing `identity:delete_project(project_id=172e4a89d9724201a4aba1b40e37a3fa)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:58.640550 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edfacc-d425-4ab7-8267-6f317383745a admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:58.654751 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 965/1927] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:58.655743 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062c61d-cf9f-4b2f-b525-beb8b7782dcd None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:58.657173 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7062c61d-cf9f-4b2f-b525-beb8b7782dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:58.786260 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062c61d-cf9f-4b2f-b525-beb8b7782dcd None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:58.795892 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed768334-74f2-48fb-9136-ae9c7535e37a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:58.796840 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed768334-74f2-48fb-9136-ae9c7535e37a service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:58.797316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:58.797638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed768334-74f2-48fb-9136-ae9c7535e37a service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:58.798104 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed768334-74f2-48fb-9136-ae9c7535e37a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:58.815401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed768334-74f2-48fb-9136-ae9c7535e37a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:58.817178 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed768334-74f2-48fb-9136-ae9c7535e37a service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:58.865068 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 966/1928] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:26:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:26:58.865614 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-45edfacc-d425-4ab7-8267-6f317383745a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '172e4a89d9724201a4aba1b40e37a3fa', 'request_id': 'req-45edfacc-d425-4ab7-8267-6f317383745a'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:59.058717 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-45edfacc-d425-4ab7-8267-6f317383745a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '172e4a89d9724201a4aba1b40e37a3fa', 'request_id': 'req-45edfacc-d425-4ab7-8267-6f317383745a'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:59.066058 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-45edfacc-d425-4ab7-8267-6f317383745a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '172e4a89d9724201a4aba1b40e37a3fa', 'request_id': 'req-45edfacc-d425-4ab7-8267-6f317383745a'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:59.077510 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-45edfacc-d425-4ab7-8267-6f317383745a admin admin] The token cache is being invalidate because project 172e4a89d9724201a4aba1b40e37a3fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:26:59.077827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-45edfacc-d425-4ab7-8267-6f317383745a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:59.078525 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-45edfacc-d425-4ab7-8267-6f317383745a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:59.080401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 963/1929] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:26:58 2022] DELETE /identity/v3/projects/172e4a89d9724201a4aba1b40e37a3fa => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:26:59.085533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0bbc9-2cd3-4d87-b189-80e85a13da3f None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:59.085931 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0bbc9-2cd3-4d87-b189-80e85a13da3f None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:59.086235 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0bbc9-2cd3-4d87-b189-80e85a13da3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:59.108355 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-84f0bbc9-2cd3-4d87-b189-80e85a13da3f None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:59.109624 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-84f0bbc9-2cd3-4d87-b189-80e85a13da3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:59.205404 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 967/1930] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:59.214490 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e7e5e-8d01-4dbd-aa71-816dd6a4d18d None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:59.214959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e7e5e-8d01-4dbd-aa71-816dd6a4d18d None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:59.215431 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e7e5e-8d01-4dbd-aa71-816dd6a4d18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:59.242392 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-e92e7e5e-8d01-4dbd-aa71-816dd6a4d18d None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:26:59.245227 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-e92e7e5e-8d01-4dbd-aa71-816dd6a4d18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:59.257958 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 964/1931] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:26:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:26:59.259126 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0bbc9-2cd3-4d87-b189-80e85a13da3f None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:59.270489 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0bbc9-2cd3-4d87-b189-80e85a13da3f None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:59.284816 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484264a-1af9-468e-927c-07d05f542e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:59.285721 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484264a-1af9-468e-927c-07d05f542e68 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:59.286045 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484264a-1af9-468e-927c-07d05f542e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:59.286489 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484264a-1af9-468e-927c-07d05f542e68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:59.287136 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484264a-1af9-468e-927c-07d05f542e68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:26:59.287499 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484264a-1af9-468e-927c-07d05f542e68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:59.289135 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484264a-1af9-468e-927c-07d05f542e68 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:59.305550 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 968/1932] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:26:59.312684 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e7e5e-8d01-4dbd-aa71-816dd6a4d18d None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:59.346674 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e7e5e-8d01-4dbd-aa71-816dd6a4d18d None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:59.359603 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d9666-9b05-4d7c-af84-1a7f9d2f931d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:59.360584 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d9666-9b05-4d7c-af84-1a7f9d2f931d admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:59.361068 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d9666-9b05-4d7c-af84-1a7f9d2f931d admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:59.361526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d9666-9b05-4d7c-af84-1a7f9d2f931d admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:59.362553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d9666-9b05-4d7c-af84-1a7f9d2f931d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:59.364840 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d9666-9b05-4d7c-af84-1a7f9d2f931d admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:59.465365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484264a-1af9-468e-927c-07d05f542e68 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:59.467575 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-0484264a-1af9-468e-927c-07d05f542e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:59.524615 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484264a-1af9-468e-927c-07d05f542e68 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:59.527823 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 965/1933] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:26:59 2022] POST /identity/v3/projects => generated 373 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:59.532462 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d9666-9b05-4d7c-af84-1a7f9d2f931d admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:59.643940 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cb830-4c4b-41f0-9a45-7f597dc07b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:59.646756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cb830-4c4b-41f0-9a45-7f597dc07b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:59.648582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cb830-4c4b-41f0-9a45-7f597dc07b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:59.649029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cb830-4c4b-41f0-9a45-7f597dc07b0f admin admin] PATH_INFO: `/v3/projects/a6fbee4bd87c4c008d6907e8b5e32dc9` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:59.651044 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d9666-9b05-4d7c-af84-1a7f9d2f931d admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:59.656019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58cb830-4c4b-41f0-9a45-7f597dc07b0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6fbee4bd87c4c008d6907e8b5e32dc9)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:59.656019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58cb830-4c4b-41f0-9a45-7f597dc07b0f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:59.657146 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a6977-6cfe-48e7-825d-d6e0f63de540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:59.657930 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a6977-6cfe-48e7-825d-d6e0f63de540 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:59.658226 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a6977-6cfe-48e7-825d-d6e0f63de540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:59.658508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a6977-6cfe-48e7-825d-d6e0f63de540 admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:59.659214 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a6977-6cfe-48e7-825d-d6e0f63de540 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:59.661380 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a6977-6cfe-48e7-825d-d6e0f63de540 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:59.800224 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 966/1934] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:26:59 2022] POST /identity/v3/users => generated 287 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:26:59.803640 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a6977-6cfe-48e7-825d-d6e0f63de540 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:59.813226 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a58cb830-4c4b-41f0-9a45-7f597dc07b0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6fbee4bd87c4c008d6907e8b5e32dc9', 'request_id': 'req-a58cb830-4c4b-41f0-9a45-7f597dc07b0f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:59.814998 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a6977-6cfe-48e7-825d-d6e0f63de540 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:59.819974 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a58cb830-4c4b-41f0-9a45-7f597dc07b0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6fbee4bd87c4c008d6907e8b5e32dc9', 'request_id': 'req-a58cb830-4c4b-41f0-9a45-7f597dc07b0f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:59.903672 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9db765-a449-4767-b36a-ba9a58da3b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:59.905702 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9db765-a449-4767-b36a-ba9a58da3b72 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:59.906253 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9db765-a449-4767-b36a-ba9a58da3b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:59.907028 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9db765-a449-4767-b36a-ba9a58da3b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:59.908352 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9db765-a449-4767-b36a-ba9a58da3b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:59.913072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9db765-a449-4767-b36a-ba9a58da3b72 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:59.928249 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 967/1935] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:26:59.932384 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9db765-a449-4767-b36a-ba9a58da3b72 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:59.933654 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a58cb830-4c4b-41f0-9a45-7f597dc07b0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6fbee4bd87c4c008d6907e8b5e32dc9', 'request_id': 'req-a58cb830-4c4b-41f0-9a45-7f597dc07b0f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:59.947787 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9db765-a449-4767-b36a-ba9a58da3b72 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:59.948481 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a58cb830-4c4b-41f0-9a45-7f597dc07b0f admin admin] The token cache is being invalidate because project a6fbee4bd87c4c008d6907e8b5e32dc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:26:59.948986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a58cb830-4c4b-41f0-9a45-7f597dc07b0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:59.949697 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a58cb830-4c4b-41f0-9a45-7f597dc07b0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:26:59.951302 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 969/1936] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:26:59 2022] DELETE /identity/v3/projects/a6fbee4bd87c4c008d6907e8b5e32dc9 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:26:59.955367 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cb830-4c4b-41f0-9a45-7f597dc07b0f admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:59.956256 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b10d5a-babd-4953-abcd-7a18a7dc1157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:59.956712 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a58cb830-4c4b-41f0-9a45-7f597dc07b0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:26:59.956944 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b10d5a-babd-4953-abcd-7a18a7dc1157 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:59.957272 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b10d5a-babd-4953-abcd-7a18a7dc1157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:59.957558 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b10d5a-babd-4953-abcd-7a18a7dc1157 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:59.959498 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b10d5a-babd-4953-abcd-7a18a7dc1157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:59.961151 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b10d5a-babd-4953-abcd-7a18a7dc1157 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:59.969335 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cb830-4c4b-41f0-9a45-7f597dc07b0f admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:26:59.972207 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 968/1937] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:26:59.977396 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5770e-c84f-425b-8912-9e2048bf0d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:26:59.978399 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5770e-c84f-425b-8912-9e2048bf0d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:26:59.978685 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5770e-c84f-425b-8912-9e2048bf0d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:26:59.978967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5770e-c84f-425b-8912-9e2048bf0d15 admin admin] PATH_INFO: `/v3/users/542128774bc24e3f9d197a416d9ca471` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:26:59.980217 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5770e-c84f-425b-8912-9e2048bf0d15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=542128774bc24e3f9d197a416d9ca471)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:26:59.981917 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b10d5a-babd-4953-abcd-7a18a7dc1157 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:26:59.982167 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5770e-c84f-425b-8912-9e2048bf0d15 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:26:59.983786 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-c2b10d5a-babd-4953-abcd-7a18a7dc1157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:00.005713 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b10d5a-babd-4953-abcd-7a18a7dc1157 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:00.012250 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77634e0-80d9-4fa0-8f1d-a2bf720d5a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:00.013177 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77634e0-80d9-4fa0-8f1d-a2bf720d5a59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:00.013466 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77634e0-80d9-4fa0-8f1d-a2bf720d5a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:00.013789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77634e0-80d9-4fa0-8f1d-a2bf720d5a59 admin admin] PATH_INFO: `/v3/projects/4830b8c5376341eda5202c6b1e66c7a1/users/b6454da0eba2404ab599b3c80c06b8dc/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:00.030019 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77634e0-80d9-4fa0-8f1d-a2bf720d5a59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4830b8c5376341eda5202c6b1e66c7a1, user_id=b6454da0eba2404ab599b3c80c06b8dc, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:00.032784 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77634e0-80d9-4fa0-8f1d-a2bf720d5a59 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:00.125407 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 969/1938] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:26:59 2022] PUT /identity/v3/projects/4830b8c5376341eda5202c6b1e66c7a1/users/b6454da0eba2404ab599b3c80c06b8dc/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:00.130534 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152269b-e388-4071-83d0-eb180da764ae None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:00.130829 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152269b-e388-4071-83d0-eb180da764ae None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:00.131169 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152269b-e388-4071-83d0-eb180da764ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:00.148697 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-4152269b-e388-4071-83d0-eb180da764ae None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:00.149980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-4152269b-e388-4071-83d0-eb180da764ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:00.209624 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 970/1939] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:27:00.219374 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152269b-e388-4071-83d0-eb180da764ae None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:00.220759 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-4152269b-e388-4071-83d0-eb180da764ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:00.251875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b9b5770e-c84f-425b-8912-9e2048bf0d15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '542128774bc24e3f9d197a416d9ca471'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:00.252755 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b9b5770e-c84f-425b-8912-9e2048bf0d15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '542128774bc24e3f9d197a416d9ca471'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:00.262614 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b9b5770e-c84f-425b-8912-9e2048bf0d15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '542128774bc24e3f9d197a416d9ca471'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:00.296383 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152269b-e388-4071-83d0-eb180da764ae None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:00.300268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bc2f9-9451-44bb-9e6e-de69191bee45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:00.300974 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bc2f9-9451-44bb-9e6e-de69191bee45 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:00.302172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bc2f9-9451-44bb-9e6e-de69191bee45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:00.302487 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bc2f9-9451-44bb-9e6e-de69191bee45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:00.314385 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254bc2f9-9451-44bb-9e6e-de69191bee45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:00.316909 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254bc2f9-9451-44bb-9e6e-de69191bee45 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:00.328991 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 971/1940] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:27:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:27:00.334593 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b9b5770e-c84f-425b-8912-9e2048bf0d15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '542128774bc24e3f9d197a416d9ca471'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:00.360342 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b9b5770e-c84f-425b-8912-9e2048bf0d15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '542128774bc24e3f9d197a416d9ca471'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:00.368735 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 970/1941] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:26:59 2022] DELETE /identity/v3/users/542128774bc24e3f9d197a416d9ca471 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:01.328179 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bc2f9-9451-44bb-9e6e-de69191bee45 service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:01.339128 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bc2f9-9451-44bb-9e6e-de69191bee45 service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:01.433511 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5770e-c84f-425b-8912-9e2048bf0d15 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:01.437432 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b9b5770e-c84f-425b-8912-9e2048bf0d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:01.456111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbbe73-f3e3-4e5e-b871-59d0c2ea6862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:01.456998 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbbe73-f3e3-4e5e-b871-59d0c2ea6862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:01.457326 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbbe73-f3e3-4e5e-b871-59d0c2ea6862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:01.457628 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbbe73-f3e3-4e5e-b871-59d0c2ea6862 admin admin] PATH_INFO: `/v3/projects/8a5985b50aa4441eb109fc47b5df4a97` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:01.458952 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbbe73-f3e3-4e5e-b871-59d0c2ea6862 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a5985b50aa4441eb109fc47b5df4a97)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:01.461859 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbbe73-f3e3-4e5e-b871-59d0c2ea6862 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:01.569478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5770e-c84f-425b-8912-9e2048bf0d15 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:01.575455 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48336889-96c5-4a99-a79f-7479283fc2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:01.576350 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48336889-96c5-4a99-a79f-7479283fc2df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:01.576835 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48336889-96c5-4a99-a79f-7479283fc2df admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:01.577117 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48336889-96c5-4a99-a79f-7479283fc2df admin admin] PATH_INFO: `/v3/users/611ba4ccbad94447ba2f6cbfae96b59c` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:01.578375 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48336889-96c5-4a99-a79f-7479283fc2df admin admin] RBAC: Authorizing `identity:delete_user(user_id=611ba4ccbad94447ba2f6cbfae96b59c)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:01.580336 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48336889-96c5-4a99-a79f-7479283fc2df admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:01.617281 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6dbbbe73-f3e3-4e5e-b871-59d0c2ea6862 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a5985b50aa4441eb109fc47b5df4a97', 'request_id': 'req-6dbbbe73-f3e3-4e5e-b871-59d0c2ea6862'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:01.733795 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6dbbbe73-f3e3-4e5e-b871-59d0c2ea6862 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a5985b50aa4441eb109fc47b5df4a97', 'request_id': 'req-6dbbbe73-f3e3-4e5e-b871-59d0c2ea6862'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:01.741446 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6dbbbe73-f3e3-4e5e-b871-59d0c2ea6862 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a5985b50aa4441eb109fc47b5df4a97', 'request_id': 'req-6dbbbe73-f3e3-4e5e-b871-59d0c2ea6862'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:01.752204 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6dbbbe73-f3e3-4e5e-b871-59d0c2ea6862 admin admin] The token cache is being invalidate because project 8a5985b50aa4441eb109fc47b5df4a97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:27:01.752584 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6dbbbe73-f3e3-4e5e-b871-59d0c2ea6862 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:01.753320 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6dbbbe73-f3e3-4e5e-b871-59d0c2ea6862 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:01.755739 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 972/1942] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:27:01 2022] DELETE /identity/v3/projects/8a5985b50aa4441eb109fc47b5df4a97 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:01.775361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36fecc-01ff-4680-a482-ff39444ba64e None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:01.775658 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36fecc-01ff-4680-a482-ff39444ba64e None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:01.775940 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36fecc-01ff-4680-a482-ff39444ba64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:01.801723 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-ca36fecc-01ff-4680-a482-ff39444ba64e None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:01.803423 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-ca36fecc-01ff-4680-a482-ff39444ba64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:01.870951 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 973/1943] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:01.880396 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12719d11-003c-4c87-9fd9-a023124f89d1 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:01.880697 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12719d11-003c-4c87-9fd9-a023124f89d1 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:01.880980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12719d11-003c-4c87-9fd9-a023124f89d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:01.901502 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-12719d11-003c-4c87-9fd9-a023124f89d1 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:01.902888 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-12719d11-003c-4c87-9fd9-a023124f89d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:01.908172 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-48336889-96c5-4a99-a79f-7479283fc2df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '611ba4ccbad94447ba2f6cbfae96b59c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:01.908838 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-48336889-96c5-4a99-a79f-7479283fc2df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '611ba4ccbad94447ba2f6cbfae96b59c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:01.911475 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 974/1944] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:27:01.915839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12719d11-003c-4c87-9fd9-a023124f89d1 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:01.916668 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-48336889-96c5-4a99-a79f-7479283fc2df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '611ba4ccbad94447ba2f6cbfae96b59c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:01.924953 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12719d11-003c-4c87-9fd9-a023124f89d1 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:01.930341 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aab91a-ed4f-4ce7-b3c3-85ba2065c5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:01.931007 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aab91a-ed4f-4ce7-b3c3-85ba2065c5d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:01.931295 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aab91a-ed4f-4ce7-b3c3-85ba2065c5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:01.931577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aab91a-ed4f-4ce7-b3c3-85ba2065c5d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:01.932373 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aab91a-ed4f-4ce7-b3c3-85ba2065c5d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:27:01.932685 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aab91a-ed4f-4ce7-b3c3-85ba2065c5d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:01.934321 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aab91a-ed4f-4ce7-b3c3-85ba2065c5d8 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:01.950256 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 975/1945] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:27:01.951277 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aab91a-ed4f-4ce7-b3c3-85ba2065c5d8 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:01.961915 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aab91a-ed4f-4ce7-b3c3-85ba2065c5d8 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:01.967024 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5a26f-106c-4b76-8f8d-25a69f4c599b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:01.967681 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5a26f-106c-4b76-8f8d-25a69f4c599b admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:01.968176 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5a26f-106c-4b76-8f8d-25a69f4c599b admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:01.968460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5a26f-106c-4b76-8f8d-25a69f4c599b admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:01.969153 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5a26f-106c-4b76-8f8d-25a69f4c599b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:01.971078 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5a26f-106c-4b76-8f8d-25a69f4c599b admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:02.099601 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-48336889-96c5-4a99-a79f-7479283fc2df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '611ba4ccbad94447ba2f6cbfae96b59c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:02.116922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-48336889-96c5-4a99-a79f-7479283fc2df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '611ba4ccbad94447ba2f6cbfae96b59c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:02.123705 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 971/1946] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:27:01 2022] DELETE /identity/v3/users/611ba4ccbad94447ba2f6cbfae96b59c => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:02.132456 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9f7d4-455d-4f31-9ee5-9da2701a2595 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:02.133380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9f7d4-455d-4f31-9ee5-9da2701a2595 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:02.133822 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9f7d4-455d-4f31-9ee5-9da2701a2595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:02.137356 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 976/1947] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:27:01 2022] POST /identity/v3/projects => generated 367 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:27:02.142219 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5a26f-106c-4b76-8f8d-25a69f4c599b admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:02.144083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-bfa5a26f-106c-4b76-8f8d-25a69f4c599b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:02.163075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-d0c9f7d4-455d-4f31-9ee5-9da2701a2595 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:02.164920 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d0c9f7d4-455d-4f31-9ee5-9da2701a2595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:02.228709 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:02.251970 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5a26f-106c-4b76-8f8d-25a69f4c599b admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:02.276355 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 972/1948] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:02.286501 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c82cf4-fbe3-4a85-8fe5-63461e904395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:02.286501 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c82cf4-fbe3-4a85-8fe5-63461e904395 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:02.286501 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c82cf4-fbe3-4a85-8fe5-63461e904395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:02.286501 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c82cf4-fbe3-4a85-8fe5-63461e904395 admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:02.286859 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c82cf4-fbe3-4a85-8fe5-63461e904395 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:02.286859 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c82cf4-fbe3-4a85-8fe5-63461e904395 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:02.290578 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9f7d4-455d-4f31-9ee5-9da2701a2595 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:02.293273 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d0c9f7d4-455d-4f31-9ee5-9da2701a2595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:02.385371 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9f7d4-455d-4f31-9ee5-9da2701a2595 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:02.390116 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e7123-601e-4e5d-a0cd-6875b1368fcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:02.390895 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e7123-601e-4e5d-a0cd-6875b1368fcd service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:02.391273 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e7123-601e-4e5d-a0cd-6875b1368fcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:02.391918 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e7123-601e-4e5d-a0cd-6875b1368fcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:02.413243 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 977/1949] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:27:02 2022] POST /identity/v3/users => generated 284 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:27:02.416405 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56753d0e-629e-4d4f-8700-06a1bd860f18 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:02.416926 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56753d0e-629e-4d4f-8700-06a1bd860f18 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:02.417435 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56753d0e-629e-4d4f-8700-06a1bd860f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:02.418771 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e7123-601e-4e5d-a0cd-6875b1368fcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:02.420383 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e7123-601e-4e5d-a0cd-6875b1368fcd service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:02.442631 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 973/1950] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:27:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:27:02.446196 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e7123-601e-4e5d-a0cd-6875b1368fcd service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:02.452625 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-56753d0e-629e-4d4f-8700-06a1bd860f18 None None] MFA Rules not processed for user `b6454da0eba2404ab599b3c80c06b8dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:02.454395 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-56753d0e-629e-4d4f-8700-06a1bd860f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:02.467162 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e7123-601e-4e5d-a0cd-6875b1368fcd service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:02.484620 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b6a95-69f2-4a3f-99c9-a9ef6da5cd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:02.487320 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b6a95-69f2-4a3f-99c9-a9ef6da5cd69 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:02.487320 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b6a95-69f2-4a3f-99c9-a9ef6da5cd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:02.487320 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b6a95-69f2-4a3f-99c9-a9ef6da5cd69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:02.487320 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b6a95-69f2-4a3f-99c9-a9ef6da5cd69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:02.489693 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b6a95-69f2-4a3f-99c9-a9ef6da5cd69 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:02.511749 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 974/1951] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:27:02.516429 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b6a95-69f2-4a3f-99c9-a9ef6da5cd69 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:02.542807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b6a95-69f2-4a3f-99c9-a9ef6da5cd69 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:02.559888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a99e5-5366-4211-ab3a-d530cfc3b97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:02.560591 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a99e5-5366-4211-ab3a-d530cfc3b97f admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:02.560876 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a99e5-5366-4211-ab3a-d530cfc3b97f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:02.561160 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a99e5-5366-4211-ab3a-d530cfc3b97f admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:02.561932 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a99e5-5366-4211-ab3a-d530cfc3b97f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:02.563855 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a99e5-5366-4211-ab3a-d530cfc3b97f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:02.572292 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 978/1952] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:02.586022 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56753d0e-629e-4d4f-8700-06a1bd860f18 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:02.587852 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-56753d0e-629e-4d4f-8700-06a1bd860f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:02.587971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 975/1953] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:27:02.592256 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a99e5-5366-4211-ab3a-d530cfc3b97f admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:02.611866 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a99e5-5366-4211-ab3a-d530cfc3b97f admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:02.618405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfe1ad-f2e4-44b9-b681-e38c0b169974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:02.619574 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfe1ad-f2e4-44b9-b681-e38c0b169974 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:02.622121 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfe1ad-f2e4-44b9-b681-e38c0b169974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:02.632293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfe1ad-f2e4-44b9-b681-e38c0b169974 admin admin] PATH_INFO: `/v3/projects/7f2b4112ba024202b56de9c4c580f12b/users/90901982bb9b4f90948f7ea205affd44/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:02.643577 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdfe1ad-f2e4-44b9-b681-e38c0b169974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f2b4112ba024202b56de9c4c580f12b, user_id=90901982bb9b4f90948f7ea205affd44, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:02.647162 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdfe1ad-f2e4-44b9-b681-e38c0b169974 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:02.713292 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56753d0e-629e-4d4f-8700-06a1bd860f18 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:02.728985 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 976/1954] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:27:02 2022] PUT /identity/v3/projects/7f2b4112ba024202b56de9c4c580f12b/users/90901982bb9b4f90948f7ea205affd44/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:27:02.731780 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36887254-3637-4c0c-a6c4-01db21981120 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:02.732499 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36887254-3637-4c0c-a6c4-01db21981120 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:02.733278 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36887254-3637-4c0c-a6c4-01db21981120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:02.800683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-36887254-3637-4c0c-a6c4-01db21981120 None None] MFA Rules not processed for user `90901982bb9b4f90948f7ea205affd44`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:02.802653 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-36887254-3637-4c0c-a6c4-01db21981120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:02.847677 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08848f0b-8c5d-46fd-a51c-c34eb15be416 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:02.848351 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08848f0b-8c5d-46fd-a51c-c34eb15be416 service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:02.848830 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08848f0b-8c5d-46fd-a51c-c34eb15be416 service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:02.849115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08848f0b-8c5d-46fd-a51c-c34eb15be416 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:02.933898 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 977/1955] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:02.936045 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36887254-3637-4c0c-a6c4-01db21981120 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:02.967997 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08848f0b-8c5d-46fd-a51c-c34eb15be416 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:02.969666 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08848f0b-8c5d-46fd-a51c-c34eb15be416 service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:02.982061 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 979/1956] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:27:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:27:03.029455 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36887254-3637-4c0c-a6c4-01db21981120 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:03.035851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067f04c-f984-4b26-9a62-7eb26247de64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:03.036383 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067f04c-f984-4b26-9a62-7eb26247de64 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:03.036877 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067f04c-f984-4b26-9a62-7eb26247de64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:03.037219 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067f04c-f984-4b26-9a62-7eb26247de64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:03.038625 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067f04c-f984-4b26-9a62-7eb26247de64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:03.040609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067f04c-f984-4b26-9a62-7eb26247de64 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:03.159140 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 978/1957] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:27:02 2022] POST /identity/v3/projects => generated 365 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:27:03.160283 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08848f0b-8c5d-46fd-a51c-c34eb15be416 service cinder] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:03.175264 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08848f0b-8c5d-46fd-a51c-c34eb15be416 service cinder] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:03.204379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067f04c-f984-4b26-9a62-7eb26247de64 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:03.206166 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d067f04c-f984-4b26-9a62-7eb26247de64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:03.257829 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11607084-b81d-48bb-9e39-ed04759cd7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:03.258523 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11607084-b81d-48bb-9e39-ed04759cd7fe admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:03.258809 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11607084-b81d-48bb-9e39-ed04759cd7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:03.259083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11607084-b81d-48bb-9e39-ed04759cd7fe admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:03.259790 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11607084-b81d-48bb-9e39-ed04759cd7fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:03.262309 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11607084-b81d-48bb-9e39-ed04759cd7fe admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:03.303258 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067f04c-f984-4b26-9a62-7eb26247de64 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:03.319800 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c0554-3ee4-4202-9a30-da9854c88d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:03.321021 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c0554-3ee4-4202-9a30-da9854c88d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:03.321382 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c0554-3ee4-4202-9a30-da9854c88d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:03.321669 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c0554-3ee4-4202-9a30-da9854c88d88 admin admin] PATH_INFO: `/v3/projects/ea1dabc9d1224cbcbaff232c4fabcfe7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:03.323262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c0554-3ee4-4202-9a30-da9854c88d88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea1dabc9d1224cbcbaff232c4fabcfe7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:03.324959 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c0554-3ee4-4202-9a30-da9854c88d88 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:03.392736 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 980/1958] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:27:03 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:27:03.392736 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11607084-b81d-48bb-9e39-ed04759cd7fe admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:03.412088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11607084-b81d-48bb-9e39-ed04759cd7fe admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:03.418892 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f2d69-4205-476d-90bb-df344e3c7363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:03.419727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f2d69-4205-476d-90bb-df344e3c7363 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:03.419727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f2d69-4205-476d-90bb-df344e3c7363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:03.419727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f2d69-4205-476d-90bb-df344e3c7363 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:03.420510 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f2d69-4205-476d-90bb-df344e3c7363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:03.422213 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f2d69-4205-476d-90bb-df344e3c7363 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:03.445042 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 981/1959] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:27:03.449757 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f2d69-4205-476d-90bb-df344e3c7363 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:03.462175 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f2d69-4205-476d-90bb-df344e3c7363 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:03.463626 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-7d1c0554-3ee4-4202-9a30-da9854c88d88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea1dabc9d1224cbcbaff232c4fabcfe7', 'request_id': 'req-7d1c0554-3ee4-4202-9a30-da9854c88d88'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:03.491148 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-7d1c0554-3ee4-4202-9a30-da9854c88d88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea1dabc9d1224cbcbaff232c4fabcfe7', 'request_id': 'req-7d1c0554-3ee4-4202-9a30-da9854c88d88'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:03.510439 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:03.552449 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10e7ee-48bc-4795-a1ee-8823ced13d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:03.553857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10e7ee-48bc-4795-a1ee-8823ced13d7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:03.554250 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10e7ee-48bc-4795-a1ee-8823ced13d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:03.554616 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10e7ee-48bc-4795-a1ee-8823ced13d7d admin admin] PATH_INFO: `/v3/projects/bce67c75df8142a8ad371a5a225d473f/users/b7e743f2a6e54ee282417699b7af12a6/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:03.562180 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-7d1c0554-3ee4-4202-9a30-da9854c88d88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea1dabc9d1224cbcbaff232c4fabcfe7', 'request_id': 'req-7d1c0554-3ee4-4202-9a30-da9854c88d88'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:03.571859 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10e7ee-48bc-4795-a1ee-8823ced13d7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce67c75df8142a8ad371a5a225d473f, user_id=b7e743f2a6e54ee282417699b7af12a6, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:03.574850 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-7d1c0554-3ee4-4202-9a30-da9854c88d88 admin admin] The token cache is being invalidate because project ea1dabc9d1224cbcbaff232c4fabcfe7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:27:03.574967 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10e7ee-48bc-4795-a1ee-8823ced13d7d admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:03.575145 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-7d1c0554-3ee4-4202-9a30-da9854c88d88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:03.575795 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-7d1c0554-3ee4-4202-9a30-da9854c88d88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:03.577627 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 979/1960] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:27:03 2022] DELETE /identity/v3/projects/ea1dabc9d1224cbcbaff232c4fabcfe7 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:27:03.581610 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c0554-3ee4-4202-9a30-da9854c88d88 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:03.583934 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7d1c0554-3ee4-4202-9a30-da9854c88d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:03.600360 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c0554-3ee4-4202-9a30-da9854c88d88 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:03.605593 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f3f9d-9920-4841-9ea9-bdfd1f6cc9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:03.609495 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f3f9d-9920-4841-9ea9-bdfd1f6cc9e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:03.609798 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f3f9d-9920-4841-9ea9-bdfd1f6cc9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:03.610088 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f3f9d-9920-4841-9ea9-bdfd1f6cc9e0 admin admin] PATH_INFO: `/v3/users/5f5e5c559ca447b8bb7d22903ae2e3dc` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:03.611338 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f3f9d-9920-4841-9ea9-bdfd1f6cc9e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f5e5c559ca447b8bb7d22903ae2e3dc)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:03.613941 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f3f9d-9920-4841-9ea9-bdfd1f6cc9e0 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:03.679913 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 982/1961] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:27:03 2022] PUT /identity/v3/projects/bce67c75df8142a8ad371a5a225d473f/users/b7e743f2a6e54ee282417699b7af12a6/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:03.683794 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10e7ee-48bc-4795-a1ee-8823ced13d7d admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:03.685506 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-8b10e7ee-48bc-4795-a1ee-8823ced13d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:03.803547 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10e7ee-48bc-4795-a1ee-8823ced13d7d admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:03.808806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f430fb-9f80-431b-832a-6cca977c14e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:03.809563 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f430fb-9f80-431b-832a-6cca977c14e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:03.809941 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f430fb-9f80-431b-832a-6cca977c14e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:03.810293 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f430fb-9f80-431b-832a-6cca977c14e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:03.811119 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f430fb-9f80-431b-832a-6cca977c14e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:03.813523 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f430fb-9f80-431b-832a-6cca977c14e9 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:03.827356 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 983/1962] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:27:03.834525 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f430fb-9f80-431b-832a-6cca977c14e9 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:03.851877 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f430fb-9f80-431b-832a-6cca977c14e9 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:03.876831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ac9d0-5a97-4261-a619-46ccdc349e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:03.876831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ac9d0-5a97-4261-a619-46ccdc349e17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:03.876831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ac9d0-5a97-4261-a619-46ccdc349e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:03.876831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ac9d0-5a97-4261-a619-46ccdc349e17 admin admin] PATH_INFO: `/v3/projects/bce67c75df8142a8ad371a5a225d473f/users/b7e743f2a6e54ee282417699b7af12a6/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:03.877290 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-2e1f3f9d-9920-4841-9ea9-bdfd1f6cc9e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f5e5c559ca447b8bb7d22903ae2e3dc'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:03.877290 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-2e1f3f9d-9920-4841-9ea9-bdfd1f6cc9e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f5e5c559ca447b8bb7d22903ae2e3dc'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:03.880433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ac9d0-5a97-4261-a619-46ccdc349e17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce67c75df8142a8ad371a5a225d473f, user_id=b7e743f2a6e54ee282417699b7af12a6, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:03.887036 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ac9d0-5a97-4261-a619-46ccdc349e17 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:03.891955 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-2e1f3f9d-9920-4841-9ea9-bdfd1f6cc9e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f5e5c559ca447b8bb7d22903ae2e3dc'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:03.905373 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 984/1963] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:27:03 2022] PUT /identity/v3/projects/bce67c75df8142a8ad371a5a225d473f/users/b7e743f2a6e54ee282417699b7af12a6/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:27:03.916364 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab02607-7269-4e14-8836-19424920f08a None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:03.916657 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab02607-7269-4e14-8836-19424920f08a None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:03.916934 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab02607-7269-4e14-8836-19424920f08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:03.952123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-dab02607-7269-4e14-8836-19424920f08a None None] MFA Rules not processed for user `b7e743f2a6e54ee282417699b7af12a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:03.953497 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-dab02607-7269-4e14-8836-19424920f08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:04.008481 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-2e1f3f9d-9920-4841-9ea9-bdfd1f6cc9e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f5e5c559ca447b8bb7d22903ae2e3dc'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:04.034579 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-2e1f3f9d-9920-4841-9ea9-bdfd1f6cc9e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f5e5c559ca447b8bb7d22903ae2e3dc'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:04.043821 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 985/1964] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:03 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:04.044997 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 980/1965] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:27:03 2022] DELETE /identity/v3/users/5f5e5c559ca447b8bb7d22903ae2e3dc => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:27:04.059755 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab02607-7269-4e14-8836-19424920f08a None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:04.063087 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-dab02607-7269-4e14-8836-19424920f08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:04.146323 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab02607-7269-4e14-8836-19424920f08a None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:04.204134 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe65f3-729b-4428-882f-058c0011a42f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:04.205086 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe65f3-729b-4428-882f-058c0011a42f service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:04.205593 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe65f3-729b-4428-882f-058c0011a42f service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:04.206201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe65f3-729b-4428-882f-058c0011a42f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:04.209337 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-44fe65f3-729b-4428-882f-058c0011a42f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:04.293591 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe65f3-729b-4428-882f-058c0011a42f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:04.293591 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe65f3-729b-4428-882f-058c0011a42f service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:04.306549 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 986/1966] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:27:04 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:27:04.577408 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f3f9d-9920-4841-9ea9-bdfd1f6cc9e0 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:04.578986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2e1f3f9d-9920-4841-9ea9-bdfd1f6cc9e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:04.592751 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f3f9d-9920-4841-9ea9-bdfd1f6cc9e0 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:04.596349 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95f612-2cd2-4460-a316-41ce66b42837 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:04.597001 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95f612-2cd2-4460-a316-41ce66b42837 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:04.597290 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95f612-2cd2-4460-a316-41ce66b42837 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:04.597570 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95f612-2cd2-4460-a316-41ce66b42837 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:04.599730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8a95f612-2cd2-4460-a316-41ce66b42837 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:04.649354 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe65f3-729b-4428-882f-058c0011a42f service cinder] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:04.651101 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-44fe65f3-729b-4428-882f-058c0011a42f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:04.665808 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a95f612-2cd2-4460-a316-41ce66b42837 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:04.667420 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a95f612-2cd2-4460-a316-41ce66b42837 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:04.677142 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 981/1967] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:27:04 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:27:04.759430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe65f3-729b-4428-882f-058c0011a42f service cinder] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:04.768347 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c399bf-1fa0-4c94-98a9-fe72f9dde8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:04.768347 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c399bf-1fa0-4c94-98a9-fe72f9dde8cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:04.768347 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c399bf-1fa0-4c94-98a9-fe72f9dde8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:04.768347 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c399bf-1fa0-4c94-98a9-fe72f9dde8cb admin admin] PATH_INFO: `/v3/projects/90aaef50efc54821b1d986220a1ee0ce` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:04.768878 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c399bf-1fa0-4c94-98a9-fe72f9dde8cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=90aaef50efc54821b1d986220a1ee0ce)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:04.771620 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c399bf-1fa0-4c94-98a9-fe72f9dde8cb admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:05.033366 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-11c399bf-1fa0-4c94-98a9-fe72f9dde8cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90aaef50efc54821b1d986220a1ee0ce', 'request_id': 'req-11c399bf-1fa0-4c94-98a9-fe72f9dde8cb'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:05.133867 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-11c399bf-1fa0-4c94-98a9-fe72f9dde8cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90aaef50efc54821b1d986220a1ee0ce', 'request_id': 'req-11c399bf-1fa0-4c94-98a9-fe72f9dde8cb'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:05.141461 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-11c399bf-1fa0-4c94-98a9-fe72f9dde8cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90aaef50efc54821b1d986220a1ee0ce', 'request_id': 'req-11c399bf-1fa0-4c94-98a9-fe72f9dde8cb'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:05.155417 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-11c399bf-1fa0-4c94-98a9-fe72f9dde8cb admin admin] The token cache is being invalidate because project 90aaef50efc54821b1d986220a1ee0ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:27:05.155710 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-11c399bf-1fa0-4c94-98a9-fe72f9dde8cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:05.156376 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-11c399bf-1fa0-4c94-98a9-fe72f9dde8cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:05.157994 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 987/1968] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:27:04 2022] DELETE /identity/v3/projects/90aaef50efc54821b1d986220a1ee0ce => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:27:05.163421 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377e83a-5597-4c97-bae8-87a896eac8cf None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:05.163704 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377e83a-5597-4c97-bae8-87a896eac8cf None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:05.164013 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377e83a-5597-4c97-bae8-87a896eac8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:05.182134 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-c377e83a-5597-4c97-bae8-87a896eac8cf None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:05.183343 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c377e83a-5597-4c97-bae8-87a896eac8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:05.244530 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 982/1969] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:05.252706 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc759f-9eb9-4434-96bb-e7f4cd531b94 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:05.252706 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc759f-9eb9-4434-96bb-e7f4cd531b94 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:05.252941 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc759f-9eb9-4434-96bb-e7f4cd531b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:05.271207 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-9acc759f-9eb9-4434-96bb-e7f4cd531b94 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:05.272388 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-9acc759f-9eb9-4434-96bb-e7f4cd531b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:05.280392 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 988/1970] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:05.285986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377e83a-5597-4c97-bae8-87a896eac8cf None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:05.296286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377e83a-5597-4c97-bae8-87a896eac8cf None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:05.301919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832bbe8-41cc-4cfe-9e1c-1effedaa7406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:05.302688 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832bbe8-41cc-4cfe-9e1c-1effedaa7406 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:05.302982 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832bbe8-41cc-4cfe-9e1c-1effedaa7406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:05.303266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832bbe8-41cc-4cfe-9e1c-1effedaa7406 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:05.304003 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832bbe8-41cc-4cfe-9e1c-1effedaa7406 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:27:05.304372 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832bbe8-41cc-4cfe-9e1c-1effedaa7406 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:05.306055 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832bbe8-41cc-4cfe-9e1c-1effedaa7406 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:05.324055 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 983/1971] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:27:05.328428 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc759f-9eb9-4434-96bb-e7f4cd531b94 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:05.338544 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc759f-9eb9-4434-96bb-e7f4cd531b94 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:05.344232 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ec7d6-ee66-4d0c-a5a8-c928ba890ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:05.344896 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ec7d6-ee66-4d0c-a5a8-c928ba890ebb admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:05.345310 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ec7d6-ee66-4d0c-a5a8-c928ba890ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:05.345598 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ec7d6-ee66-4d0c-a5a8-c928ba890ebb admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:05.346453 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ec7d6-ee66-4d0c-a5a8-c928ba890ebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:05.348570 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ec7d6-ee66-4d0c-a5a8-c928ba890ebb admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:05.387850 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:05.467672 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 989/1972] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:27:05 2022] POST /identity/v3/projects => generated 391 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:27:05.481393 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832bbe8-41cc-4cfe-9e1c-1effedaa7406 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:05.507677 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832bbe8-41cc-4cfe-9e1c-1effedaa7406 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:05.679308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2679e-2635-45ff-bd30-58ee991da8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:05.679308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2679e-2635-45ff-bd30-58ee991da8e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:05.679308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2679e-2635-45ff-bd30-58ee991da8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:05.679308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2679e-2635-45ff-bd30-58ee991da8e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:05.683335 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2679e-2635-45ff-bd30-58ee991da8e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:05.686821 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2679e-2635-45ff-bd30-58ee991da8e2 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:05.797307 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 984/1973] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:27:05 2022] POST /identity/v3/users => generated 296 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:27:05.802209 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ec7d6-ee66-4d0c-a5a8-c928ba890ebb admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:05.813201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ec7d6-ee66-4d0c-a5a8-c928ba890ebb admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:05.818934 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f0002-c8a7-43c6-bee8-e3a26e20f4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:05.819790 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f0002-c8a7-43c6-bee8-e3a26e20f4cf admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:05.820079 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f0002-c8a7-43c6-bee8-e3a26e20f4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:05.820360 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f0002-c8a7-43c6-bee8-e3a26e20f4cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:05.821365 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f0002-c8a7-43c6-bee8-e3a26e20f4cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:05.823187 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f0002-c8a7-43c6-bee8-e3a26e20f4cf admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:05.836290 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 990/1974] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:27:05.840559 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2679e-2635-45ff-bd30-58ee991da8e2 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:05.851381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2679e-2635-45ff-bd30-58ee991da8e2 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:05.856410 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295317f7-01c2-4c6f-a3bf-dab863b12bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:05.857267 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295317f7-01c2-4c6f-a3bf-dab863b12bad admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:05.857919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295317f7-01c2-4c6f-a3bf-dab863b12bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:05.857919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295317f7-01c2-4c6f-a3bf-dab863b12bad admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:05.858643 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295317f7-01c2-4c6f-a3bf-dab863b12bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:05.860269 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295317f7-01c2-4c6f-a3bf-dab863b12bad admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:05.871904 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 985/1975] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:27:05.876112 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f0002-c8a7-43c6-bee8-e3a26e20f4cf admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:05.887479 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f0002-c8a7-43c6-bee8-e3a26e20f4cf admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:05.892199 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb5d71-bbff-4a27-838a-f549410ae987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:05.893103 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb5d71-bbff-4a27-838a-f549410ae987 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:05.893390 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb5d71-bbff-4a27-838a-f549410ae987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:05.893668 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb5d71-bbff-4a27-838a-f549410ae987 admin admin] PATH_INFO: `/v3/projects/170677882d2e404cb663b663761f9f74/users/f236d4d135d64482b8b575100bb7e3b3/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:05.912965 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb5d71-bbff-4a27-838a-f549410ae987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=170677882d2e404cb663b663761f9f74, user_id=f236d4d135d64482b8b575100bb7e3b3, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:05.917100 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb5d71-bbff-4a27-838a-f549410ae987 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:05.921170 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98af0d-75cd-4539-8d73-fe197ab6a9bf None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:05.921809 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98af0d-75cd-4539-8d73-fe197ab6a9bf None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:05.922105 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98af0d-75cd-4539-8d73-fe197ab6a9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:05.942815 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-3c98af0d-75cd-4539-8d73-fe197ab6a9bf None None] MFA Rules not processed for user `b6454da0eba2404ab599b3c80c06b8dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:05.944094 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3c98af0d-75cd-4539-8d73-fe197ab6a9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:06.012364 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 986/1976] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:27:06.027044 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 991/1977] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:27:05 2022] PUT /identity/v3/projects/170677882d2e404cb663b663761f9f74/users/f236d4d135d64482b8b575100bb7e3b3/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:06.038117 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce031c46-a61e-46dc-9159-e893619d50c4 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:06.038412 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce031c46-a61e-46dc-9159-e893619d50c4 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:06.038699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce031c46-a61e-46dc-9159-e893619d50c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:06.067343 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-ce031c46-a61e-46dc-9159-e893619d50c4 None None] MFA Rules not processed for user `f236d4d135d64482b8b575100bb7e3b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:06.068759 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ce031c46-a61e-46dc-9159-e893619d50c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:06.137009 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 987/1978] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:27:06.141527 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb5d71-bbff-4a27-838a-f549410ae987 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:06.211403 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb5d71-bbff-4a27-838a-f549410ae987 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:06.218250 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26464e2-92c3-45f9-b719-a326be7cf59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:06.218947 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26464e2-92c3-45f9-b719-a326be7cf59c admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:06.219241 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26464e2-92c3-45f9-b719-a326be7cf59c admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:06.219581 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26464e2-92c3-45f9-b719-a326be7cf59c admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:06.220295 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26464e2-92c3-45f9-b719-a326be7cf59c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:06.222280 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26464e2-92c3-45f9-b719-a326be7cf59c admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:06.357576 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 992/1979] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:27:06 2022] POST /identity/v3/projects => generated 393 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:27:06.360922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce031c46-a61e-46dc-9159-e893619d50c4 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:06.374013 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce031c46-a61e-46dc-9159-e893619d50c4 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:06.437912 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518ee41-838f-4bde-8be5-5da0d137d963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:06.438732 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518ee41-838f-4bde-8be5-5da0d137d963 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:06.439133 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518ee41-838f-4bde-8be5-5da0d137d963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:06.439450 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518ee41-838f-4bde-8be5-5da0d137d963 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:06.440285 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518ee41-838f-4bde-8be5-5da0d137d963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:06.442853 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518ee41-838f-4bde-8be5-5da0d137d963 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:06.522162 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 988/1980] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:27:06 2022] POST /identity/v3/users => generated 303 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:27:06.522582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26464e2-92c3-45f9-b719-a326be7cf59c admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:06.534619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26464e2-92c3-45f9-b719-a326be7cf59c admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:06.541431 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36288d-bbf3-4916-b757-6b05a720e6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:06.550548 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36288d-bbf3-4916-b757-6b05a720e6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:06.550548 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36288d-bbf3-4916-b757-6b05a720e6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:06.550548 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36288d-bbf3-4916-b757-6b05a720e6d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:06.550548 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d36288d-bbf3-4916-b757-6b05a720e6d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:06.550548 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d36288d-bbf3-4916-b757-6b05a720e6d3 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:06.559024 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 993/1981] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:27:06.562889 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518ee41-838f-4bde-8be5-5da0d137d963 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:06.574120 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518ee41-838f-4bde-8be5-5da0d137d963 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:06.579353 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727690f-0eee-45f3-ae59-653f798cbf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:06.580327 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727690f-0eee-45f3-ae59-653f798cbf3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:06.581218 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727690f-0eee-45f3-ae59-653f798cbf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:06.581218 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727690f-0eee-45f3-ae59-653f798cbf3b admin admin] PATH_INFO: `/v3/projects/a76590fe884f4fe8bbd6c854c5f7a7cc/users/3d12fabac85543208b50e8f5085d260d/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:06.596519 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727690f-0eee-45f3-ae59-653f798cbf3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a76590fe884f4fe8bbd6c854c5f7a7cc, user_id=3d12fabac85543208b50e8f5085d260d, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:06.599369 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727690f-0eee-45f3-ae59-653f798cbf3b admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:06.642633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:06.700947 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 989/1982] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:27:06 2022] PUT /identity/v3/projects/a76590fe884f4fe8bbd6c854c5f7a7cc/users/3d12fabac85543208b50e8f5085d260d/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:27:06.711497 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36288d-bbf3-4916-b757-6b05a720e6d3 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:06.721405 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36288d-bbf3-4916-b757-6b05a720e6d3 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:06.806606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cf7cf-8e26-442d-8c1c-6c304b50a786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:06.807349 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cf7cf-8e26-442d-8c1c-6c304b50a786 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:06.807719 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cf7cf-8e26-442d-8c1c-6c304b50a786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:06.807883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cf7cf-8e26-442d-8c1c-6c304b50a786 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:06.808826 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9cf7cf-8e26-442d-8c1c-6c304b50a786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:06.810783 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9cf7cf-8e26-442d-8c1c-6c304b50a786 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:06.849570 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 994/1983] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:27:06.850927 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727690f-0eee-45f3-ae59-653f798cbf3b admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:06.862431 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727690f-0eee-45f3-ae59-653f798cbf3b admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:06.868391 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd3e0e-2966-4dc4-88f8-c0a4bfc9a2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:06.870326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd3e0e-2966-4dc4-88f8-c0a4bfc9a2f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:06.871371 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd3e0e-2966-4dc4-88f8-c0a4bfc9a2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:06.871804 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd3e0e-2966-4dc4-88f8-c0a4bfc9a2f7 admin admin] PATH_INFO: `/v3/projects/a76590fe884f4fe8bbd6c854c5f7a7cc/users/3d12fabac85543208b50e8f5085d260d/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:06.874435 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd3e0e-2966-4dc4-88f8-c0a4bfc9a2f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a76590fe884f4fe8bbd6c854c5f7a7cc, user_id=3d12fabac85543208b50e8f5085d260d, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:06.877366 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd3e0e-2966-4dc4-88f8-c0a4bfc9a2f7 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:06.892498 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 990/1984] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:27:06 2022] PUT /identity/v3/projects/a76590fe884f4fe8bbd6c854c5f7a7cc/users/3d12fabac85543208b50e8f5085d260d/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:06.904216 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17b493-4f29-407f-887f-f4bd34b34da0 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:06.904513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17b493-4f29-407f-887f-f4bd34b34da0 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:06.904797 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17b493-4f29-407f-887f-f4bd34b34da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:06.945434 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-0d17b493-4f29-407f-887f-f4bd34b34da0 None None] MFA Rules not processed for user `3d12fabac85543208b50e8f5085d260d`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:06.947064 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-0d17b493-4f29-407f-887f-f4bd34b34da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:07.048652 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 995/1985] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:06 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:27:07.062051 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd3e0e-2966-4dc4-88f8-c0a4bfc9a2f7 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:07.062929 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2ddd3e0e-2966-4dc4-88f8-c0a4bfc9a2f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:07.139768 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd3e0e-2966-4dc4-88f8-c0a4bfc9a2f7 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:07.144844 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c58de0-dc17-46cf-bcfb-57efa3b8dce7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:07.146233 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c58de0-dc17-46cf-bcfb-57efa3b8dce7 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:07.146531 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c58de0-dc17-46cf-bcfb-57efa3b8dce7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:07.146935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c58de0-dc17-46cf-bcfb-57efa3b8dce7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:07.159697 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c58de0-dc17-46cf-bcfb-57efa3b8dce7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:07.161656 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c58de0-dc17-46cf-bcfb-57efa3b8dce7 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:07.174262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 991/1986] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:27:07 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:27:07.231590 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:07.241351 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17b493-4f29-407f-887f-f4bd34b34da0 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:07.245997 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-0d17b493-4f29-407f-887f-f4bd34b34da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:07.264513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17b493-4f29-407f-887f-f4bd34b34da0 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:07.268651 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be6f39-a231-4d2d-81d6-d0477178d6bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:07.269278 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be6f39-a231-4d2d-81d6-d0477178d6bd service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:07.270634 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be6f39-a231-4d2d-81d6-d0477178d6bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:07.270634 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be6f39-a231-4d2d-81d6-d0477178d6bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:07.345284 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be6f39-a231-4d2d-81d6-d0477178d6bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:07.346971 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be6f39-a231-4d2d-81d6-d0477178d6bd service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:07.371012 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 996/1987] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:27:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:27:08.894117 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:09.585438 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:11.145812 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:11.323531 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:11.979820 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:12.909152 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c58de0-dc17-46cf-bcfb-57efa3b8dce7 service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:12.913263 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-58c58de0-dc17-46cf-bcfb-57efa3b8dce7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:13.008032 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c58de0-dc17-46cf-bcfb-57efa3b8dce7 service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:13.013867 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1367c-d9ee-455e-9544-ef174e8a0b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:13.014766 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1367c-d9ee-455e-9544-ef174e8a0b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:13.015056 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1367c-d9ee-455e-9544-ef174e8a0b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:13.015505 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1367c-d9ee-455e-9544-ef174e8a0b01 admin admin] PATH_INFO: `/v3/users/90901982bb9b4f90948f7ea205affd44` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:13.016762 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1367c-d9ee-455e-9544-ef174e8a0b01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90901982bb9b4f90948f7ea205affd44)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:13.018807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1367c-d9ee-455e-9544-ef174e8a0b01 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:13.275302 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-97d1367c-d9ee-455e-9544-ef174e8a0b01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90901982bb9b4f90948f7ea205affd44'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:13.276257 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-97d1367c-d9ee-455e-9544-ef174e8a0b01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90901982bb9b4f90948f7ea205affd44'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:13.283455 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-97d1367c-d9ee-455e-9544-ef174e8a0b01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90901982bb9b4f90948f7ea205affd44'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:13.414571 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-97d1367c-d9ee-455e-9544-ef174e8a0b01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90901982bb9b4f90948f7ea205affd44'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:13.444242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-97d1367c-d9ee-455e-9544-ef174e8a0b01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90901982bb9b4f90948f7ea205affd44'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:13.450838 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 992/1988] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:27:12 2022] DELETE /identity/v3/users/90901982bb9b4f90948f7ea205affd44 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:13.455327 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc284a-9458-468a-a0f2-a24d5008c22b None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:13.455784 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc284a-9458-468a-a0f2-a24d5008c22b None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:13.455873 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc284a-9458-468a-a0f2-a24d5008c22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:13.474522 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-c0fc284a-9458-468a-a0f2-a24d5008c22b None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:13.475840 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-c0fc284a-9458-468a-a0f2-a24d5008c22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:13.550125 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 997/1989] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:13.559838 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1367c-d9ee-455e-9544-ef174e8a0b01 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:13.562469 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-97d1367c-d9ee-455e-9544-ef174e8a0b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:13.637414 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1367c-d9ee-455e-9544-ef174e8a0b01 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:13.641754 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bad9e-3af0-47b6-a0fe-9b3e3c1811ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:13.642275 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bad9e-3af0-47b6-a0fe-9b3e3c1811ed service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:13.642561 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bad9e-3af0-47b6-a0fe-9b3e3c1811ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:13.642840 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bad9e-3af0-47b6-a0fe-9b3e3c1811ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:13.656179 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bad9e-3af0-47b6-a0fe-9b3e3c1811ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:13.657824 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bad9e-3af0-47b6-a0fe-9b3e3c1811ed service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:13.667678 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 993/1990] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:27:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:27:13.831478 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:14.005251 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc284a-9458-468a-a0f2-a24d5008c22b None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:14.014610 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-c0fc284a-9458-468a-a0f2-a24d5008c22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:14.020743 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc284a-9458-468a-a0f2-a24d5008c22b None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:14.025966 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c9557-cf75-4186-bbb1-838a2cc3fffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:14.027003 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c9557-cf75-4186-bbb1-838a2cc3fffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:14.027357 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c9557-cf75-4186-bbb1-838a2cc3fffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:14.027704 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c9557-cf75-4186-bbb1-838a2cc3fffe admin admin] PATH_INFO: `/v3/users/f236d4d135d64482b8b575100bb7e3b3` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:14.029016 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9c9557-cf75-4186-bbb1-838a2cc3fffe admin admin] RBAC: Authorizing `identity:delete_user(user_id=f236d4d135d64482b8b575100bb7e3b3)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:14.031427 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9c9557-cf75-4186-bbb1-838a2cc3fffe admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:14.242923 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bad9e-3af0-47b6-a0fe-9b3e3c1811ed service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:14.244572 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ac9bad9e-3af0-47b6-a0fe-9b3e3c1811ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:14.268525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bad9e-3af0-47b6-a0fe-9b3e3c1811ed service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:14.277379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13b1c2-9a97-4375-be08-cc4ed1272ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:14.279270 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13b1c2-9a97-4375-be08-cc4ed1272ff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:14.280150 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13b1c2-9a97-4375-be08-cc4ed1272ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:14.280640 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13b1c2-9a97-4375-be08-cc4ed1272ff5 admin admin] PATH_INFO: `/v3/projects/7f2b4112ba024202b56de9c4c580f12b` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:14.283238 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f13b1c2-9a97-4375-be08-cc4ed1272ff5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f2b4112ba024202b56de9c4c580f12b)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:14.286526 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f13b1c2-9a97-4375-be08-cc4ed1272ff5 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:14.320347 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-0c9c9557-cf75-4186-bbb1-838a2cc3fffe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f236d4d135d64482b8b575100bb7e3b3'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:14.323848 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:14.448835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-0c9c9557-cf75-4186-bbb1-838a2cc3fffe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f236d4d135d64482b8b575100bb7e3b3'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:14.457536 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-0c9c9557-cf75-4186-bbb1-838a2cc3fffe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f236d4d135d64482b8b575100bb7e3b3'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:14.459281 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-0c9c9557-cf75-4186-bbb1-838a2cc3fffe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f236d4d135d64482b8b575100bb7e3b3'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:14.460395 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-0c9c9557-cf75-4186-bbb1-838a2cc3fffe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f236d4d135d64482b8b575100bb7e3b3'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:14.482649 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 998/1991] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:27:14 2022] DELETE /identity/v3/users/f236d4d135d64482b8b575100bb7e3b3 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:14.493052 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-7f13b1c2-9a97-4375-be08-cc4ed1272ff5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f2b4112ba024202b56de9c4c580f12b', 'request_id': 'req-7f13b1c2-9a97-4375-be08-cc4ed1272ff5'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:14.495856 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1c9a1-d5d6-4c6a-a460-4fc778270d9d None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:14.496512 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1c9a1-d5d6-4c6a-a460-4fc778270d9d None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:14.496877 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1c9a1-d5d6-4c6a-a460-4fc778270d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:14.501266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-7f13b1c2-9a97-4375-be08-cc4ed1272ff5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f2b4112ba024202b56de9c4c580f12b', 'request_id': 'req-7f13b1c2-9a97-4375-be08-cc4ed1272ff5'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:14.518122 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-6ae1c9a1-d5d6-4c6a-a460-4fc778270d9d None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:14.526020 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-6ae1c9a1-d5d6-4c6a-a460-4fc778270d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:14.598938 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 999/1992] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:14.623624 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-7f13b1c2-9a97-4375-be08-cc4ed1272ff5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f2b4112ba024202b56de9c4c580f12b', 'request_id': 'req-7f13b1c2-9a97-4375-be08-cc4ed1272ff5'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:14.623954 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1c9a1-d5d6-4c6a-a460-4fc778270d9d None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:14.623954 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-6ae1c9a1-d5d6-4c6a-a460-4fc778270d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:14.625402 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-7f13b1c2-9a97-4375-be08-cc4ed1272ff5 admin admin] The token cache is being invalidate because project 7f2b4112ba024202b56de9c4c580f12b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:27:14.625893 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-7f13b1c2-9a97-4375-be08-cc4ed1272ff5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:14.626569 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-7f13b1c2-9a97-4375-be08-cc4ed1272ff5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:14.628181 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 994/1993] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:27:14 2022] DELETE /identity/v3/projects/7f2b4112ba024202b56de9c4c580f12b => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:14.632266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13b1c2-9a97-4375-be08-cc4ed1272ff5 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:14.633867 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7f13b1c2-9a97-4375-be08-cc4ed1272ff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:14.714041 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13b1c2-9a97-4375-be08-cc4ed1272ff5 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:14.722665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31772db2-db02-4fd3-8a04-44a59354be5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:14.724497 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31772db2-db02-4fd3-8a04-44a59354be5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:14.724994 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31772db2-db02-4fd3-8a04-44a59354be5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:14.725499 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31772db2-db02-4fd3-8a04-44a59354be5e admin admin] PATH_INFO: `/v3/users/b7e743f2a6e54ee282417699b7af12a6` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:14.727365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31772db2-db02-4fd3-8a04-44a59354be5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7e743f2a6e54ee282417699b7af12a6)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:14.729528 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31772db2-db02-4fd3-8a04-44a59354be5e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:14.736672 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1c9a1-d5d6-4c6a-a460-4fc778270d9d None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:14.741503 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d03f46-44d1-4d7b-a206-888a035edadd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:14.742202 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d03f46-44d1-4d7b-a206-888a035edadd service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:14.742493 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d03f46-44d1-4d7b-a206-888a035edadd service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:14.745328 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d03f46-44d1-4d7b-a206-888a035edadd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:14.745328 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-33d03f46-44d1-4d7b-a206-888a035edadd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:14.769138 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d03f46-44d1-4d7b-a206-888a035edadd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:14.770636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d03f46-44d1-4d7b-a206-888a035edadd service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:14.782628 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1000/1994] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:27:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:27:15.034260 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-31772db2-db02-4fd3-8a04-44a59354be5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7e743f2a6e54ee282417699b7af12a6'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:15.035063 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-31772db2-db02-4fd3-8a04-44a59354be5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7e743f2a6e54ee282417699b7af12a6'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:15.045778 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-31772db2-db02-4fd3-8a04-44a59354be5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7e743f2a6e54ee282417699b7af12a6'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:15.167687 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-31772db2-db02-4fd3-8a04-44a59354be5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7e743f2a6e54ee282417699b7af12a6'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:15.193560 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-31772db2-db02-4fd3-8a04-44a59354be5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7e743f2a6e54ee282417699b7af12a6'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:15.202107 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 995/1995] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:27:14 2022] DELETE /identity/v3/users/b7e743f2a6e54ee282417699b7af12a6 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:27:15.270858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d03f46-44d1-4d7b-a206-888a035edadd service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:15.274066 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-33d03f46-44d1-4d7b-a206-888a035edadd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:15.296050 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d03f46-44d1-4d7b-a206-888a035edadd service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:15.391635 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6299aec-3dee-4dc0-b828-53c344e8a3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:15.392517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6299aec-3dee-4dc0-b828-53c344e8a3e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:15.392801 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6299aec-3dee-4dc0-b828-53c344e8a3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:15.393080 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6299aec-3dee-4dc0-b828-53c344e8a3e1 admin admin] PATH_INFO: `/v3/projects/170677882d2e404cb663b663761f9f74` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:15.394314 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6299aec-3dee-4dc0-b828-53c344e8a3e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=170677882d2e404cb663b663761f9f74)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:15.396772 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6299aec-3dee-4dc0-b828-53c344e8a3e1 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:15.563277 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-a6299aec-3dee-4dc0-b828-53c344e8a3e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '170677882d2e404cb663b663761f9f74', 'request_id': 'req-a6299aec-3dee-4dc0-b828-53c344e8a3e1'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:15.653538 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-a6299aec-3dee-4dc0-b828-53c344e8a3e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '170677882d2e404cb663b663761f9f74', 'request_id': 'req-a6299aec-3dee-4dc0-b828-53c344e8a3e1'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:15.660409 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-a6299aec-3dee-4dc0-b828-53c344e8a3e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '170677882d2e404cb663b663761f9f74', 'request_id': 'req-a6299aec-3dee-4dc0-b828-53c344e8a3e1'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:15.671020 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-a6299aec-3dee-4dc0-b828-53c344e8a3e1 admin admin] The token cache is being invalidate because project 170677882d2e404cb663b663761f9f74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:27:15.671315 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-a6299aec-3dee-4dc0-b828-53c344e8a3e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:15.671970 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-a6299aec-3dee-4dc0-b828-53c344e8a3e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:15.673732 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1001/1996] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:27:15 2022] DELETE /identity/v3/projects/170677882d2e404cb663b663761f9f74 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:27:15.677964 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31772db2-db02-4fd3-8a04-44a59354be5e admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:15.679530 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-31772db2-db02-4fd3-8a04-44a59354be5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:15.695119 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31772db2-db02-4fd3-8a04-44a59354be5e admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:15.754482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8707e2-e694-4fb8-9ebe-7be847397feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:15.755408 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8707e2-e694-4fb8-9ebe-7be847397feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:15.755879 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8707e2-e694-4fb8-9ebe-7be847397feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:15.756270 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8707e2-e694-4fb8-9ebe-7be847397feb admin admin] PATH_INFO: `/v3/users/3d12fabac85543208b50e8f5085d260d` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:15.758354 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8707e2-e694-4fb8-9ebe-7be847397feb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d12fabac85543208b50e8f5085d260d)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:15.767958 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8707e2-e694-4fb8-9ebe-7be847397feb admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:15.768059 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6299aec-3dee-4dc0-b828-53c344e8a3e1 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:15.769336 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-a6299aec-3dee-4dc0-b828-53c344e8a3e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:15.793681 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6299aec-3dee-4dc0-b828-53c344e8a3e1 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:15.800665 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05302a2d-c92e-4f05-a1ee-b2408825460a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:15.801665 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05302a2d-c92e-4f05-a1ee-b2408825460a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:15.801984 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05302a2d-c92e-4f05-a1ee-b2408825460a admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:15.802264 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05302a2d-c92e-4f05-a1ee-b2408825460a admin admin] PATH_INFO: `/v3/projects/bce67c75df8142a8ad371a5a225d473f` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:15.804500 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05302a2d-c92e-4f05-a1ee-b2408825460a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bce67c75df8142a8ad371a5a225d473f)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:15.806531 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05302a2d-c92e-4f05-a1ee-b2408825460a admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:16.135769 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ed8707e2-e694-4fb8-9ebe-7be847397feb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d12fabac85543208b50e8f5085d260d'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:16.137106 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-05302a2d-c92e-4f05-a1ee-b2408825460a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bce67c75df8142a8ad371a5a225d473f', 'request_id': 'req-05302a2d-c92e-4f05-a1ee-b2408825460a'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:16.156974 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ed8707e2-e694-4fb8-9ebe-7be847397feb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d12fabac85543208b50e8f5085d260d'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:16.157743 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ed8707e2-e694-4fb8-9ebe-7be847397feb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d12fabac85543208b50e8f5085d260d'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:16.207612 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-05302a2d-c92e-4f05-a1ee-b2408825460a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bce67c75df8142a8ad371a5a225d473f', 'request_id': 'req-05302a2d-c92e-4f05-a1ee-b2408825460a'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:16.215145 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-05302a2d-c92e-4f05-a1ee-b2408825460a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bce67c75df8142a8ad371a5a225d473f', 'request_id': 'req-05302a2d-c92e-4f05-a1ee-b2408825460a'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:16.226364 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-05302a2d-c92e-4f05-a1ee-b2408825460a admin admin] The token cache is being invalidate because project bce67c75df8142a8ad371a5a225d473f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:27:16.226659 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-05302a2d-c92e-4f05-a1ee-b2408825460a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:16.227314 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-05302a2d-c92e-4f05-a1ee-b2408825460a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:16.229033 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1002/1997] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:27:15 2022] DELETE /identity/v3/projects/bce67c75df8142a8ad371a5a225d473f => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:16.233734 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3ecbf-09ee-4bff-a1ff-6112224e129e None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:16.234122 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3ecbf-09ee-4bff-a1ff-6112224e129e None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:16.234397 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3ecbf-09ee-4bff-a1ff-6112224e129e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:16.254728 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-00e3ecbf-09ee-4bff-a1ff-6112224e129e None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:16.256022 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-00e3ecbf-09ee-4bff-a1ff-6112224e129e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:16.292038 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ed8707e2-e694-4fb8-9ebe-7be847397feb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d12fabac85543208b50e8f5085d260d'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:16.309002 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ed8707e2-e694-4fb8-9ebe-7be847397feb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d12fabac85543208b50e8f5085d260d'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:16.320861 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 996/1998] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:27:15 2022] DELETE /identity/v3/users/3d12fabac85543208b50e8f5085d260d => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:27:16.340762 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1003/1999] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:27:16.351857 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01fee3-fa85-46f1-8a23-6b5c503e4bd5 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:16.352369 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01fee3-fa85-46f1-8a23-6b5c503e4bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:16.352809 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01fee3-fa85-46f1-8a23-6b5c503e4bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:16.373490 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-cc01fee3-fa85-46f1-8a23-6b5c503e4bd5 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:16.374936 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-cc01fee3-fa85-46f1-8a23-6b5c503e4bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:16.407390 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:16.437970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 997/2000] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:16.447627 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3ecbf-09ee-4bff-a1ff-6112224e129e None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:16.457607 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3ecbf-09ee-4bff-a1ff-6112224e129e None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:16.464223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6f822-1e6a-4e06-a334-7a006a17513e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:16.464486 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6f822-1e6a-4e06-a334-7a006a17513e admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:16.464835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6f822-1e6a-4e06-a334-7a006a17513e admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:16.465185 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6f822-1e6a-4e06-a334-7a006a17513e admin admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:16.466061 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6f822-1e6a-4e06-a334-7a006a17513e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:27:16.466437 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6f822-1e6a-4e06-a334-7a006a17513e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:16.468119 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6f822-1e6a-4e06-a334-7a006a17513e admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:16.480663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1004/2001] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:27:16.487794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01fee3-fa85-46f1-8a23-6b5c503e4bd5 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:16.497393 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01fee3-fa85-46f1-8a23-6b5c503e4bd5 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:16.502169 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621020b-c02e-4f82-938d-70fa7a0d1033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:16.502823 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621020b-c02e-4f82-938d-70fa7a0d1033 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:16.503202 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621020b-c02e-4f82-938d-70fa7a0d1033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:16.503491 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621020b-c02e-4f82-938d-70fa7a0d1033 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:16.504244 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621020b-c02e-4f82-938d-70fa7a0d1033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:16.507487 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621020b-c02e-4f82-938d-70fa7a0d1033 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:16.621000 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 998/2002] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:27:16 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:27:16.625419 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6f822-1e6a-4e06-a334-7a006a17513e admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:16.637134 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6f822-1e6a-4e06-a334-7a006a17513e admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:16.696081 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2f351-8d7c-44d9-9970-fd4bfedab739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:16.697015 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2f351-8d7c-44d9-9970-fd4bfedab739 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:16.697302 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2f351-8d7c-44d9-9970-fd4bfedab739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:16.697582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2f351-8d7c-44d9-9970-fd4bfedab739 admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:16.698330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2f351-8d7c-44d9-9970-fd4bfedab739 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:16.700502 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2f351-8d7c-44d9-9970-fd4bfedab739 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:16.792037 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1005/2003] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:27:16 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:27:16.796821 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621020b-c02e-4f82-938d-70fa7a0d1033 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:16.808646 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621020b-c02e-4f82-938d-70fa7a0d1033 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:16.813307 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc058194-b145-451b-9d71-e14d5e02c902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:16.814156 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc058194-b145-451b-9d71-e14d5e02c902 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:16.814554 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc058194-b145-451b-9d71-e14d5e02c902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:16.814839 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc058194-b145-451b-9d71-e14d5e02c902 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:16.815606 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc058194-b145-451b-9d71-e14d5e02c902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:16.817373 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc058194-b145-451b-9d71-e14d5e02c902 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:16.829374 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 999/2004] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:27:16.840172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2f351-8d7c-44d9-9970-fd4bfedab739 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:16.850503 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2f351-8d7c-44d9-9970-fd4bfedab739 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:16.855302 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd8226-8cdd-4085-a645-03066c1842eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:16.856072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd8226-8cdd-4085-a645-03066c1842eb admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:16.856422 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd8226-8cdd-4085-a645-03066c1842eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:16.856777 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd8226-8cdd-4085-a645-03066c1842eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:16.857573 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd8226-8cdd-4085-a645-03066c1842eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:16.859296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd8226-8cdd-4085-a645-03066c1842eb admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:16.866517 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:16.873713 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1006/2005] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:27:16.874866 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc058194-b145-451b-9d71-e14d5e02c902 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:16.885675 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc058194-b145-451b-9d71-e14d5e02c902 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:16.891719 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af61e3-f6cc-4d44-8390-32e67fc9f1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:16.892680 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af61e3-f6cc-4d44-8390-32e67fc9f1b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:16.892967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af61e3-f6cc-4d44-8390-32e67fc9f1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:16.893254 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af61e3-f6cc-4d44-8390-32e67fc9f1b7 admin admin] PATH_INFO: `/v3/projects/9610159a1e7e4a059a582a061ef5acbf/users/129dc4c7c702449280a86deb07b092a2/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:16.909272 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af61e3-f6cc-4d44-8390-32e67fc9f1b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9610159a1e7e4a059a582a061ef5acbf, user_id=129dc4c7c702449280a86deb07b092a2, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:16.913322 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af61e3-f6cc-4d44-8390-32e67fc9f1b7 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:17.021195 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1000/2006] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:27:16 2022] PUT /identity/v3/projects/9610159a1e7e4a059a582a061ef5acbf/users/129dc4c7c702449280a86deb07b092a2/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:17.023399 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aae59c-db1c-4fd0-80b7-10bb245b9626 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:17.023898 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aae59c-db1c-4fd0-80b7-10bb245b9626 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:17.024368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aae59c-db1c-4fd0-80b7-10bb245b9626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:17.053534 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-e3aae59c-db1c-4fd0-80b7-10bb245b9626 None None] MFA Rules not processed for user `129dc4c7c702449280a86deb07b092a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:17.054910 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-e3aae59c-db1c-4fd0-80b7-10bb245b9626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:17.121959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1007/2007] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:17.133857 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af61e3-f6cc-4d44-8390-32e67fc9f1b7 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:17.136148 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-54af61e3-f6cc-4d44-8390-32e67fc9f1b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:17.144446 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aae59c-db1c-4fd0-80b7-10bb245b9626 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:17.150451 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-e3aae59c-db1c-4fd0-80b7-10bb245b9626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:17.235152 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aae59c-db1c-4fd0-80b7-10bb245b9626 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:17.246706 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2aed85-3b74-41e1-b5d4-770288b78f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:17.247630 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2aed85-3b74-41e1-b5d4-770288b78f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:17.247919 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2aed85-3b74-41e1-b5d4-770288b78f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:17.248200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2aed85-3b74-41e1-b5d4-770288b78f55 admin admin] PATH_INFO: `/v3/projects/a76590fe884f4fe8bbd6c854c5f7a7cc` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:17.250886 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2aed85-3b74-41e1-b5d4-770288b78f55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a76590fe884f4fe8bbd6c854c5f7a7cc)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:17.252691 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af61e3-f6cc-4d44-8390-32e67fc9f1b7 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:17.253129 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2aed85-3b74-41e1-b5d4-770288b78f55 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:17.261365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748a6cf-2abc-42a4-b0a2-6d0457dda002 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:17.262709 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748a6cf-2abc-42a4-b0a2-6d0457dda002 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:17.263412 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748a6cf-2abc-42a4-b0a2-6d0457dda002 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:17.263864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748a6cf-2abc-42a4-b0a2-6d0457dda002 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:17.275971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748a6cf-2abc-42a4-b0a2-6d0457dda002 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:17.278839 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748a6cf-2abc-42a4-b0a2-6d0457dda002 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:17.305799 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1001/2008] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:27:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:27:17.337383 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748a6cf-2abc-42a4-b0a2-6d0457dda002 service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:17.353255 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748a6cf-2abc-42a4-b0a2-6d0457dda002 service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:17.372344 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-2e2aed85-3b74-41e1-b5d4-770288b78f55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a76590fe884f4fe8bbd6c854c5f7a7cc', 'request_id': 'req-2e2aed85-3b74-41e1-b5d4-770288b78f55'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:17.380535 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391d3bf-965b-4e6c-8371-c5afe414aa35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:17.381600 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391d3bf-965b-4e6c-8371-c5afe414aa35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:17.381923 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391d3bf-965b-4e6c-8371-c5afe414aa35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:17.382200 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391d3bf-965b-4e6c-8371-c5afe414aa35 admin admin] PATH_INFO: `/v3/users/129dc4c7c702449280a86deb07b092a2` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:17.383499 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391d3bf-965b-4e6c-8371-c5afe414aa35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=129dc4c7c702449280a86deb07b092a2)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:17.385856 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391d3bf-965b-4e6c-8371-c5afe414aa35 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:17.461245 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-2e2aed85-3b74-41e1-b5d4-770288b78f55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a76590fe884f4fe8bbd6c854c5f7a7cc', 'request_id': 'req-2e2aed85-3b74-41e1-b5d4-770288b78f55'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:17.468995 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-2e2aed85-3b74-41e1-b5d4-770288b78f55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a76590fe884f4fe8bbd6c854c5f7a7cc', 'request_id': 'req-2e2aed85-3b74-41e1-b5d4-770288b78f55'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:17.480906 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-2e2aed85-3b74-41e1-b5d4-770288b78f55 admin admin] The token cache is being invalidate because project a76590fe884f4fe8bbd6c854c5f7a7cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:27:17.481243 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-2e2aed85-3b74-41e1-b5d4-770288b78f55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:17.481976 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-2e2aed85-3b74-41e1-b5d4-770288b78f55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:17.483626 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1008/2009] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:27:17 2022] DELETE /identity/v3/projects/a76590fe884f4fe8bbd6c854c5f7a7cc => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:17.488788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ea690-a210-46db-b82f-4f8070f26cec None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:17.489080 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ea690-a210-46db-b82f-4f8070f26cec None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:17.489362 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ea690-a210-46db-b82f-4f8070f26cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:17.509789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-897ea690-a210-46db-b82f-4f8070f26cec None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:17.511041 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-897ea690-a210-46db-b82f-4f8070f26cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:17.556466 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-7391d3bf-965b-4e6c-8371-c5afe414aa35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '129dc4c7c702449280a86deb07b092a2'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:17.557355 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-7391d3bf-965b-4e6c-8371-c5afe414aa35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '129dc4c7c702449280a86deb07b092a2'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:17.565324 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-7391d3bf-965b-4e6c-8371-c5afe414aa35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '129dc4c7c702449280a86deb07b092a2'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:17.576930 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1009/2010] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:27:17.586909 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200b677-9f09-4ede-8cb7-cece95a65c1e None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:17.587201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200b677-9f09-4ede-8cb7-cece95a65c1e None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:17.587480 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200b677-9f09-4ede-8cb7-cece95a65c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:17.607334 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-4200b677-9f09-4ede-8cb7-cece95a65c1e None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:17.608689 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-4200b677-9f09-4ede-8cb7-cece95a65c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:17.620271 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1010/2011] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:27:17.621375 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200b677-9f09-4ede-8cb7-cece95a65c1e None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:17.630670 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200b677-9f09-4ede-8cb7-cece95a65c1e None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:17.636506 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb3dcf-a77d-4c12-a283-6725484bca16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:17.637266 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb3dcf-a77d-4c12-a283-6725484bca16 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:17.637552 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb3dcf-a77d-4c12-a283-6725484bca16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:17.637855 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb3dcf-a77d-4c12-a283-6725484bca16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:17.638601 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb3dcf-a77d-4c12-a283-6725484bca16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:27:17.638914 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb3dcf-a77d-4c12-a283-6725484bca16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:17.640684 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb3dcf-a77d-4c12-a283-6725484bca16 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:17.648374 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-7391d3bf-965b-4e6c-8371-c5afe414aa35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '129dc4c7c702449280a86deb07b092a2'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:17.658904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1011/2012] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:27:17.659846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb3dcf-a77d-4c12-a283-6725484bca16 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:17.661554 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:17.668982 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-7391d3bf-965b-4e6c-8371-c5afe414aa35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '129dc4c7c702449280a86deb07b092a2'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:17.672422 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb3dcf-a77d-4c12-a283-6725484bca16 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:17.679274 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1002/2013] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:27:17 2022] DELETE /identity/v3/users/129dc4c7c702449280a86deb07b092a2 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:17.680318 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47937eeb-fafd-43a0-a8f9-180088f8b74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:17.680989 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8399658-7afd-41b4-8e23-f769941bffc4 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:17.681132 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47937eeb-fafd-43a0-a8f9-180088f8b74b admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:17.681241 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8399658-7afd-41b4-8e23-f769941bffc4 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:17.681428 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47937eeb-fafd-43a0-a8f9-180088f8b74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:17.681553 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8399658-7afd-41b4-8e23-f769941bffc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:17.681848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47937eeb-fafd-43a0-a8f9-180088f8b74b admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:17.683579 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47937eeb-fafd-43a0-a8f9-180088f8b74b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:17.684966 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47937eeb-fafd-43a0-a8f9-180088f8b74b admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:17.704185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-b8399658-7afd-41b4-8e23-f769941bffc4 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:17.705417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b8399658-7afd-41b4-8e23-f769941bffc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:17.787026 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1003/2014] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:17.787201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1012/2015] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:27:17 2022] POST /identity/v3/projects => generated 407 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:27:17.789541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8399658-7afd-41b4-8e23-f769941bffc4 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:17.792368 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b8399658-7afd-41b4-8e23-f769941bffc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:17.795379 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47937eeb-fafd-43a0-a8f9-180088f8b74b admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:17.797824 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-47937eeb-fafd-43a0-a8f9-180088f8b74b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:17.809171 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8399658-7afd-41b4-8e23-f769941bffc4 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:17.888993 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47937eeb-fafd-43a0-a8f9-180088f8b74b admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:17.890059 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fb60e-1fb0-430d-b10e-1d57b8171a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:17.890913 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fb60e-1fb0-430d-b10e-1d57b8171a19 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:17.891024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fb60e-1fb0-430d-b10e-1d57b8171a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:17.895387 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fb60e-1fb0-430d-b10e-1d57b8171a19 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:17.895387 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fb60e-1fb0-430d-b10e-1d57b8171a19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:17.895387 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fb60e-1fb0-430d-b10e-1d57b8171a19 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:17.895640 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55388473-1026-418f-9142-08cd852f96ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:17.896257 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55388473-1026-418f-9142-08cd852f96ee service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:17.897182 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55388473-1026-418f-9142-08cd852f96ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:17.898089 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55388473-1026-418f-9142-08cd852f96ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:17.913538 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55388473-1026-418f-9142-08cd852f96ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:17.915360 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55388473-1026-418f-9142-08cd852f96ee service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:17.925708 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1013/2016] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:27:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:27:18.081142 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1004/2017] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:27:17 2022] POST /identity/v3/users => generated 304 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:27:18.081804 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55388473-1026-418f-9142-08cd852f96ee service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:18.093975 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55388473-1026-418f-9142-08cd852f96ee service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:18.100189 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb6f07-72c7-47ae-97f6-273627645c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:18.101189 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb6f07-72c7-47ae-97f6-273627645c4c admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:18.101622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb6f07-72c7-47ae-97f6-273627645c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:18.102321 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb6f07-72c7-47ae-97f6-273627645c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:18.103938 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb6f07-72c7-47ae-97f6-273627645c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:18.106468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb6f07-72c7-47ae-97f6-273627645c4c admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:18.122855 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1014/2018] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:27:18.131338 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fb60e-1fb0-430d-b10e-1d57b8171a19 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:18.141874 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fb60e-1fb0-430d-b10e-1d57b8171a19 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:18.148348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd3a30-1671-4f35-a114-1cac7bc4f8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:18.149514 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd3a30-1671-4f35-a114-1cac7bc4f8bb admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:18.150070 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd3a30-1671-4f35-a114-1cac7bc4f8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:18.150535 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd3a30-1671-4f35-a114-1cac7bc4f8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:18.151503 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd3a30-1671-4f35-a114-1cac7bc4f8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:18.153451 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd3a30-1671-4f35-a114-1cac7bc4f8bb admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:18.170283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1005/2019] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:27:18.170474 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb6f07-72c7-47ae-97f6-273627645c4c admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:18.181449 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb6f07-72c7-47ae-97f6-273627645c4c admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:18.186902 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acedbbb-896a-429b-aedc-f96a01fc2dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:18.188313 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acedbbb-896a-429b-aedc-f96a01fc2dc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:18.188600 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acedbbb-896a-429b-aedc-f96a01fc2dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:18.188880 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acedbbb-896a-429b-aedc-f96a01fc2dc1 admin admin] PATH_INFO: `/v3/projects/b220990b59734b9eac33ec1c3f3a76df/users/7befd8480d7245be86794e71785cd2ae/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:18.206081 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acedbbb-896a-429b-aedc-f96a01fc2dc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b220990b59734b9eac33ec1c3f3a76df, user_id=7befd8480d7245be86794e71785cd2ae, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:18.209635 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acedbbb-896a-429b-aedc-f96a01fc2dc1 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:18.325190 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1015/2020] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:27:18 2022] PUT /identity/v3/projects/b220990b59734b9eac33ec1c3f3a76df/users/7befd8480d7245be86794e71785cd2ae/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:18.336844 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2e7ab-ba14-419a-bb1e-56e2515934b9 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:18.337054 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2e7ab-ba14-419a-bb1e-56e2515934b9 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:18.337344 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2e7ab-ba14-419a-bb1e-56e2515934b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:18.374849 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-58e2e7ab-ba14-419a-bb1e-56e2515934b9 None None] MFA Rules not processed for user `7befd8480d7245be86794e71785cd2ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:18.376540 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-58e2e7ab-ba14-419a-bb1e-56e2515934b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:18.499339 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1006/2021] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:18 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:18.504225 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acedbbb-896a-429b-aedc-f96a01fc2dc1 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:18.594723 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acedbbb-896a-429b-aedc-f96a01fc2dc1 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:18.600257 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c9a07-30a8-49d7-9bc8-d360a52b9a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:18.600936 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c9a07-30a8-49d7-9bc8-d360a52b9a32 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:18.601276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c9a07-30a8-49d7-9bc8-d360a52b9a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:18.601566 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c9a07-30a8-49d7-9bc8-d360a52b9a32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:18.602377 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c9a07-30a8-49d7-9bc8-d360a52b9a32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:18.604339 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c9a07-30a8-49d7-9bc8-d360a52b9a32 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:18.614012 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2e7ab-ba14-419a-bb1e-56e2515934b9 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:18.617448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-58e2e7ab-ba14-419a-bb1e-56e2515934b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:18.642009 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2e7ab-ba14-419a-bb1e-56e2515934b9 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:18.645611 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658f406-bfd2-4a8a-b665-539103a0a74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:18.646646 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658f406-bfd2-4a8a-b665-539103a0a74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:18.647105 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658f406-bfd2-4a8a-b665-539103a0a74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:18.647413 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658f406-bfd2-4a8a-b665-539103a0a74e admin admin] PATH_INFO: `/v3/projects/9610159a1e7e4a059a582a061ef5acbf` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:18.649087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658f406-bfd2-4a8a-b665-539103a0a74e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9610159a1e7e4a059a582a061ef5acbf)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:18.651088 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658f406-bfd2-4a8a-b665-539103a0a74e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:18.725705 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1016/2022] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:27:18 2022] POST /identity/v3/projects => generated 407 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:27:18.727390 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c9a07-30a8-49d7-9bc8-d360a52b9a32 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:18.805012 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6658f406-bfd2-4a8a-b665-539103a0a74e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9610159a1e7e4a059a582a061ef5acbf', 'request_id': 'req-6658f406-bfd2-4a8a-b665-539103a0a74e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:18.805645 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c9a07-30a8-49d7-9bc8-d360a52b9a32 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:18.811057 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6658f406-bfd2-4a8a-b665-539103a0a74e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9610159a1e7e4a059a582a061ef5acbf', 'request_id': 'req-6658f406-bfd2-4a8a-b665-539103a0a74e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:18.866990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50efb44-4d56-4625-bdd0-bf6e33886fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:18.867585 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50efb44-4d56-4625-bdd0-bf6e33886fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:18.867870 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50efb44-4d56-4625-bdd0-bf6e33886fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:18.868145 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50efb44-4d56-4625-bdd0-bf6e33886fe7 admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:18.868829 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50efb44-4d56-4625-bdd0-bf6e33886fe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:18.870776 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50efb44-4d56-4625-bdd0-bf6e33886fe7 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:18.939425 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6658f406-bfd2-4a8a-b665-539103a0a74e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9610159a1e7e4a059a582a061ef5acbf', 'request_id': 'req-6658f406-bfd2-4a8a-b665-539103a0a74e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:18.952336 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6658f406-bfd2-4a8a-b665-539103a0a74e admin admin] The token cache is being invalidate because project 9610159a1e7e4a059a582a061ef5acbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:27:18.952855 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6658f406-bfd2-4a8a-b665-539103a0a74e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:18.953540 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6658f406-bfd2-4a8a-b665-539103a0a74e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:18.955184 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1007/2023] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:27:18 2022] DELETE /identity/v3/projects/9610159a1e7e4a059a582a061ef5acbf => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:27:18.982824 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1017/2024] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:27:18 2022] POST /identity/v3/users => generated 310 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:27:18.987427 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658f406-bfd2-4a8a-b665-539103a0a74e admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:18.988966 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6658f406-bfd2-4a8a-b665-539103a0a74e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:19.010407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658f406-bfd2-4a8a-b665-539103a0a74e admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:19.019872 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db7a03-d7ee-41a6-bf99-0c3047b8607b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:19.019872 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db7a03-d7ee-41a6-bf99-0c3047b8607b admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:19.019872 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db7a03-d7ee-41a6-bf99-0c3047b8607b admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:19.019872 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db7a03-d7ee-41a6-bf99-0c3047b8607b admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:19.020216 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db7a03-d7ee-41a6-bf99-0c3047b8607b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:19.024687 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db7a03-d7ee-41a6-bf99-0c3047b8607b admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:19.039841 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1008/2025] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:27:19.043827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50efb44-4d56-4625-bdd0-bf6e33886fe7 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:19.059538 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50efb44-4d56-4625-bdd0-bf6e33886fe7 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:19.065630 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07828144-9dc2-4592-ae30-5d836eec3234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:19.067105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07828144-9dc2-4592-ae30-5d836eec3234 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:19.067583 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07828144-9dc2-4592-ae30-5d836eec3234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:19.068041 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07828144-9dc2-4592-ae30-5d836eec3234 admin admin] PATH_INFO: `/v3/projects/31b26b845fd34b7facc09bf5d671c8b6/users/57fadc2b54bf4ab4b5a8dd3b42cff97c/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:19.097178 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07828144-9dc2-4592-ae30-5d836eec3234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31b26b845fd34b7facc09bf5d671c8b6, user_id=57fadc2b54bf4ab4b5a8dd3b42cff97c, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:19.102525 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07828144-9dc2-4592-ae30-5d836eec3234 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:19.128111 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:19.206234 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1018/2026] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:27:19 2022] PUT /identity/v3/projects/31b26b845fd34b7facc09bf5d671c8b6/users/57fadc2b54bf4ab4b5a8dd3b42cff97c/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:19.211349 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db7a03-d7ee-41a6-bf99-0c3047b8607b admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:19.223472 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db7a03-d7ee-41a6-bf99-0c3047b8607b admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:19.297392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168715ba-d5f4-42e1-9628-cf779880ef52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:19.298109 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168715ba-d5f4-42e1-9628-cf779880ef52 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:19.298401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168715ba-d5f4-42e1-9628-cf779880ef52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:19.298685 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168715ba-d5f4-42e1-9628-cf779880ef52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:19.299456 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168715ba-d5f4-42e1-9628-cf779880ef52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:19.301068 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168715ba-d5f4-42e1-9628-cf779880ef52 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:19.312074 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1009/2027] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:27:19.317021 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07828144-9dc2-4592-ae30-5d836eec3234 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:19.331655 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07828144-9dc2-4592-ae30-5d836eec3234 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:19.337615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29633e-c53b-4c2f-a601-fc46a5f23414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:19.338702 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29633e-c53b-4c2f-a601-fc46a5f23414 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:19.338997 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29633e-c53b-4c2f-a601-fc46a5f23414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:19.339282 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29633e-c53b-4c2f-a601-fc46a5f23414 admin admin] PATH_INFO: `/v3/projects/31b26b845fd34b7facc09bf5d671c8b6/users/57fadc2b54bf4ab4b5a8dd3b42cff97c/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:19.341312 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29633e-c53b-4c2f-a601-fc46a5f23414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31b26b845fd34b7facc09bf5d671c8b6, user_id=57fadc2b54bf4ab4b5a8dd3b42cff97c, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:19.356793 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29633e-c53b-4c2f-a601-fc46a5f23414 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:19.382126 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1019/2028] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:27:19 2022] PUT /identity/v3/projects/31b26b845fd34b7facc09bf5d671c8b6/users/57fadc2b54bf4ab4b5a8dd3b42cff97c/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:19.392632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cd62f-3e2e-4e89-8d7f-60b934e3c0e2 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:19.392924 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cd62f-3e2e-4e89-8d7f-60b934e3c0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:19.393208 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cd62f-3e2e-4e89-8d7f-60b934e3c0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:19.422236 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-6c6cd62f-3e2e-4e89-8d7f-60b934e3c0e2 None None] MFA Rules not processed for user `57fadc2b54bf4ab4b5a8dd3b42cff97c`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:19.424420 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6c6cd62f-3e2e-4e89-8d7f-60b934e3c0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:19.511583 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1010/2029] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:19 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:19.522440 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29633e-c53b-4c2f-a601-fc46a5f23414 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:19.525130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-fc29633e-c53b-4c2f-a601-fc46a5f23414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:19.611110 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29633e-c53b-4c2f-a601-fc46a5f23414 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:19.615355 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18665e5a-ccf5-4e3f-aa9a-8966de9848d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:19.616158 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18665e5a-ccf5-4e3f-aa9a-8966de9848d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:19.616514 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18665e5a-ccf5-4e3f-aa9a-8966de9848d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:19.616862 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18665e5a-ccf5-4e3f-aa9a-8966de9848d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:19.627958 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18665e5a-ccf5-4e3f-aa9a-8966de9848d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:19.629692 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18665e5a-ccf5-4e3f-aa9a-8966de9848d8 service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:19.641108 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1020/2030] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:27:19 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:27:20.098686 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cd62f-3e2e-4e89-8d7f-60b934e3c0e2 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:20.109548 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cd62f-3e2e-4e89-8d7f-60b934e3c0e2 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:20.113125 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef034148-a478-4ac5-bb3e-69de9f057c26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:20.113786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef034148-a478-4ac5-bb3e-69de9f057c26 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:20.114098 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef034148-a478-4ac5-bb3e-69de9f057c26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:20.114445 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef034148-a478-4ac5-bb3e-69de9f057c26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:20.117071 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ef034148-a478-4ac5-bb3e-69de9f057c26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:20.194055 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef034148-a478-4ac5-bb3e-69de9f057c26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:20.196149 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef034148-a478-4ac5-bb3e-69de9f057c26 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:20.207927 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1011/2031] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:27:20 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:27:20.345632 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:21.911118 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e0a18-e6a3-4844-b386-d520152a8c44 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:21.911685 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e0a18-e6a3-4844-b386-d520152a8c44 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:21.915928 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e0a18-e6a3-4844-b386-d520152a8c44 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:21.915928 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1021/2032] 10.222.0.23 () {54 vars in 921 bytes} [Mon Jul 11 11:27:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:27:21.923476 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c750279-9692-4321-a413-16a096bae9b4 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:21.924440 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c750279-9692-4321-a413-16a096bae9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:21.924969 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c750279-9692-4321-a413-16a096bae9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:21.967586 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-0c750279-9692-4321-a413-16a096bae9b4 None None] MFA Rules not processed for user `12b7c9264495433985185332778dbc8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:21.968922 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-0c750279-9692-4321-a413-16a096bae9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:22.038728 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1012/2033] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Jul 11 11:27:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:27:22.056950 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e0a18-e6a3-4844-b386-d520152a8c44 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:22.063385 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:22.063620 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-2d6e0a18-e6a3-4844-b386-d520152a8c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:22.101832 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e0a18-e6a3-4844-b386-d520152a8c44 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:22.108403 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272399f-a34f-433a-b435-a926caf035e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b7c9264495433985185332778dbc8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:22.109263 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272399f-a34f-433a-b435-a926caf035e7 service placement] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:22.109555 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272399f-a34f-433a-b435-a926caf035e7 service placement] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:22.109890 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272399f-a34f-433a-b435-a926caf035e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:22.122426 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272399f-a34f-433a-b435-a926caf035e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:22.124728 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272399f-a34f-433a-b435-a926caf035e7 service placement] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:22.138605 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1022/2034] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:27:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:27:22.160704 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c750279-9692-4321-a413-16a096bae9b4 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:22.164553 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-0c750279-9692-4321-a413-16a096bae9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:22.237720 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c750279-9692-4321-a413-16a096bae9b4 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:22.243603 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5c558-90be-4bf4-bb30-2f8830ea5c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:22.244470 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5c558-90be-4bf4-bb30-2f8830ea5c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:22.244756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5c558-90be-4bf4-bb30-2f8830ea5c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:22.245031 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5c558-90be-4bf4-bb30-2f8830ea5c5a admin admin] PATH_INFO: `/v3/users/d5d47cb8d622421195d3eed6bfcf2e97` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:22.246267 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5c558-90be-4bf4-bb30-2f8830ea5c5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5d47cb8d622421195d3eed6bfcf2e97)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:22.248184 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5c558-90be-4bf4-bb30-2f8830ea5c5a admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:22.424805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64794435-795e-4226-8b08-e27bb3203be3 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:22.425104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64794435-795e-4226-8b08-e27bb3203be3 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:22.425390 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64794435-795e-4226-8b08-e27bb3203be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:22.444762 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-64794435-795e-4226-8b08-e27bb3203be3 None None] MFA Rules not processed for user `cdfa8f4012c2471b81f8749b013d3117`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:22.446067 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-64794435-795e-4226-8b08-e27bb3203be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:22.503088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1023/2035] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Jul 11 11:27:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:27:22.507977 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a4b5c558-90be-4bf4-bb30-2f8830ea5c5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5d47cb8d622421195d3eed6bfcf2e97'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:22.508704 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a4b5c558-90be-4bf4-bb30-2f8830ea5c5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5d47cb8d622421195d3eed6bfcf2e97'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:22.516189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a4b5c558-90be-4bf4-bb30-2f8830ea5c5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5d47cb8d622421195d3eed6bfcf2e97'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:22.517380 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64794435-795e-4226-8b08-e27bb3203be3 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:22.518867 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-64794435-795e-4226-8b08-e27bb3203be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:22.589300 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64794435-795e-4226-8b08-e27bb3203be3 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:22.594463 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c9da0-938e-4a4a-9da0-e5c7dfa67002 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736f6d4d1dbb47ff98bc67e53614d49c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:22.595124 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c9da0-938e-4a4a-9da0-e5c7dfa67002 service swift] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:22.595416 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c9da0-938e-4a4a-9da0-e5c7dfa67002 service swift] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:22.595699 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c9da0-938e-4a4a-9da0-e5c7dfa67002 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:22.604623 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c9da0-938e-4a4a-9da0-e5c7dfa67002 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:22.606248 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c9da0-938e-4a4a-9da0-e5c7dfa67002 service swift] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:22.614514 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1024/2036] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jul 11 11:27:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 11:27:22.631037 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a4b5c558-90be-4bf4-bb30-2f8830ea5c5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5d47cb8d622421195d3eed6bfcf2e97'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:22.646135 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a4b5c558-90be-4bf4-bb30-2f8830ea5c5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5d47cb8d622421195d3eed6bfcf2e97'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:22.652787 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1013/2037] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:27:22 2022] DELETE /identity/v3/users/d5d47cb8d622421195d3eed6bfcf2e97 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:22.935194 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c9da0-938e-4a4a-9da0-e5c7dfa67002 service swift] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:22.946050 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c9da0-938e-4a4a-9da0-e5c7dfa67002 service swift] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:22.970027 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:23.012168 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa853bc-db5f-487c-88cb-1c5b1098d0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:23.013027 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa853bc-db5f-487c-88cb-1c5b1098d0cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:23.013315 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa853bc-db5f-487c-88cb-1c5b1098d0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:23.013592 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa853bc-db5f-487c-88cb-1c5b1098d0cb admin admin] PATH_INFO: `/v3/projects/b4358d9876da4ef288a9dec2f830a652` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:23.014832 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa853bc-db5f-487c-88cb-1c5b1098d0cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4358d9876da4ef288a9dec2f830a652)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:23.027392 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa853bc-db5f-487c-88cb-1c5b1098d0cb admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:23.162182 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-7aa853bc-db5f-487c-88cb-1c5b1098d0cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4358d9876da4ef288a9dec2f830a652', 'request_id': 'req-7aa853bc-db5f-487c-88cb-1c5b1098d0cb'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:23.286363 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-7aa853bc-db5f-487c-88cb-1c5b1098d0cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4358d9876da4ef288a9dec2f830a652', 'request_id': 'req-7aa853bc-db5f-487c-88cb-1c5b1098d0cb'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:23.294914 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-7aa853bc-db5f-487c-88cb-1c5b1098d0cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4358d9876da4ef288a9dec2f830a652', 'request_id': 'req-7aa853bc-db5f-487c-88cb-1c5b1098d0cb'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:23.313029 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-7aa853bc-db5f-487c-88cb-1c5b1098d0cb admin admin] The token cache is being invalidate because project b4358d9876da4ef288a9dec2f830a652 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:27:23.313379 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-7aa853bc-db5f-487c-88cb-1c5b1098d0cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:23.314077 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-7aa853bc-db5f-487c-88cb-1c5b1098d0cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:23.315639 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1025/2038] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:27:22 2022] DELETE /identity/v3/projects/b4358d9876da4ef288a9dec2f830a652 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:23.321229 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c453c77-e25a-44b2-b9c3-2338534bd4c4 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:23.321993 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c453c77-e25a-44b2-b9c3-2338534bd4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:23.322070 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c453c77-e25a-44b2-b9c3-2338534bd4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:23.343597 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-5c453c77-e25a-44b2-b9c3-2338534bd4c4 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:23.345212 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-5c453c77-e25a-44b2-b9c3-2338534bd4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:23.385315 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:23.419737 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1014/2039] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:23.429461 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45f925-e07e-4c68-92b8-227d07ad23a4 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:23.429755 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45f925-e07e-4c68-92b8-227d07ad23a4 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:23.430063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45f925-e07e-4c68-92b8-227d07ad23a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:23.449995 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-ee45f925-e07e-4c68-92b8-227d07ad23a4 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:23.451564 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-ee45f925-e07e-4c68-92b8-227d07ad23a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:23.460288 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1026/2040] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:23.464903 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c453c77-e25a-44b2-b9c3-2338534bd4c4 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:23.475608 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c453c77-e25a-44b2-b9c3-2338534bd4c4 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:23.485675 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c09c8-f9e0-4eff-a0dc-225497358fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:23.485675 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c09c8-f9e0-4eff-a0dc-225497358fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:23.485675 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c09c8-f9e0-4eff-a0dc-225497358fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:23.485675 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c09c8-f9e0-4eff-a0dc-225497358fe3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:23.486055 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c09c8-f9e0-4eff-a0dc-225497358fe3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:27:23.486055 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c09c8-f9e0-4eff-a0dc-225497358fe3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:23.486055 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c09c8-f9e0-4eff-a0dc-225497358fe3 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:23.499086 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1015/2041] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:27:23.503250 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45f925-e07e-4c68-92b8-227d07ad23a4 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:23.514511 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45f925-e07e-4c68-92b8-227d07ad23a4 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:23.519202 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36c5aa-3314-4264-bb42-24bac3082f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:23.519858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36c5aa-3314-4264-bb42-24bac3082f72 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:23.520145 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36c5aa-3314-4264-bb42-24bac3082f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:23.520440 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36c5aa-3314-4264-bb42-24bac3082f72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:23.521133 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36c5aa-3314-4264-bb42-24bac3082f72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:23.523180 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36c5aa-3314-4264-bb42-24bac3082f72 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:23.610414 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17eb230-607c-4073-861f-13fe08dcdf76 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:23.610657 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17eb230-607c-4073-861f-13fe08dcdf76 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:23.610949 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17eb230-607c-4073-861f-13fe08dcdf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:23.621173 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1027/2042] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:27:23 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:27:23.626932 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36c5aa-3314-4264-bb42-24bac3082f72 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:23.629894 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-a17eb230-607c-4073-861f-13fe08dcdf76 None None] MFA Rules not processed for user `cdfa8f4012c2471b81f8749b013d3117`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:23.631252 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a17eb230-607c-4073-861f-13fe08dcdf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:23.697952 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1016/2043] 10.222.0.23 () {58 vars in 967 bytes} [Mon Jul 11 11:27:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:27:23.715994 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36c5aa-3314-4264-bb42-24bac3082f72 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:23.721236 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96a22b-2329-47f0-ba75-bad53b4ad07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:23.721999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96a22b-2329-47f0-ba75-bad53b4ad07f admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:23.722643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96a22b-2329-47f0-ba75-bad53b4ad07f admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:23.722936 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96a22b-2329-47f0-ba75-bad53b4ad07f admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:23.723723 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96a22b-2329-47f0-ba75-bad53b4ad07f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:23.723924 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17eb230-607c-4073-861f-13fe08dcdf76 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:23.725836 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a17eb230-607c-4073-861f-13fe08dcdf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:23.726070 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96a22b-2329-47f0-ba75-bad53b4ad07f admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:23.808183 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17eb230-607c-4073-861f-13fe08dcdf76 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:23.815176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cd9f3-e0a9-4b93-a95a-a2dd4f64e23d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736f6d4d1dbb47ff98bc67e53614d49c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:23.815986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cd9f3-e0a9-4b93-a95a-a2dd4f64e23d service swift] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:23.816979 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cd9f3-e0a9-4b93-a95a-a2dd4f64e23d service swift] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:23.816979 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cd9f3-e0a9-4b93-a95a-a2dd4f64e23d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:23.821868 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1028/2044] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:27:23 2022] POST /identity/v3/users => generated 291 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:27:23.825814 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96a22b-2329-47f0-ba75-bad53b4ad07f admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:23.828301 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cd9f3-e0a9-4b93-a95a-a2dd4f64e23d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:23.830029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cd9f3-e0a9-4b93-a95a-a2dd4f64e23d service swift] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:23.836305 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96a22b-2329-47f0-ba75-bad53b4ad07f admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:23.839997 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1017/2045] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jul 11 11:27:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 11:27:23.841871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c807961-b216-42e1-832c-81bdae6a1288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:23.848385 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c807961-b216-42e1-832c-81bdae6a1288 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:23.848385 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c807961-b216-42e1-832c-81bdae6a1288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:23.848385 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c807961-b216-42e1-832c-81bdae6a1288 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:23.848385 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c807961-b216-42e1-832c-81bdae6a1288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:23.848385 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c807961-b216-42e1-832c-81bdae6a1288 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:23.862831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1029/2046] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:27:23.863587 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cd9f3-e0a9-4b93-a95a-a2dd4f64e23d service swift] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:23.879850 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cd9f3-e0a9-4b93-a95a-a2dd4f64e23d service swift] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:23.887767 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7937a01-a75d-49a8-9e82-aaabdc89171d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:23.888456 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7937a01-a75d-49a8-9e82-aaabdc89171d admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:23.888747 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7937a01-a75d-49a8-9e82-aaabdc89171d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:23.889032 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7937a01-a75d-49a8-9e82-aaabdc89171d admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:23.889802 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7937a01-a75d-49a8-9e82-aaabdc89171d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:23.891856 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7937a01-a75d-49a8-9e82-aaabdc89171d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:23.904330 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1018/2047] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:27:23.908350 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c807961-b216-42e1-832c-81bdae6a1288 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:23.920161 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c807961-b216-42e1-832c-81bdae6a1288 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:23.933508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86443cae-3abc-4969-82b7-d1cd31d95f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:23.935765 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86443cae-3abc-4969-82b7-d1cd31d95f88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:23.936327 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86443cae-3abc-4969-82b7-d1cd31d95f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:23.936419 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86443cae-3abc-4969-82b7-d1cd31d95f88 admin admin] PATH_INFO: `/v3/projects/743947cbb2f747098204325138d71945/users/ce099e27e8644e92ba0abb06f52ce17e/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:23.955444 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86443cae-3abc-4969-82b7-d1cd31d95f88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=743947cbb2f747098204325138d71945, user_id=ce099e27e8644e92ba0abb06f52ce17e, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:23.962241 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86443cae-3abc-4969-82b7-d1cd31d95f88 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:24.106528 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1030/2048] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:27:23 2022] PUT /identity/v3/projects/743947cbb2f747098204325138d71945/users/ce099e27e8644e92ba0abb06f52ce17e/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:24.117215 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c18471-dde2-45b2-b98c-375c182f368c None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:24.117651 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c18471-dde2-45b2-b98c-375c182f368c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:24.117991 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c18471-dde2-45b2-b98c-375c182f368c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:24.144725 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-c7c18471-dde2-45b2-b98c-375c182f368c None None] MFA Rules not processed for user `ce099e27e8644e92ba0abb06f52ce17e`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:24.145993 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c7c18471-dde2-45b2-b98c-375c182f368c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:24.214874 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1019/2049] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:24.219386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86443cae-3abc-4969-82b7-d1cd31d95f88 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:24.282359 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86443cae-3abc-4969-82b7-d1cd31d95f88 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:24.287027 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235233b-9e41-4ccc-b9bc-45629d1fdaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:24.287680 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235233b-9e41-4ccc-b9bc-45629d1fdaa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:24.287966 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235233b-9e41-4ccc-b9bc-45629d1fdaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:24.288932 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235233b-9e41-4ccc-b9bc-45629d1fdaa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:24.289675 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235233b-9e41-4ccc-b9bc-45629d1fdaa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:24.291625 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235233b-9e41-4ccc-b9bc-45629d1fdaa2 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:24.371170 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:24.379359 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1031/2050] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:27:24 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:27:24.383693 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c18471-dde2-45b2-b98c-375c182f368c None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:24.394881 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c18471-dde2-45b2-b98c-375c182f368c None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:24.454812 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382a04c-95de-41b9-903a-e07c5d1f0a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:24.455494 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382a04c-95de-41b9-903a-e07c5d1f0a21 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:24.455779 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382a04c-95de-41b9-903a-e07c5d1f0a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:24.456084 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382a04c-95de-41b9-903a-e07c5d1f0a21 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:24.456761 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382a04c-95de-41b9-903a-e07c5d1f0a21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:24.459134 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382a04c-95de-41b9-903a-e07c5d1f0a21 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:24.567250 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1020/2051] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:27:24 2022] POST /identity/v3/users => generated 296 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:27:24.572437 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235233b-9e41-4ccc-b9bc-45629d1fdaa2 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:24.583927 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235233b-9e41-4ccc-b9bc-45629d1fdaa2 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:24.591717 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580abbc3-5d8e-4cc9-ace8-0b9a0f5c3c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:24.592413 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580abbc3-5d8e-4cc9-ace8-0b9a0f5c3c69 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:24.592737 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580abbc3-5d8e-4cc9-ace8-0b9a0f5c3c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:24.595273 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580abbc3-5d8e-4cc9-ace8-0b9a0f5c3c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:24.595273 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580abbc3-5d8e-4cc9-ace8-0b9a0f5c3c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:24.596019 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580abbc3-5d8e-4cc9-ace8-0b9a0f5c3c69 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:24.608247 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1032/2052] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:27:24.612973 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d10ef2-bc7f-4dd4-a556-8cb6234c9253 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:24.613269 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d10ef2-bc7f-4dd4-a556-8cb6234c9253 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:24.613553 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d10ef2-bc7f-4dd4-a556-8cb6234c9253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:24.615889 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580abbc3-5d8e-4cc9-ace8-0b9a0f5c3c69 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:24.629593 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580abbc3-5d8e-4cc9-ace8-0b9a0f5c3c69 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:24.631767 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78239c-57f9-4b57-a190-7d8fdf8b6634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:24.633331 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78239c-57f9-4b57-a190-7d8fdf8b6634 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:24.633620 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78239c-57f9-4b57-a190-7d8fdf8b6634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:24.633939 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78239c-57f9-4b57-a190-7d8fdf8b6634 admin admin] PATH_INFO: `/v3/projects/0a85c8e4f24343c581e6c3cdf3e5fc61/users/d56ece2a0fd74d88b12239c5b6ed6a0e/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:24.637813 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-59d10ef2-bc7f-4dd4-a556-8cb6234c9253 None None] MFA Rules not processed for user `cdfa8f4012c2471b81f8749b013d3117`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:24.639224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-59d10ef2-bc7f-4dd4-a556-8cb6234c9253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:24.651757 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78239c-57f9-4b57-a190-7d8fdf8b6634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a85c8e4f24343c581e6c3cdf3e5fc61, user_id=d56ece2a0fd74d88b12239c5b6ed6a0e, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:24.654739 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78239c-57f9-4b57-a190-7d8fdf8b6634 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:24.701393 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1021/2053] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Jul 11 11:27:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:27:24.715439 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d10ef2-bc7f-4dd4-a556-8cb6234c9253 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:24.779728 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1033/2054] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:27:24 2022] PUT /identity/v3/projects/0a85c8e4f24343c581e6c3cdf3e5fc61/users/d56ece2a0fd74d88b12239c5b6ed6a0e/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:24.783949 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78239c-57f9-4b57-a190-7d8fdf8b6634 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:24.820831 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d10ef2-bc7f-4dd4-a556-8cb6234c9253 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:24.858739 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78239c-57f9-4b57-a190-7d8fdf8b6634 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:24.863830 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a203fd0-14da-499e-881c-2e80b59bbaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:24.864499 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a203fd0-14da-499e-881c-2e80b59bbaba admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:24.864847 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a203fd0-14da-499e-881c-2e80b59bbaba admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:24.865171 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a203fd0-14da-499e-881c-2e80b59bbaba admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:24.865938 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a203fd0-14da-499e-881c-2e80b59bbaba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:24.867606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a203fd0-14da-499e-881c-2e80b59bbaba admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:24.877572 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1034/2055] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:27:24.881651 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a203fd0-14da-499e-881c-2e80b59bbaba admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:24.885274 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe6835-441a-4e04-89b2-9486748acce0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736f6d4d1dbb47ff98bc67e53614d49c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:24.885968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe6835-441a-4e04-89b2-9486748acce0 service swift] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:24.886254 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe6835-441a-4e04-89b2-9486748acce0 service swift] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:24.886533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe6835-441a-4e04-89b2-9486748acce0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:24.892151 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a203fd0-14da-499e-881c-2e80b59bbaba admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:24.896760 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30fbd3-b8cd-4b6e-a5a7-15c8060b247a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:24.898347 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30fbd3-b8cd-4b6e-a5a7-15c8060b247a admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:24.898636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30fbd3-b8cd-4b6e-a5a7-15c8060b247a admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:24.898912 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30fbd3-b8cd-4b6e-a5a7-15c8060b247a admin admin] PATH_INFO: `/v3/projects/0a85c8e4f24343c581e6c3cdf3e5fc61/users/d56ece2a0fd74d88b12239c5b6ed6a0e/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:24.900894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce30fbd3-b8cd-4b6e-a5a7-15c8060b247a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a85c8e4f24343c581e6c3cdf3e5fc61, user_id=d56ece2a0fd74d88b12239c5b6ed6a0e, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:24.903556 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce30fbd3-b8cd-4b6e-a5a7-15c8060b247a admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:24.913848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1035/2056] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:27:24 2022] PUT /identity/v3/projects/0a85c8e4f24343c581e6c3cdf3e5fc61/users/d56ece2a0fd74d88b12239c5b6ed6a0e/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:27:24.924306 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd617b3-ddb1-4c51-b452-e35477809861 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:24.924629 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd617b3-ddb1-4c51-b452-e35477809861 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:24.924911 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd617b3-ddb1-4c51-b452-e35477809861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:24.947215 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe6835-441a-4e04-89b2-9486748acce0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:24.948822 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe6835-441a-4e04-89b2-9486748acce0 service swift] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:24.953701 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-cdd617b3-ddb1-4c51-b452-e35477809861 None None] MFA Rules not processed for user `d56ece2a0fd74d88b12239c5b6ed6a0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:24.955600 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-cdd617b3-ddb1-4c51-b452-e35477809861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:24.957010 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1022/2057] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jul 11 11:27:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 11:27:25.024243 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1036/2058] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:24 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:27:25.035516 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe6835-441a-4e04-89b2-9486748acce0 service swift] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:25.036912 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4bfe6835-441a-4e04-89b2-9486748acce0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:25.096141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe6835-441a-4e04-89b2-9486748acce0 service swift] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:25.146220 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2519a4-56df-443d-b0f5-dcbc01dc9724 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:25.147277 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2519a4-56df-443d-b0f5-dcbc01dc9724 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:25.148208 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2519a4-56df-443d-b0f5-dcbc01dc9724 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:25.148586 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2519a4-56df-443d-b0f5-dcbc01dc9724 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:25.159747 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2519a4-56df-443d-b0f5-dcbc01dc9724 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:25.161180 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2519a4-56df-443d-b0f5-dcbc01dc9724 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:25.172925 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1023/2059] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:27:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:27:25.518111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd617b3-ddb1-4c51-b452-e35477809861 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:25.528712 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd617b3-ddb1-4c51-b452-e35477809861 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:25.532547 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b601a1-1ee6-4c40-ad70-b42027809d53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:25.533191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b601a1-1ee6-4c40-ad70-b42027809d53 service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:25.533474 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b601a1-1ee6-4c40-ad70-b42027809d53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:25.533748 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b601a1-1ee6-4c40-ad70-b42027809d53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:25.592716 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b601a1-1ee6-4c40-ad70-b42027809d53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:25.594775 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b601a1-1ee6-4c40-ad70-b42027809d53 service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:25.603597 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1037/2060] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:27:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:27:25.648939 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:25.789400 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2708a-9d4d-474b-8b65-e34438d82ed3 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:25.789644 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2708a-9d4d-474b-8b65-e34438d82ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:25.789961 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2708a-9d4d-474b-8b65-e34438d82ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:25.809062 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-2bf2708a-9d4d-474b-8b65-e34438d82ed3 None None] MFA Rules not processed for user `cdfa8f4012c2471b81f8749b013d3117`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:25.810341 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2bf2708a-9d4d-474b-8b65-e34438d82ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:25.865538 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:25.873771 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1024/2061] 10.222.0.23 () {58 vars in 967 bytes} [Mon Jul 11 11:27:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:25.886862 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b601a1-1ee6-4c40-ad70-b42027809d53 service cinder] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:25.955182 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b601a1-1ee6-4c40-ad70-b42027809d53 service cinder] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:25.961307 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649274ef-c5da-42ab-b4b7-cbbb755bbe93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736f6d4d1dbb47ff98bc67e53614d49c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:25.961997 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649274ef-c5da-42ab-b4b7-cbbb755bbe93 service swift] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:25.962299 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649274ef-c5da-42ab-b4b7-cbbb755bbe93 service swift] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:25.962573 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649274ef-c5da-42ab-b4b7-cbbb755bbe93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:25.971101 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649274ef-c5da-42ab-b4b7-cbbb755bbe93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:25.972755 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649274ef-c5da-42ab-b4b7-cbbb755bbe93 service swift] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:25.981309 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1038/2062] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jul 11 11:27:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 11:27:27.168279 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:27.716832 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:28.018590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:28.972535 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:29.255414 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2708a-9d4d-474b-8b65-e34438d82ed3 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:29.257362 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2bf2708a-9d4d-474b-8b65-e34438d82ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:29.325045 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2708a-9d4d-474b-8b65-e34438d82ed3 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:29.329661 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01c61f-2be0-4392-8bdb-531cc68549f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:29.330563 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01c61f-2be0-4392-8bdb-531cc68549f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:29.330849 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01c61f-2be0-4392-8bdb-531cc68549f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:29.331131 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01c61f-2be0-4392-8bdb-531cc68549f4 admin admin] PATH_INFO: `/v3/users/7befd8480d7245be86794e71785cd2ae` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:29.332398 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01c61f-2be0-4392-8bdb-531cc68549f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7befd8480d7245be86794e71785cd2ae)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:29.334383 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01c61f-2be0-4392-8bdb-531cc68549f4 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:29.552255 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3d01c61f-2be0-4392-8bdb-531cc68549f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7befd8480d7245be86794e71785cd2ae'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:29.552930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3d01c61f-2be0-4392-8bdb-531cc68549f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7befd8480d7245be86794e71785cd2ae'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:29.560309 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3d01c61f-2be0-4392-8bdb-531cc68549f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7befd8480d7245be86794e71785cd2ae'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:29.634256 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649274ef-c5da-42ab-b4b7-cbbb755bbe93 service swift] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:29.635971 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-649274ef-c5da-42ab-b4b7-cbbb755bbe93 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:29.641645 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3d01c61f-2be0-4392-8bdb-531cc68549f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7befd8480d7245be86794e71785cd2ae'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:29.650995 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649274ef-c5da-42ab-b4b7-cbbb755bbe93 service swift] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:29.655869 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3e525-7943-479b-9e59-0a7e8ecac7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:29.656855 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3d01c61f-2be0-4392-8bdb-531cc68549f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7befd8480d7245be86794e71785cd2ae'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:29.657005 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3e525-7943-479b-9e59-0a7e8ecac7d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:29.657145 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3e525-7943-479b-9e59-0a7e8ecac7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:29.657380 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3e525-7943-479b-9e59-0a7e8ecac7d0 admin admin] PATH_INFO: `/v3/users/24e42e0322a1480baadc090a57b7a80b` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:29.658630 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3e525-7943-479b-9e59-0a7e8ecac7d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24e42e0322a1480baadc090a57b7a80b)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:29.660526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3e525-7943-479b-9e59-0a7e8ecac7d0 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:29.668931 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1025/2063] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:27:29 2022] DELETE /identity/v3/users/7befd8480d7245be86794e71785cd2ae => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:29.670714 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929acadb-952d-4242-9fea-cda044b2e326 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:29.671026 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929acadb-952d-4242-9fea-cda044b2e326 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:29.671382 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929acadb-952d-4242-9fea-cda044b2e326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:29.692691 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-929acadb-952d-4242-9fea-cda044b2e326 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:29.737590 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-929acadb-952d-4242-9fea-cda044b2e326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:29.755711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1026/2064] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:27:29.767666 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929acadb-952d-4242-9fea-cda044b2e326 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:29.769334 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-929acadb-952d-4242-9fea-cda044b2e326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:29.849644 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929acadb-952d-4242-9fea-cda044b2e326 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:29.849644 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00693ca-9642-4aec-9a3f-b2566af37d6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:29.849644 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00693ca-9642-4aec-9a3f-b2566af37d6d service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:29.849644 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00693ca-9642-4aec-9a3f-b2566af37d6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:29.850397 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00693ca-9642-4aec-9a3f-b2566af37d6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:29.850397 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00693ca-9642-4aec-9a3f-b2566af37d6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:29.850397 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00693ca-9642-4aec-9a3f-b2566af37d6d service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:29.856018 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1027/2065] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:27:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:27:30.043916 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-36a3e525-7943-479b-9e59-0a7e8ecac7d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24e42e0322a1480baadc090a57b7a80b'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:30.173481 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-36a3e525-7943-479b-9e59-0a7e8ecac7d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24e42e0322a1480baadc090a57b7a80b'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:30.181926 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-36a3e525-7943-479b-9e59-0a7e8ecac7d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24e42e0322a1480baadc090a57b7a80b'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:30.182589 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-36a3e525-7943-479b-9e59-0a7e8ecac7d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24e42e0322a1480baadc090a57b7a80b'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:30.183206 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-36a3e525-7943-479b-9e59-0a7e8ecac7d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24e42e0322a1480baadc090a57b7a80b'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:30.200747 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1039/2066] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:27:29 2022] DELETE /identity/v3/users/24e42e0322a1480baadc090a57b7a80b => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:27:30.203424 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:30.205141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e41660-0abb-403a-b55e-dc664f71c4a3 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:30.205516 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e41660-0abb-403a-b55e-dc664f71c4a3 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:30.205825 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e41660-0abb-403a-b55e-dc664f71c4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:30.223463 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-32e41660-0abb-403a-b55e-dc664f71c4a3 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:30.224664 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-32e41660-0abb-403a-b55e-dc664f71c4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:30.289326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1028/2067] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:30.300572 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3e525-7943-479b-9e59-0a7e8ecac7d0 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:30.302060 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-36a3e525-7943-479b-9e59-0a7e8ecac7d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:30.368182 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3e525-7943-479b-9e59-0a7e8ecac7d0 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:30.372111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518ffbb-e4c0-4ce3-9935-a0bf5e35517a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:30.372827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518ffbb-e4c0-4ce3-9935-a0bf5e35517a service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:30.373725 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518ffbb-e4c0-4ce3-9935-a0bf5e35517a service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:30.374407 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518ffbb-e4c0-4ce3-9935-a0bf5e35517a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:30.384901 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518ffbb-e4c0-4ce3-9935-a0bf5e35517a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:30.386443 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518ffbb-e4c0-4ce3-9935-a0bf5e35517a service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:30.400130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1040/2068] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:27:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:27:30.514185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e41660-0abb-403a-b55e-dc664f71c4a3 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:30.515686 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-32e41660-0abb-403a-b55e-dc664f71c4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:30.530563 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e41660-0abb-403a-b55e-dc664f71c4a3 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:30.540053 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251d3f5-6d4e-4731-a864-2dd4a601b2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:30.546810 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251d3f5-6d4e-4731-a864-2dd4a601b2e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:30.547110 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251d3f5-6d4e-4731-a864-2dd4a601b2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:30.547393 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251d3f5-6d4e-4731-a864-2dd4a601b2e9 admin admin] PATH_INFO: `/v3/projects/b220990b59734b9eac33ec1c3f3a76df` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:30.549374 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251d3f5-6d4e-4731-a864-2dd4a601b2e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b220990b59734b9eac33ec1c3f3a76df)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:30.551921 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251d3f5-6d4e-4731-a864-2dd4a601b2e9 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:30.626849 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518ffbb-e4c0-4ce3-9935-a0bf5e35517a service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:30.628317 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-9518ffbb-e4c0-4ce3-9935-a0bf5e35517a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:30.642389 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518ffbb-e4c0-4ce3-9935-a0bf5e35517a service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:30.648143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554973c-0062-43cf-b503-d4920778dbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:30.649021 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554973c-0062-43cf-b503-d4920778dbfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:30.649476 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554973c-0062-43cf-b503-d4920778dbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:30.649787 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554973c-0062-43cf-b503-d4920778dbfb admin admin] PATH_INFO: `/v3/projects/6fcefda8be6c4727a93645075e72c217` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:30.651009 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0554973c-0062-43cf-b503-d4920778dbfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fcefda8be6c4727a93645075e72c217)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:30.652983 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0554973c-0062-43cf-b503-d4920778dbfb admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:30.682625 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6251d3f5-6d4e-4731-a864-2dd4a601b2e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b220990b59734b9eac33ec1c3f3a76df', 'request_id': 'req-6251d3f5-6d4e-4731-a864-2dd4a601b2e9'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:30.688015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6251d3f5-6d4e-4731-a864-2dd4a601b2e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b220990b59734b9eac33ec1c3f3a76df', 'request_id': 'req-6251d3f5-6d4e-4731-a864-2dd4a601b2e9'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:30.711756 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:30.757577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-0554973c-0062-43cf-b503-d4920778dbfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fcefda8be6c4727a93645075e72c217', 'request_id': 'req-0554973c-0062-43cf-b503-d4920778dbfb'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:30.790756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6251d3f5-6d4e-4731-a864-2dd4a601b2e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b220990b59734b9eac33ec1c3f3a76df', 'request_id': 'req-6251d3f5-6d4e-4731-a864-2dd4a601b2e9'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:30.802965 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6251d3f5-6d4e-4731-a864-2dd4a601b2e9 admin admin] The token cache is being invalidate because project b220990b59734b9eac33ec1c3f3a76df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:27:30.806034 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6251d3f5-6d4e-4731-a864-2dd4a601b2e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:30.806034 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6251d3f5-6d4e-4731-a864-2dd4a601b2e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:30.806034 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1029/2069] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:27:30 2022] DELETE /identity/v3/projects/b220990b59734b9eac33ec1c3f3a76df => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:30.809639 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251d3f5-6d4e-4731-a864-2dd4a601b2e9 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:30.811057 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6251d3f5-6d4e-4731-a864-2dd4a601b2e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:30.874923 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-0554973c-0062-43cf-b503-d4920778dbfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fcefda8be6c4727a93645075e72c217', 'request_id': 'req-0554973c-0062-43cf-b503-d4920778dbfb'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:30.876736 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251d3f5-6d4e-4731-a864-2dd4a601b2e9 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:30.879625 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-0554973c-0062-43cf-b503-d4920778dbfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fcefda8be6c4727a93645075e72c217', 'request_id': 'req-0554973c-0062-43cf-b503-d4920778dbfb'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:30.892353 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-0554973c-0062-43cf-b503-d4920778dbfb admin admin] The token cache is being invalidate because project 6fcefda8be6c4727a93645075e72c217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:27:30.892716 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-0554973c-0062-43cf-b503-d4920778dbfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:30.893391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-0554973c-0062-43cf-b503-d4920778dbfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:30.898987 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1041/2070] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:27:30 2022] DELETE /identity/v3/projects/6fcefda8be6c4727a93645075e72c217 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:27:30.900869 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b86fc-1ad3-4869-b0ec-003d61ea1159 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:30.901166 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b86fc-1ad3-4869-b0ec-003d61ea1159 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:30.904801 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b86fc-1ad3-4869-b0ec-003d61ea1159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:30.921450 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-ef6b86fc-1ad3-4869-b0ec-003d61ea1159 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:30.922806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-ef6b86fc-1ad3-4869-b0ec-003d61ea1159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:30.942297 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42d36d-105a-49c0-aec5-707726c3a4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:30.943200 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42d36d-105a-49c0-aec5-707726c3a4f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:30.943488 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42d36d-105a-49c0-aec5-707726c3a4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:30.944257 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42d36d-105a-49c0-aec5-707726c3a4f8 admin admin] PATH_INFO: `/v3/users/57fadc2b54bf4ab4b5a8dd3b42cff97c` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:30.946981 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42d36d-105a-49c0-aec5-707726c3a4f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57fadc2b54bf4ab4b5a8dd3b42cff97c)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:30.948989 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42d36d-105a-49c0-aec5-707726c3a4f8 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:30.994183 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1042/2071] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:27:31.002256 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016443f-f950-4339-8867-9eb60c4b9e00 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:31.002641 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016443f-f950-4339-8867-9eb60c4b9e00 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:31.003048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016443f-f950-4339-8867-9eb60c4b9e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:31.028342 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-0016443f-f950-4339-8867-9eb60c4b9e00 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:31.029813 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-0016443f-f950-4339-8867-9eb60c4b9e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:31.040105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1043/2072] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:31.043954 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016443f-f950-4339-8867-9eb60c4b9e00 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:31.056907 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016443f-f950-4339-8867-9eb60c4b9e00 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:31.062100 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23d141-cdff-45f9-88de-cc416f4f0eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:31.062702 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23d141-cdff-45f9-88de-cc416f4f0eeb admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:31.062986 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23d141-cdff-45f9-88de-cc416f4f0eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:31.063254 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23d141-cdff-45f9-88de-cc416f4f0eeb admin admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:31.064011 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23d141-cdff-45f9-88de-cc416f4f0eeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:27:31.064324 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23d141-cdff-45f9-88de-cc416f4f0eeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:31.066187 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23d141-cdff-45f9-88de-cc416f4f0eeb admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:31.088252 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1044/2073] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:27:31.089525 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23d141-cdff-45f9-88de-cc416f4f0eeb admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:31.101119 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23d141-cdff-45f9-88de-cc416f4f0eeb admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:31.107224 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86683e-723d-4076-86c4-af49200f8796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:31.107447 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86683e-723d-4076-86c4-af49200f8796 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:31.107700 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86683e-723d-4076-86c4-af49200f8796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:31.108013 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86683e-723d-4076-86c4-af49200f8796 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:31.108865 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86683e-723d-4076-86c4-af49200f8796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:31.111030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86683e-723d-4076-86c4-af49200f8796 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:31.166098 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bb42d36d-105a-49c0-aec5-707726c3a4f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57fadc2b54bf4ab4b5a8dd3b42cff97c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:31.168001 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bb42d36d-105a-49c0-aec5-707726c3a4f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57fadc2b54bf4ab4b5a8dd3b42cff97c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:31.177570 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bb42d36d-105a-49c0-aec5-707726c3a4f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57fadc2b54bf4ab4b5a8dd3b42cff97c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:31.269653 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1045/2074] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:27:31 2022] POST /identity/v3/projects => generated 383 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:27:31.273589 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86683e-723d-4076-86c4-af49200f8796 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:31.274726 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bb42d36d-105a-49c0-aec5-707726c3a4f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57fadc2b54bf4ab4b5a8dd3b42cff97c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:31.309698 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bb42d36d-105a-49c0-aec5-707726c3a4f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57fadc2b54bf4ab4b5a8dd3b42cff97c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:31.312642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1030/2075] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:27:30 2022] DELETE /identity/v3/users/57fadc2b54bf4ab4b5a8dd3b42cff97c => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:31.362053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86683e-723d-4076-86c4-af49200f8796 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:31.431568 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8ca82-bb79-4002-bef5-6b7ccb3cb819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:31.432543 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8ca82-bb79-4002-bef5-6b7ccb3cb819 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:31.433087 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8ca82-bb79-4002-bef5-6b7ccb3cb819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:31.433512 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8ca82-bb79-4002-bef5-6b7ccb3cb819 admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:31.434451 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d8ca82-bb79-4002-bef5-6b7ccb3cb819 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:31.437578 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d8ca82-bb79-4002-bef5-6b7ccb3cb819 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:31.536340 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1046/2076] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:27:31 2022] POST /identity/v3/users => generated 292 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:27:31.543098 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42d36d-105a-49c0-aec5-707726c3a4f8 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:31.543098 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-bb42d36d-105a-49c0-aec5-707726c3a4f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:31.557221 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42d36d-105a-49c0-aec5-707726c3a4f8 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:31.562072 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37221e-195b-4581-aa90-d4a0b0e5ff04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:31.562749 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37221e-195b-4581-aa90-d4a0b0e5ff04 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:31.563077 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37221e-195b-4581-aa90-d4a0b0e5ff04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:31.563359 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37221e-195b-4581-aa90-d4a0b0e5ff04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:31.564092 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37221e-195b-4581-aa90-d4a0b0e5ff04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:31.565680 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37221e-195b-4581-aa90-d4a0b0e5ff04 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:31.576198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1031/2077] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:27:31.580248 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8ca82-bb79-4002-bef5-6b7ccb3cb819 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:31.591257 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8ca82-bb79-4002-bef5-6b7ccb3cb819 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:31.596154 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fd0d5-333f-4f9c-9b25-84afdab46852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:31.597147 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fd0d5-333f-4f9c-9b25-84afdab46852 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:31.597307 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fd0d5-333f-4f9c-9b25-84afdab46852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:31.597584 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fd0d5-333f-4f9c-9b25-84afdab46852 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:31.598366 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8fd0d5-333f-4f9c-9b25-84afdab46852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:31.599949 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8fd0d5-333f-4f9c-9b25-84afdab46852 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:31.610719 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1047/2078] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:27:31.614933 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37221e-195b-4581-aa90-d4a0b0e5ff04 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:31.625361 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:31.631570 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37221e-195b-4581-aa90-d4a0b0e5ff04 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:31.633672 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55eb435-901c-4745-b146-6f3fbb57f83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:31.634864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55eb435-901c-4745-b146-6f3fbb57f83f admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:31.635259 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55eb435-901c-4745-b146-6f3fbb57f83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:31.635665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55eb435-901c-4745-b146-6f3fbb57f83f admin admin] PATH_INFO: `/v3/projects/312d1dffbc63477f9c3d743d08e19ff9/users/58581f894dbd470a97bd92580323ac56/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:31.652289 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55eb435-901c-4745-b146-6f3fbb57f83f admin admin] RBAC: Authorizing `identity:create_grant(project_id=312d1dffbc63477f9c3d743d08e19ff9, user_id=58581f894dbd470a97bd92580323ac56, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:31.655333 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55eb435-901c-4745-b146-6f3fbb57f83f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:31.815473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fd0d5-333f-4f9c-9b25-84afdab46852 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:31.819252 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1032/2079] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:27:31 2022] PUT /identity/v3/projects/312d1dffbc63477f9c3d743d08e19ff9/users/58581f894dbd470a97bd92580323ac56/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:31.819462 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-ed8fd0d5-333f-4f9c-9b25-84afdab46852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:31.822751 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa23f8-ce45-472f-ad48-a9b324c35b10 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:31.823166 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa23f8-ce45-472f-ad48-a9b324c35b10 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:31.824464 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa23f8-ce45-472f-ad48-a9b324c35b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:31.846660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-e3aa23f8-ce45-472f-ad48-a9b324c35b10 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:31.847213 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fd0d5-333f-4f9c-9b25-84afdab46852 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:31.847308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e3aa23f8-ce45-472f-ad48-a9b324c35b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:31.904108 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d18b5-a679-4aa9-b730-6258b8cadd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:31.904887 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d18b5-a679-4aa9-b730-6258b8cadd06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:31.905177 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d18b5-a679-4aa9-b730-6258b8cadd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:31.905459 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d18b5-a679-4aa9-b730-6258b8cadd06 admin admin] PATH_INFO: `/v3/projects/31b26b845fd34b7facc09bf5d671c8b6` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:31.906060 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1033/2080] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:31.907053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d18b5-a679-4aa9-b730-6258b8cadd06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31b26b845fd34b7facc09bf5d671c8b6)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:31.909013 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d18b5-a679-4aa9-b730-6258b8cadd06 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:31.916625 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa23f8-ce45-472f-ad48-a9b324c35b10 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:31.918263 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e3aa23f8-ce45-472f-ad48-a9b324c35b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:31.977118 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa23f8-ce45-472f-ad48-a9b324c35b10 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:31.980928 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126df5a-32eb-4693-aee0-2b6905dbdfd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:31.981578 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126df5a-32eb-4693-aee0-2b6905dbdfd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:31.981915 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126df5a-32eb-4693-aee0-2b6905dbdfd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:31.982199 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126df5a-32eb-4693-aee0-2b6905dbdfd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:31.991879 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126df5a-32eb-4693-aee0-2b6905dbdfd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:31.993305 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126df5a-32eb-4693-aee0-2b6905dbdfd8 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:32.002838 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1034/2081] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:27:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:27:32.100354 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ca3d18b5-a679-4aa9-b730-6258b8cadd06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31b26b845fd34b7facc09bf5d671c8b6', 'request_id': 'req-ca3d18b5-a679-4aa9-b730-6258b8cadd06'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:32.159011 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ca3d18b5-a679-4aa9-b730-6258b8cadd06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31b26b845fd34b7facc09bf5d671c8b6', 'request_id': 'req-ca3d18b5-a679-4aa9-b730-6258b8cadd06'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:32.165294 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ca3d18b5-a679-4aa9-b730-6258b8cadd06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31b26b845fd34b7facc09bf5d671c8b6', 'request_id': 'req-ca3d18b5-a679-4aa9-b730-6258b8cadd06'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:32.176610 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ca3d18b5-a679-4aa9-b730-6258b8cadd06 admin admin] The token cache is being invalidate because project 31b26b845fd34b7facc09bf5d671c8b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:27:32.176904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ca3d18b5-a679-4aa9-b730-6258b8cadd06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:32.177558 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ca3d18b5-a679-4aa9-b730-6258b8cadd06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:32.179228 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1048/2082] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:27:31 2022] DELETE /identity/v3/projects/31b26b845fd34b7facc09bf5d671c8b6 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:27:32.184299 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8cc45-71c2-4e50-92c3-c0b4575db3ef None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:32.184599 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8cc45-71c2-4e50-92c3-c0b4575db3ef None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:32.184910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8cc45-71c2-4e50-92c3-c0b4575db3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:32.204341 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-09f8cc45-71c2-4e50-92c3-c0b4575db3ef None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:32.206669 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-09f8cc45-71c2-4e50-92c3-c0b4575db3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:32.264951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1035/2083] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:32.273845 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42357d42-7783-48f8-a0bb-75d9d54069fe None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:32.274139 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42357d42-7783-48f8-a0bb-75d9d54069fe None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:32.274419 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42357d42-7783-48f8-a0bb-75d9d54069fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:32.292973 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-42357d42-7783-48f8-a0bb-75d9d54069fe None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:32.294505 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-42357d42-7783-48f8-a0bb-75d9d54069fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:32.303301 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1049/2084] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:32.307875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8cc45-71c2-4e50-92c3-c0b4575db3ef None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:32.324328 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8cc45-71c2-4e50-92c3-c0b4575db3ef None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:32.331889 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edd136-d073-4961-9725-f17c28553379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:32.332896 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edd136-d073-4961-9725-f17c28553379 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:32.333378 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edd136-d073-4961-9725-f17c28553379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:32.333910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edd136-d073-4961-9725-f17c28553379 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:32.336016 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edd136-d073-4961-9725-f17c28553379 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:27:32.337283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edd136-d073-4961-9725-f17c28553379 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:32.340142 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edd136-d073-4961-9725-f17c28553379 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:32.359296 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1036/2085] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:27:32.363427 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42357d42-7783-48f8-a0bb-75d9d54069fe None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:32.374011 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42357d42-7783-48f8-a0bb-75d9d54069fe None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:32.379058 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c17a7-bb76-4f8b-a37e-c83343286088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:32.380089 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c17a7-bb76-4f8b-a37e-c83343286088 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:32.382624 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:32.384622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c17a7-bb76-4f8b-a37e-c83343286088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:32.384622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c17a7-bb76-4f8b-a37e-c83343286088 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:32.384622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c17a7-bb76-4f8b-a37e-c83343286088 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:32.387411 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c17a7-bb76-4f8b-a37e-c83343286088 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:32.494836 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1050/2086] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:27:32 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:27:32.499209 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edd136-d073-4961-9725-f17c28553379 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:32.512150 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edd136-d073-4961-9725-f17c28553379 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:32.580745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d916c-d278-4491-a504-47df36302786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:32.580745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d916c-d278-4491-a504-47df36302786 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:32.580745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d916c-d278-4491-a504-47df36302786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:32.580745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d916c-d278-4491-a504-47df36302786 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:32.581054 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d916c-d278-4491-a504-47df36302786 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:32.581054 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d916c-d278-4491-a504-47df36302786 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:32.677228 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1037/2087] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:27:32 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:27:32.682671 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c17a7-bb76-4f8b-a37e-c83343286088 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:32.695998 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c17a7-bb76-4f8b-a37e-c83343286088 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:32.701672 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2d0a2-a1fd-4e07-973a-6d792172f16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:32.702378 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2d0a2-a1fd-4e07-973a-6d792172f16f admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:32.702665 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2d0a2-a1fd-4e07-973a-6d792172f16f admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:32.702945 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2d0a2-a1fd-4e07-973a-6d792172f16f admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:32.703755 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2d0a2-a1fd-4e07-973a-6d792172f16f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:32.705290 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2d0a2-a1fd-4e07-973a-6d792172f16f admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:32.718354 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1051/2088] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:27:32.722314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d916c-d278-4491-a504-47df36302786 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:32.733552 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d916c-d278-4491-a504-47df36302786 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:32.738188 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfccf1d-9132-4370-b43f-6e4facfe6184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:32.738845 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfccf1d-9132-4370-b43f-6e4facfe6184 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:32.739131 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfccf1d-9132-4370-b43f-6e4facfe6184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:32.739410 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfccf1d-9132-4370-b43f-6e4facfe6184 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:32.740165 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfccf1d-9132-4370-b43f-6e4facfe6184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:32.741824 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfccf1d-9132-4370-b43f-6e4facfe6184 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:32.752015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1038/2089] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:27:32.756330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2d0a2-a1fd-4e07-973a-6d792172f16f admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:32.768660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2d0a2-a1fd-4e07-973a-6d792172f16f admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:32.774059 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c313ee-a43d-44ec-8c12-533bcc8da9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:32.774940 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c313ee-a43d-44ec-8c12-533bcc8da9ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:32.775223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c313ee-a43d-44ec-8c12-533bcc8da9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:32.775499 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c313ee-a43d-44ec-8c12-533bcc8da9ba admin admin] PATH_INFO: `/v3/projects/3ed4db83caed4b72b6bbb613e53502bd/users/e0a1449a68a042209584d9acb0ec3921/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:32.794525 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c313ee-a43d-44ec-8c12-533bcc8da9ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ed4db83caed4b72b6bbb613e53502bd, user_id=e0a1449a68a042209584d9acb0ec3921, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:32.797192 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c313ee-a43d-44ec-8c12-533bcc8da9ba admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:32.882897 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1052/2090] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:27:32 2022] PUT /identity/v3/projects/3ed4db83caed4b72b6bbb613e53502bd/users/e0a1449a68a042209584d9acb0ec3921/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:32.893204 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f01b5-af8b-4db0-8f6d-98492b1f1978 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:32.893495 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f01b5-af8b-4db0-8f6d-98492b1f1978 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:32.893791 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f01b5-af8b-4db0-8f6d-98492b1f1978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:32.920898 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-333f01b5-af8b-4db0-8f6d-98492b1f1978 None None] MFA Rules not processed for user `e0a1449a68a042209584d9acb0ec3921`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:32.922836 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-333f01b5-af8b-4db0-8f6d-98492b1f1978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:32.988557 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1039/2091] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:32.992991 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c313ee-a43d-44ec-8c12-533bcc8da9ba admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:33.053480 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c313ee-a43d-44ec-8c12-533bcc8da9ba admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:33.058250 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0403e-0cab-431a-93ba-e103b5131707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:33.058914 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0403e-0cab-431a-93ba-e103b5131707 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:33.059204 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0403e-0cab-431a-93ba-e103b5131707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:33.059486 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0403e-0cab-431a-93ba-e103b5131707 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:33.060190 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0403e-0cab-431a-93ba-e103b5131707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:33.062117 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0403e-0cab-431a-93ba-e103b5131707 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:33.211060 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1053/2092] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:27:32 2022] POST /identity/v3/projects => generated 385 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:27:33.215905 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f01b5-af8b-4db0-8f6d-98492b1f1978 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:33.226880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f01b5-af8b-4db0-8f6d-98492b1f1978 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:33.283754 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cdbdf9-41e1-4c45-ab97-97d8a3953f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:33.284456 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdbdf9-41e1-4c45-ab97-97d8a3953f63 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:33.284741 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdbdf9-41e1-4c45-ab97-97d8a3953f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:33.285017 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdbdf9-41e1-4c45-ab97-97d8a3953f63 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:33.285709 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cdbdf9-41e1-4c45-ab97-97d8a3953f63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:33.287646 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cdbdf9-41e1-4c45-ab97-97d8a3953f63 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:33.351879 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:33.417133 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1040/2093] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:27:33 2022] POST /identity/v3/users => generated 299 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:27:33.418379 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0403e-0cab-431a-93ba-e103b5131707 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:33.429307 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0403e-0cab-431a-93ba-e103b5131707 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:33.434899 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5acee2a-a2f3-4675-897d-419594208477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:33.436115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acee2a-a2f3-4675-897d-419594208477 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:33.436642 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acee2a-a2f3-4675-897d-419594208477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:33.437025 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acee2a-a2f3-4675-897d-419594208477 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:33.437988 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5acee2a-a2f3-4675-897d-419594208477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:33.441822 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:33.442372 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5acee2a-a2f3-4675-897d-419594208477 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:33.450680 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1819801-b50b-4f8b-9b45-98fe0c0ebccf None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:33.450843 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1819801-b50b-4f8b-9b45-98fe0c0ebccf None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:33.451109 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1819801-b50b-4f8b-9b45-98fe0c0ebccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:33.457810 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1054/2094] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:27:33.460648 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5acee2a-a2f3-4675-897d-419594208477 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:33.472093 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5acee2a-a2f3-4675-897d-419594208477 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:33.477137 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0585f-41cf-4bd4-a94a-1ce9b89bd56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:33.477878 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0585f-41cf-4bd4-a94a-1ce9b89bd56b admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:33.478167 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0585f-41cf-4bd4-a94a-1ce9b89bd56b admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:33.478486 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0585f-41cf-4bd4-a94a-1ce9b89bd56b admin admin] PATH_INFO: `/v3/projects/d80888aeade54eff9c547d723d450fb1/users/670a24abdc574a0e8f523dd0ef996338/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:33.481205 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-d1819801-b50b-4f8b-9b45-98fe0c0ebccf None None] MFA Rules not processed for user `58581f894dbd470a97bd92580323ac56`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:33.482761 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d1819801-b50b-4f8b-9b45-98fe0c0ebccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:33.507821 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0585f-41cf-4bd4-a94a-1ce9b89bd56b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d80888aeade54eff9c547d723d450fb1, user_id=670a24abdc574a0e8f523dd0ef996338, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:33.511523 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0585f-41cf-4bd4-a94a-1ce9b89bd56b admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:33.569254 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1041/2095] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:27:33.571419 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd44cc0-8c80-4aa5-99bd-0cf0ce1397e3 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:33.571715 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd44cc0-8c80-4aa5-99bd-0cf0ce1397e3 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:33.572301 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd44cc0-8c80-4aa5-99bd-0cf0ce1397e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:33.591028 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-2dd44cc0-8c80-4aa5-99bd-0cf0ce1397e3 None None] MFA Rules not processed for user `b6454da0eba2404ab599b3c80c06b8dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:33.592264 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2dd44cc0-8c80-4aa5-99bd-0cf0ce1397e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:33.594604 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1055/2096] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:27:33 2022] PUT /identity/v3/projects/d80888aeade54eff9c547d723d450fb1/users/670a24abdc574a0e8f523dd0ef996338/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:33.595413 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0585f-41cf-4bd4-a94a-1ce9b89bd56b admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:33.597039 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-acf0585f-41cf-4bd4-a94a-1ce9b89bd56b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:33.655530 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1042/2097] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:33.658752 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd44cc0-8c80-4aa5-99bd-0cf0ce1397e3 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:33.660704 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0585f-41cf-4bd4-a94a-1ce9b89bd56b admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:33.671072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48bc91-d344-4111-b418-a2a3f1c189a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:33.671816 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48bc91-d344-4111-b418-a2a3f1c189a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:33.672173 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48bc91-d344-4111-b418-a2a3f1c189a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:33.672679 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48bc91-d344-4111-b418-a2a3f1c189a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:33.753291 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d48bc91-d344-4111-b418-a2a3f1c189a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:33.754867 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d48bc91-d344-4111-b418-a2a3f1c189a2 service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:33.760931 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd44cc0-8c80-4aa5-99bd-0cf0ce1397e3 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:33.769244 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde2733-2449-4cba-b69c-50ec3016952d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:33.770098 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde2733-2449-4cba-b69c-50ec3016952d admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:33.770648 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde2733-2449-4cba-b69c-50ec3016952d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:33.770926 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde2733-2449-4cba-b69c-50ec3016952d admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:33.774064 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1056/2098] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:27:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:27:33.775674 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde2733-2449-4cba-b69c-50ec3016952d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:33.777700 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde2733-2449-4cba-b69c-50ec3016952d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:33.793491 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1043/2099] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:27:33.803694 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48bc91-d344-4111-b418-a2a3f1c189a2 service cinder] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:33.814548 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48bc91-d344-4111-b418-a2a3f1c189a2 service cinder] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:33.820271 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0652a-f4d0-4c44-a198-079643e22504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:33.821226 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0652a-f4d0-4c44-a198-079643e22504 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:33.821516 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0652a-f4d0-4c44-a198-079643e22504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:33.822080 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0652a-f4d0-4c44-a198-079643e22504 admin admin] PATH_INFO: `/v3/projects/d80888aeade54eff9c547d723d450fb1/users/670a24abdc574a0e8f523dd0ef996338/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:33.824076 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0652a-f4d0-4c44-a198-079643e22504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d80888aeade54eff9c547d723d450fb1, user_id=670a24abdc574a0e8f523dd0ef996338, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:33.826763 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0652a-f4d0-4c44-a198-079643e22504 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:33.841572 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1057/2100] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:27:33 2022] PUT /identity/v3/projects/d80888aeade54eff9c547d723d450fb1/users/670a24abdc574a0e8f523dd0ef996338/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:33.857834 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef00382-e41e-40d0-b850-e8fb8083e661 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:33.858133 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef00382-e41e-40d0-b850-e8fb8083e661 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:33.858416 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef00382-e41e-40d0-b850-e8fb8083e661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:33.889405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-bef00382-e41e-40d0-b850-e8fb8083e661 None None] MFA Rules not processed for user `670a24abdc574a0e8f523dd0ef996338`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:33.890679 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-bef00382-e41e-40d0-b850-e8fb8083e661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:33.960976 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1044/2101] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:33.971959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0652a-f4d0-4c44-a198-079643e22504 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:33.973704 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-84e0652a-f4d0-4c44-a198-079643e22504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:34.034326 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0652a-f4d0-4c44-a198-079643e22504 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:34.038793 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a34b4-5f90-4d8a-9d6d-f194d3f4b362 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:34.047145 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a34b4-5f90-4d8a-9d6d-f194d3f4b362 service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:34.047145 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a34b4-5f90-4d8a-9d6d-f194d3f4b362 service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:34.047145 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a34b4-5f90-4d8a-9d6d-f194d3f4b362 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:34.098524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a34b4-5f90-4d8a-9d6d-f194d3f4b362 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:34.099948 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a34b4-5f90-4d8a-9d6d-f194d3f4b362 service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:34.110755 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1058/2102] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:27:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:27:34.218176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=81,keystone:INSERT=3,keystone:DELETE=16 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:35.124252 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:35.876573 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:36.389623 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:36.982894 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43bf35-0ea1-4150-ac99-38114b46e212 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:36.983456 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43bf35-0ea1-4150-ac99-38114b46e212 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:36.983876 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43bf35-0ea1-4150-ac99-38114b46e212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:37.001623 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-5d43bf35-0ea1-4150-ac99-38114b46e212 None None] MFA Rules not processed for user `58581f894dbd470a97bd92580323ac56`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:37.002873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-5d43bf35-0ea1-4150-ac99-38114b46e212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:37.058389 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1045/2103] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:37.682362 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:37.772978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a34b4-5f90-4d8a-9d6d-f194d3f4b362 service cinder] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:37.775043 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-d13a34b4-5f90-4d8a-9d6d-f194d3f4b362 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:37.841249 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a34b4-5f90-4d8a-9d6d-f194d3f4b362 service cinder] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:37.847010 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb21eb-0e67-460b-bd78-125b03ee636a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:37.847163 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb21eb-0e67-460b-bd78-125b03ee636a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:37.847374 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb21eb-0e67-460b-bd78-125b03ee636a admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:37.847653 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb21eb-0e67-460b-bd78-125b03ee636a admin admin] PATH_INFO: `/v3/users/ce099e27e8644e92ba0abb06f52ce17e` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:37.849054 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb21eb-0e67-460b-bd78-125b03ee636a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce099e27e8644e92ba0abb06f52ce17e)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:37.851010 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb21eb-0e67-460b-bd78-125b03ee636a admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:38.015409 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:38.107895 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-69eb21eb-0e67-460b-bd78-125b03ee636a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce099e27e8644e92ba0abb06f52ce17e'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:38.169128 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-69eb21eb-0e67-460b-bd78-125b03ee636a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce099e27e8644e92ba0abb06f52ce17e'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:38.177064 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-69eb21eb-0e67-460b-bd78-125b03ee636a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce099e27e8644e92ba0abb06f52ce17e'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:38.177712 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-69eb21eb-0e67-460b-bd78-125b03ee636a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce099e27e8644e92ba0abb06f52ce17e'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:38.178370 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-69eb21eb-0e67-460b-bd78-125b03ee636a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce099e27e8644e92ba0abb06f52ce17e'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:38.196277 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1059/2104] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:27:37 2022] DELETE /identity/v3/users/ce099e27e8644e92ba0abb06f52ce17e => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:38.200800 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18c5ad-bd34-459f-a0cf-331c27948d39 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:38.201097 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18c5ad-bd34-459f-a0cf-331c27948d39 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:38.201385 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18c5ad-bd34-459f-a0cf-331c27948d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:38.218773 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-ab18c5ad-bd34-459f-a0cf-331c27948d39 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:38.219977 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ab18c5ad-bd34-459f-a0cf-331c27948d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:38.281251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1046/2105] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:38.291760 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb21eb-0e67-460b-bd78-125b03ee636a admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:38.296784 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-69eb21eb-0e67-460b-bd78-125b03ee636a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:38.350870 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb21eb-0e67-460b-bd78-125b03ee636a admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:38.355537 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a7adb-07c6-40ec-8e22-2e365cd7db80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:38.356462 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a7adb-07c6-40ec-8e22-2e365cd7db80 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:38.356595 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a7adb-07c6-40ec-8e22-2e365cd7db80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:38.356862 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a7adb-07c6-40ec-8e22-2e365cd7db80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:38.366315 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a7adb-07c6-40ec-8e22-2e365cd7db80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:38.368343 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a7adb-07c6-40ec-8e22-2e365cd7db80 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:38.378914 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1060/2106] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:27:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:27:38.677192 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:38.887957 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18c5ad-bd34-459f-a0cf-331c27948d39 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:38.889698 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ab18c5ad-bd34-459f-a0cf-331c27948d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:38.905060 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18c5ad-bd34-459f-a0cf-331c27948d39 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:38.912161 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa5149-9187-4038-9337-fda65cd641db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:38.916719 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa5149-9187-4038-9337-fda65cd641db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:38.916719 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa5149-9187-4038-9337-fda65cd641db admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:38.916719 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa5149-9187-4038-9337-fda65cd641db admin admin] PATH_INFO: `/v3/projects/743947cbb2f747098204325138d71945` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:38.916719 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa5149-9187-4038-9337-fda65cd641db admin admin] RBAC: Authorizing `identity:delete_project(project_id=743947cbb2f747098204325138d71945)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:38.918948 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa5149-9187-4038-9337-fda65cd641db admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:38.996810 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:39.137256 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6aaa5149-9187-4038-9337-fda65cd641db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '743947cbb2f747098204325138d71945', 'request_id': 'req-6aaa5149-9187-4038-9337-fda65cd641db'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:39.142579 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6aaa5149-9187-4038-9337-fda65cd641db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '743947cbb2f747098204325138d71945', 'request_id': 'req-6aaa5149-9187-4038-9337-fda65cd641db'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:39.229472 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6aaa5149-9187-4038-9337-fda65cd641db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '743947cbb2f747098204325138d71945', 'request_id': 'req-6aaa5149-9187-4038-9337-fda65cd641db'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:39.241068 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6aaa5149-9187-4038-9337-fda65cd641db admin admin] The token cache is being invalidate because project 743947cbb2f747098204325138d71945 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:27:39.241359 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6aaa5149-9187-4038-9337-fda65cd641db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:39.242030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6aaa5149-9187-4038-9337-fda65cd641db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:39.244091 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1047/2107] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:27:38 2022] DELETE /identity/v3/projects/743947cbb2f747098204325138d71945 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:39.248122 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a7adb-07c6-40ec-8e22-2e365cd7db80 service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:39.257630 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a7adb-07c6-40ec-8e22-2e365cd7db80 service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:39.319680 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff8368-8bc2-4627-a312-3d36c7dc91a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:39.320600 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff8368-8bc2-4627-a312-3d36c7dc91a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:39.321092 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff8368-8bc2-4627-a312-3d36c7dc91a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:39.321435 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff8368-8bc2-4627-a312-3d36c7dc91a8 admin admin] PATH_INFO: `/v3/users/d56ece2a0fd74d88b12239c5b6ed6a0e` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:39.323744 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff8368-8bc2-4627-a312-3d36c7dc91a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d56ece2a0fd74d88b12239c5b6ed6a0e)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:39.325742 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff8368-8bc2-4627-a312-3d36c7dc91a8 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:39.524471 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-f3ff8368-8bc2-4627-a312-3d36c7dc91a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd56ece2a0fd74d88b12239c5b6ed6a0e'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:39.596282 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-f3ff8368-8bc2-4627-a312-3d36c7dc91a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd56ece2a0fd74d88b12239c5b6ed6a0e'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:39.612043 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-f3ff8368-8bc2-4627-a312-3d36c7dc91a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd56ece2a0fd74d88b12239c5b6ed6a0e'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:39.613829 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-f3ff8368-8bc2-4627-a312-3d36c7dc91a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd56ece2a0fd74d88b12239c5b6ed6a0e'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:39.614091 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-f3ff8368-8bc2-4627-a312-3d36c7dc91a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd56ece2a0fd74d88b12239c5b6ed6a0e'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:39.640355 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1061/2108] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:27:39 2022] DELETE /identity/v3/users/d56ece2a0fd74d88b12239c5b6ed6a0e => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:40.386997 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa5149-9187-4038-9337-fda65cd641db admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:40.388430 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6aaa5149-9187-4038-9337-fda65cd641db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:40.402842 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa5149-9187-4038-9337-fda65cd641db admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:40.436579 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:40.461067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a58b9-00f2-4c1d-9898-c393df22c9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:40.462052 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a58b9-00f2-4c1d-9898-c393df22c9ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:40.462401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a58b9-00f2-4c1d-9898-c393df22c9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:40.463540 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a58b9-00f2-4c1d-9898-c393df22c9ae admin admin] PATH_INFO: `/v3/projects/0a85c8e4f24343c581e6c3cdf3e5fc61` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:40.464807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a58b9-00f2-4c1d-9898-c393df22c9ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a85c8e4f24343c581e6c3cdf3e5fc61)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:40.466795 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a58b9-00f2-4c1d-9898-c393df22c9ae admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:40.644582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-404a58b9-00f2-4c1d-9898-c393df22c9ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a85c8e4f24343c581e6c3cdf3e5fc61', 'request_id': 'req-404a58b9-00f2-4c1d-9898-c393df22c9ae'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:40.650891 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-404a58b9-00f2-4c1d-9898-c393df22c9ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a85c8e4f24343c581e6c3cdf3e5fc61', 'request_id': 'req-404a58b9-00f2-4c1d-9898-c393df22c9ae'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:40.798180 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:40.806812 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-404a58b9-00f2-4c1d-9898-c393df22c9ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a85c8e4f24343c581e6c3cdf3e5fc61', 'request_id': 'req-404a58b9-00f2-4c1d-9898-c393df22c9ae'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:40.813528 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-404a58b9-00f2-4c1d-9898-c393df22c9ae admin admin] The token cache is being invalidate because project 0a85c8e4f24343c581e6c3cdf3e5fc61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:27:40.814113 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-404a58b9-00f2-4c1d-9898-c393df22c9ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:40.815930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-404a58b9-00f2-4c1d-9898-c393df22c9ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:40.817790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1048/2109] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:27:40 2022] DELETE /identity/v3/projects/0a85c8e4f24343c581e6c3cdf3e5fc61 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:27:40.823955 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3faf1fa-d0f4-4f2f-9ded-e2378330d0a4 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:40.824313 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3faf1fa-d0f4-4f2f-9ded-e2378330d0a4 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:40.825567 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3faf1fa-d0f4-4f2f-9ded-e2378330d0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:40.852248 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-c3faf1fa-d0f4-4f2f-9ded-e2378330d0a4 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:40.854019 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-c3faf1fa-d0f4-4f2f-9ded-e2378330d0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:40.932634 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1062/2110] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:40.940239 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f4281-0ee3-46d3-8668-fcd35c8ac5e2 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:40.945075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f4281-0ee3-46d3-8668-fcd35c8ac5e2 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:40.945456 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f4281-0ee3-46d3-8668-fcd35c8ac5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:40.969927 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-540f4281-0ee3-46d3-8668-fcd35c8ac5e2 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:40.971150 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-540f4281-0ee3-46d3-8668-fcd35c8ac5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:40.980563 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1049/2111] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:27:40.985531 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3faf1fa-d0f4-4f2f-9ded-e2378330d0a4 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:40.996300 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3faf1fa-d0f4-4f2f-9ded-e2378330d0a4 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:41.000956 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c80d19-edde-4af8-bc23-50e8c3105e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:41.001611 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c80d19-edde-4af8-bc23-50e8c3105e8a admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:41.001935 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c80d19-edde-4af8-bc23-50e8c3105e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:41.002246 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c80d19-edde-4af8-bc23-50e8c3105e8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:41.002984 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c80d19-edde-4af8-bc23-50e8c3105e8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:27:41.003293 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c80d19-edde-4af8-bc23-50e8c3105e8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:41.004885 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c80d19-edde-4af8-bc23-50e8c3105e8a admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:41.018096 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1063/2112] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:27:41.022566 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f4281-0ee3-46d3-8668-fcd35c8ac5e2 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:41.032812 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f4281-0ee3-46d3-8668-fcd35c8ac5e2 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:41.037916 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466cb07-e1d6-4e0c-a12d-9890c2400add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:41.038692 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466cb07-e1d6-4e0c-a12d-9890c2400add admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:41.039013 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466cb07-e1d6-4e0c-a12d-9890c2400add admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:41.039360 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466cb07-e1d6-4e0c-a12d-9890c2400add admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:41.040156 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466cb07-e1d6-4e0c-a12d-9890c2400add admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:41.042817 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466cb07-e1d6-4e0c-a12d-9890c2400add admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:41.180062 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1050/2113] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:27:41 2022] POST /identity/v3/projects => generated 379 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:27:41.181840 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c80d19-edde-4af8-bc23-50e8c3105e8a admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:41.192241 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c80d19-edde-4af8-bc23-50e8c3105e8a admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:41.276896 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76661b5-1207-45ae-b32a-fe45dfc9994b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:41.277699 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76661b5-1207-45ae-b32a-fe45dfc9994b admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:41.278085 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76661b5-1207-45ae-b32a-fe45dfc9994b admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:41.278433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76661b5-1207-45ae-b32a-fe45dfc9994b admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:41.279289 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76661b5-1207-45ae-b32a-fe45dfc9994b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:41.281291 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76661b5-1207-45ae-b32a-fe45dfc9994b admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:41.453733 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1064/2114] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:27:41 2022] POST /identity/v3/users => generated 290 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:27:41.457943 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466cb07-e1d6-4e0c-a12d-9890c2400add admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:41.468773 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466cb07-e1d6-4e0c-a12d-9890c2400add admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:41.473484 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d27a0-223d-4f75-9883-ad1e5cf0a7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:41.474179 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d27a0-223d-4f75-9883-ad1e5cf0a7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:41.474468 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d27a0-223d-4f75-9883-ad1e5cf0a7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:41.474742 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d27a0-223d-4f75-9883-ad1e5cf0a7e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:41.475462 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d27a0-223d-4f75-9883-ad1e5cf0a7e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:41.477044 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d27a0-223d-4f75-9883-ad1e5cf0a7e4 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:41.490409 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1051/2115] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:27:41.493204 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76661b5-1207-45ae-b32a-fe45dfc9994b admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:41.503841 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76661b5-1207-45ae-b32a-fe45dfc9994b admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:41.508477 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f660ffd-9a90-4a98-a5f7-b571ec760b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:41.509137 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f660ffd-9a90-4a98-a5f7-b571ec760b6f admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:41.510121 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f660ffd-9a90-4a98-a5f7-b571ec760b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:41.510400 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f660ffd-9a90-4a98-a5f7-b571ec760b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:41.511126 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f660ffd-9a90-4a98-a5f7-b571ec760b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:41.512736 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f660ffd-9a90-4a98-a5f7-b571ec760b6f admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:41.523236 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1065/2116] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:27:41.527274 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d27a0-223d-4f75-9883-ad1e5cf0a7e4 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:41.537457 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d27a0-223d-4f75-9883-ad1e5cf0a7e4 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:41.542291 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28016926-6f5a-41f5-88f1-46a35774f21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:41.543230 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28016926-6f5a-41f5-88f1-46a35774f21b admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:41.543511 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28016926-6f5a-41f5-88f1-46a35774f21b admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:41.543788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28016926-6f5a-41f5-88f1-46a35774f21b admin admin] PATH_INFO: `/v3/projects/e533ba61edc64066a1c66fecce8c83fa/users/9a9d9178dbcf40ad8a7a63c8578ca4b8/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:41.558733 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28016926-6f5a-41f5-88f1-46a35774f21b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e533ba61edc64066a1c66fecce8c83fa, user_id=9a9d9178dbcf40ad8a7a63c8578ca4b8, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:41.561370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28016926-6f5a-41f5-88f1-46a35774f21b admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:41.642364 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1052/2117] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:27:41 2022] PUT /identity/v3/projects/e533ba61edc64066a1c66fecce8c83fa/users/9a9d9178dbcf40ad8a7a63c8578ca4b8/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:27:41.652791 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef15b43-14f4-4a5d-92eb-6dfed454ca62 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:41.653108 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef15b43-14f4-4a5d-92eb-6dfed454ca62 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:41.653420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef15b43-14f4-4a5d-92eb-6dfed454ca62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:41.679728 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-eef15b43-14f4-4a5d-92eb-6dfed454ca62 None None] MFA Rules not processed for user `9a9d9178dbcf40ad8a7a63c8578ca4b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:41.680938 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-eef15b43-14f4-4a5d-92eb-6dfed454ca62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:41.744889 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1066/2118] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:41.749388 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28016926-6f5a-41f5-88f1-46a35774f21b admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:41.812506 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28016926-6f5a-41f5-88f1-46a35774f21b admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:41.817273 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882c7b8-941e-41b3-ac0a-353ad65c432d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:41.818041 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882c7b8-941e-41b3-ac0a-353ad65c432d admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:41.818337 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882c7b8-941e-41b3-ac0a-353ad65c432d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:41.818617 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882c7b8-941e-41b3-ac0a-353ad65c432d admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:41.819316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882c7b8-941e-41b3-ac0a-353ad65c432d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:41.821204 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882c7b8-941e-41b3-ac0a-353ad65c432d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:41.859595 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:41.975463 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1053/2119] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:27:41 2022] POST /identity/v3/projects => generated 379 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:27:41.980202 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef15b43-14f4-4a5d-92eb-6dfed454ca62 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:41.991484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef15b43-14f4-4a5d-92eb-6dfed454ca62 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:42.056941 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f126140-cfee-456a-a4d1-7932a2003918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:42.057748 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f126140-cfee-456a-a4d1-7932a2003918 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:42.058068 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f126140-cfee-456a-a4d1-7932a2003918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:42.058525 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f126140-cfee-456a-a4d1-7932a2003918 admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:42.059359 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f126140-cfee-456a-a4d1-7932a2003918 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:42.061325 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f126140-cfee-456a-a4d1-7932a2003918 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:42.197510 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1067/2120] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:27:41 2022] POST /identity/v3/users => generated 296 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:27:42.201709 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882c7b8-941e-41b3-ac0a-353ad65c432d admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:42.213726 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882c7b8-941e-41b3-ac0a-353ad65c432d admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:42.218321 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823a723-55b6-468f-8795-cbe07b4f69a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:42.218982 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823a723-55b6-468f-8795-cbe07b4f69a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:42.219265 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823a723-55b6-468f-8795-cbe07b4f69a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:42.219542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823a723-55b6-468f-8795-cbe07b4f69a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:42.220277 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823a723-55b6-468f-8795-cbe07b4f69a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:42.221902 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823a723-55b6-468f-8795-cbe07b4f69a6 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:42.233637 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1054/2121] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:27:42.243106 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f126140-cfee-456a-a4d1-7932a2003918 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:42.253547 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f126140-cfee-456a-a4d1-7932a2003918 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:42.258312 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f36ff-b472-4355-b3cd-7704ae96389b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:42.259274 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f36ff-b472-4355-b3cd-7704ae96389b admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:42.259653 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f36ff-b472-4355-b3cd-7704ae96389b admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:42.260129 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f36ff-b472-4355-b3cd-7704ae96389b admin admin] PATH_INFO: `/v3/projects/a8663bc56e0f4f2aa3368045bf6f3f95/users/2893f76c5f874f1c802e714649803ad7/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:42.277190 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f36ff-b472-4355-b3cd-7704ae96389b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8663bc56e0f4f2aa3368045bf6f3f95, user_id=2893f76c5f874f1c802e714649803ad7, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:42.280012 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f36ff-b472-4355-b3cd-7704ae96389b admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:42.304129 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:42.370457 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:42.378643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1068/2122] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:27:42 2022] PUT /identity/v3/projects/a8663bc56e0f4f2aa3368045bf6f3f95/users/2893f76c5f874f1c802e714649803ad7/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:42.382706 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823a723-55b6-468f-8795-cbe07b4f69a6 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:42.394084 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823a723-55b6-468f-8795-cbe07b4f69a6 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:42.461479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ccd5b-95db-452b-a718-be4d3c0a7239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:42.470378 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ccd5b-95db-452b-a718-be4d3c0a7239 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:42.470714 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ccd5b-95db-452b-a718-be4d3c0a7239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:42.470999 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ccd5b-95db-452b-a718-be4d3c0a7239 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:42.471789 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ccd5b-95db-452b-a718-be4d3c0a7239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:42.473404 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ccd5b-95db-452b-a718-be4d3c0a7239 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:42.484610 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1055/2123] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:27:42.489287 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f36ff-b472-4355-b3cd-7704ae96389b admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:42.501519 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f36ff-b472-4355-b3cd-7704ae96389b admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:42.507141 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6b26f-e786-4ddb-be87-aa070625e57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:42.510864 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6b26f-e786-4ddb-be87-aa070625e57e admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:42.510864 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6b26f-e786-4ddb-be87-aa070625e57e admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:42.510864 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6b26f-e786-4ddb-be87-aa070625e57e admin admin] PATH_INFO: `/v3/projects/a8663bc56e0f4f2aa3368045bf6f3f95/users/2893f76c5f874f1c802e714649803ad7/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:42.512946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6b26f-e786-4ddb-be87-aa070625e57e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8663bc56e0f4f2aa3368045bf6f3f95, user_id=2893f76c5f874f1c802e714649803ad7, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:42.515603 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6b26f-e786-4ddb-be87-aa070625e57e admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:42.528457 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1069/2124] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:27:42 2022] PUT /identity/v3/projects/a8663bc56e0f4f2aa3368045bf6f3f95/users/2893f76c5f874f1c802e714649803ad7/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:42.541060 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcf82a-41a0-4000-8dff-3dae91aa2e58 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:42.541381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcf82a-41a0-4000-8dff-3dae91aa2e58 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:42.541669 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcf82a-41a0-4000-8dff-3dae91aa2e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:42.573678 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-3cdcf82a-41a0-4000-8dff-3dae91aa2e58 None None] MFA Rules not processed for user `2893f76c5f874f1c802e714649803ad7`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:42.574957 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3cdcf82a-41a0-4000-8dff-3dae91aa2e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:42.648025 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1056/2125] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:42 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:42.659876 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6b26f-e786-4ddb-be87-aa070625e57e admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:42.661579 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-45a6b26f-e786-4ddb-be87-aa070625e57e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:42.720149 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6b26f-e786-4ddb-be87-aa070625e57e admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:42.723838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9644cc-e449-4fec-b203-96169b7056da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:42.724490 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9644cc-e449-4fec-b203-96169b7056da service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:42.724823 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9644cc-e449-4fec-b203-96169b7056da service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:42.725106 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9644cc-e449-4fec-b203-96169b7056da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:42.785271 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9644cc-e449-4fec-b203-96169b7056da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:42.786750 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9644cc-e449-4fec-b203-96169b7056da service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:42.795976 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1070/2126] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:27:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:27:43.376999 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcf82a-41a0-4000-8dff-3dae91aa2e58 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:43.378500 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3cdcf82a-41a0-4000-8dff-3dae91aa2e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:43.392216 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcf82a-41a0-4000-8dff-3dae91aa2e58 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:43.396002 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589eaca-0394-40ed-84c6-6bf49d6b59c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:43.396649 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589eaca-0394-40ed-84c6-6bf49d6b59c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:43.396933 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589eaca-0394-40ed-84c6-6bf49d6b59c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:43.397234 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589eaca-0394-40ed-84c6-6bf49d6b59c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:43.399001 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3589eaca-0394-40ed-84c6-6bf49d6b59c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:43.474166 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589eaca-0394-40ed-84c6-6bf49d6b59c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:43.475711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589eaca-0394-40ed-84c6-6bf49d6b59c3 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:43.486532 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1057/2127] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:27:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:27:43.604888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:43.803039 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:45.921263 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9644cc-e449-4fec-b203-96169b7056da service cinder] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:45.930889 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9644cc-e449-4fec-b203-96169b7056da service cinder] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:45.935379 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acde42e-7d39-44a7-9d78-a64b9ad10803 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:45.936238 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acde42e-7d39-44a7-9d78-a64b9ad10803 service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:45.936596 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acde42e-7d39-44a7-9d78-a64b9ad10803 service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:45.936947 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acde42e-7d39-44a7-9d78-a64b9ad10803 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:45.950944 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acde42e-7d39-44a7-9d78-a64b9ad10803 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:45.952510 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acde42e-7d39-44a7-9d78-a64b9ad10803 service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:45.979054 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1071/2128] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:27:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:27:46.078264 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:46.309827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:48.282351 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:49.471051 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:51.067424 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589eaca-0394-40ed-84c6-6bf49d6b59c3 service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:51.068938 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3589eaca-0394-40ed-84c6-6bf49d6b59c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:51.133669 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589eaca-0394-40ed-84c6-6bf49d6b59c3 service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:51.139002 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53282e42-3469-4045-8722-cadbb66b673d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:51.139864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53282e42-3469-4045-8722-cadbb66b673d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:51.140151 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53282e42-3469-4045-8722-cadbb66b673d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:51.140433 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53282e42-3469-4045-8722-cadbb66b673d admin admin] PATH_INFO: `/v3/users/e0a1449a68a042209584d9acb0ec3921` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:51.141640 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53282e42-3469-4045-8722-cadbb66b673d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0a1449a68a042209584d9acb0ec3921)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:51.143665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53282e42-3469-4045-8722-cadbb66b673d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:51.405149 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-53282e42-3469-4045-8722-cadbb66b673d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0a1449a68a042209584d9acb0ec3921'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:51.405832 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-53282e42-3469-4045-8722-cadbb66b673d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0a1449a68a042209584d9acb0ec3921'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:51.412567 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-53282e42-3469-4045-8722-cadbb66b673d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0a1449a68a042209584d9acb0ec3921'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:51.505471 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-53282e42-3469-4045-8722-cadbb66b673d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0a1449a68a042209584d9acb0ec3921'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:51.519544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-53282e42-3469-4045-8722-cadbb66b673d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0a1449a68a042209584d9acb0ec3921'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:51.525605 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1058/2129] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:27:51 2022] DELETE /identity/v3/users/e0a1449a68a042209584d9acb0ec3921 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:51.531383 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de1991-5393-4b04-8114-455b889e8ec4 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:51.531905 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de1991-5393-4b04-8114-455b889e8ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:51.532114 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de1991-5393-4b04-8114-455b889e8ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:51.550958 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-a7de1991-5393-4b04-8114-455b889e8ec4 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:51.552206 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-a7de1991-5393-4b04-8114-455b889e8ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:51.612250 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1072/2130] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:51.622995 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53282e42-3469-4045-8722-cadbb66b673d admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:51.624571 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-53282e42-3469-4045-8722-cadbb66b673d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:51.713262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53282e42-3469-4045-8722-cadbb66b673d admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:51.716997 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811869a6-388b-489b-993c-1c54fabab7da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:51.717656 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811869a6-388b-489b-993c-1c54fabab7da service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:51.717974 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811869a6-388b-489b-993c-1c54fabab7da service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:51.718254 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811869a6-388b-489b-993c-1c54fabab7da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:51.727578 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de1991-5393-4b04-8114-455b889e8ec4 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:51.728926 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811869a6-388b-489b-993c-1c54fabab7da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:51.730108 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-a7de1991-5393-4b04-8114-455b889e8ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:51.730678 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811869a6-388b-489b-993c-1c54fabab7da service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:51.741336 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1059/2131] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:27:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:27:51.742611 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de1991-5393-4b04-8114-455b889e8ec4 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:51.748324 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23641c82-2026-4074-a6be-0996f809a4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:51.749289 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23641c82-2026-4074-a6be-0996f809a4b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:51.749740 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23641c82-2026-4074-a6be-0996f809a4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:51.750201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23641c82-2026-4074-a6be-0996f809a4b7 admin admin] PATH_INFO: `/v3/users/9a9d9178dbcf40ad8a7a63c8578ca4b8` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:51.751632 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23641c82-2026-4074-a6be-0996f809a4b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a9d9178dbcf40ad8a7a63c8578ca4b8)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:51.753671 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23641c82-2026-4074-a6be-0996f809a4b7 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:52.093027 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-23641c82-2026-4074-a6be-0996f809a4b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a9d9178dbcf40ad8a7a63c8578ca4b8'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:52.231211 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-23641c82-2026-4074-a6be-0996f809a4b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a9d9178dbcf40ad8a7a63c8578ca4b8'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:52.238991 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-23641c82-2026-4074-a6be-0996f809a4b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a9d9178dbcf40ad8a7a63c8578ca4b8'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:52.240916 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-23641c82-2026-4074-a6be-0996f809a4b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a9d9178dbcf40ad8a7a63c8578ca4b8'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:52.241545 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-23641c82-2026-4074-a6be-0996f809a4b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a9d9178dbcf40ad8a7a63c8578ca4b8'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:52.260207 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1073/2132] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:27:51 2022] DELETE /identity/v3/users/9a9d9178dbcf40ad8a7a63c8578ca4b8 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:52.265008 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6066d6-6433-49c1-865b-97d27646b7f3 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:52.265484 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6066d6-6433-49c1-865b-97d27646b7f3 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:52.266243 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6066d6-6433-49c1-865b-97d27646b7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:52.285149 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-6c6066d6-6433-49c1-865b-97d27646b7f3 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:52.286645 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6c6066d6-6433-49c1-865b-97d27646b7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:52.335981 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23641c82-2026-4074-a6be-0996f809a4b7 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:52.338102 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-23641c82-2026-4074-a6be-0996f809a4b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:52.356334 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1060/2133] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:27:52.363053 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6066d6-6433-49c1-865b-97d27646b7f3 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:52.364874 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6c6066d6-6433-49c1-865b-97d27646b7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:52.412238 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23641c82-2026-4074-a6be-0996f809a4b7 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:52.417974 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b1b5b-fdea-4e0b-a63d-94a8d1277a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:52.418844 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b1b5b-fdea-4e0b-a63d-94a8d1277a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:52.419185 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b1b5b-fdea-4e0b-a63d-94a8d1277a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:52.419475 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b1b5b-fdea-4e0b-a63d-94a8d1277a0b admin admin] PATH_INFO: `/v3/projects/3ed4db83caed4b72b6bbb613e53502bd` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:52.420842 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b1b5b-fdea-4e0b-a63d-94a8d1277a0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ed4db83caed4b72b6bbb613e53502bd)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:52.422875 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b1b5b-fdea-4e0b-a63d-94a8d1277a0b admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:52.430156 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6066d6-6433-49c1-865b-97d27646b7f3 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:52.434799 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d479b-aa78-477e-984f-99f2ee5c4ed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:52.435478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d479b-aa78-477e-984f-99f2ee5c4ed9 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:52.435763 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d479b-aa78-477e-984f-99f2ee5c4ed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:52.436040 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d479b-aa78-477e-984f-99f2ee5c4ed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:52.445529 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d479b-aa78-477e-984f-99f2ee5c4ed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:52.447926 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d479b-aa78-477e-984f-99f2ee5c4ed9 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:52.458479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1061/2134] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:27:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:27:52.543008 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-940b1b5b-fdea-4e0b-a63d-94a8d1277a0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ed4db83caed4b72b6bbb613e53502bd', 'request_id': 'req-940b1b5b-fdea-4e0b-a63d-94a8d1277a0b'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:52.658582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-940b1b5b-fdea-4e0b-a63d-94a8d1277a0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ed4db83caed4b72b6bbb613e53502bd', 'request_id': 'req-940b1b5b-fdea-4e0b-a63d-94a8d1277a0b'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:52.669305 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-940b1b5b-fdea-4e0b-a63d-94a8d1277a0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ed4db83caed4b72b6bbb613e53502bd', 'request_id': 'req-940b1b5b-fdea-4e0b-a63d-94a8d1277a0b'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:52.682042 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-940b1b5b-fdea-4e0b-a63d-94a8d1277a0b admin admin] The token cache is being invalidate because project 3ed4db83caed4b72b6bbb613e53502bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:27:52.682042 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-940b1b5b-fdea-4e0b-a63d-94a8d1277a0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:52.682706 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-940b1b5b-fdea-4e0b-a63d-94a8d1277a0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:52.685148 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1074/2135] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:27:52 2022] DELETE /identity/v3/projects/3ed4db83caed4b72b6bbb613e53502bd => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:52.689006 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d479b-aa78-477e-984f-99f2ee5c4ed9 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:52.706283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d479b-aa78-477e-984f-99f2ee5c4ed9 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:52.823609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fffa30-5ae5-4df6-a6d9-10906f45e7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:52.824505 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fffa30-5ae5-4df6-a6d9-10906f45e7f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:52.824780 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fffa30-5ae5-4df6-a6d9-10906f45e7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:52.825060 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fffa30-5ae5-4df6-a6d9-10906f45e7f7 admin admin] PATH_INFO: `/v3/users/670a24abdc574a0e8f523dd0ef996338` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:52.826306 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fffa30-5ae5-4df6-a6d9-10906f45e7f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=670a24abdc574a0e8f523dd0ef996338)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:52.828520 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fffa30-5ae5-4df6-a6d9-10906f45e7f7 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:53.109431 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b1b5b-fdea-4e0b-a63d-94a8d1277a0b admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:53.118268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-940b1b5b-fdea-4e0b-a63d-94a8d1277a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:53.132764 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-94fffa30-5ae5-4df6-a6d9-10906f45e7f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '670a24abdc574a0e8f523dd0ef996338'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:53.135482 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-94fffa30-5ae5-4df6-a6d9-10906f45e7f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '670a24abdc574a0e8f523dd0ef996338'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:53.145026 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-94fffa30-5ae5-4df6-a6d9-10906f45e7f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '670a24abdc574a0e8f523dd0ef996338'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:53.151363 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b1b5b-fdea-4e0b-a63d-94a8d1277a0b admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:53.156562 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c58d3-3fd2-4659-9896-eb10724cd726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:53.157152 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c58d3-3fd2-4659-9896-eb10724cd726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:53.157443 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c58d3-3fd2-4659-9896-eb10724cd726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:53.157726 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c58d3-3fd2-4659-9896-eb10724cd726 admin admin] PATH_INFO: `/v3/projects/e533ba61edc64066a1c66fecce8c83fa` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:53.158979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c58d3-3fd2-4659-9896-eb10724cd726 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e533ba61edc64066a1c66fecce8c83fa)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:53.161028 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c58d3-3fd2-4659-9896-eb10724cd726 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:53.172602 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:53.218044 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-94fffa30-5ae5-4df6-a6d9-10906f45e7f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '670a24abdc574a0e8f523dd0ef996338'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:53.233461 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-94fffa30-5ae5-4df6-a6d9-10906f45e7f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '670a24abdc574a0e8f523dd0ef996338'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:53.240146 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1062/2136] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:27:52 2022] DELETE /identity/v3/users/670a24abdc574a0e8f523dd0ef996338 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:53.329361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-dc2c58d3-3fd2-4659-9896-eb10724cd726 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e533ba61edc64066a1c66fecce8c83fa', 'request_id': 'req-dc2c58d3-3fd2-4659-9896-eb10724cd726'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:53.414655 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-dc2c58d3-3fd2-4659-9896-eb10724cd726 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e533ba61edc64066a1c66fecce8c83fa', 'request_id': 'req-dc2c58d3-3fd2-4659-9896-eb10724cd726'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:53.423535 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-dc2c58d3-3fd2-4659-9896-eb10724cd726 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e533ba61edc64066a1c66fecce8c83fa', 'request_id': 'req-dc2c58d3-3fd2-4659-9896-eb10724cd726'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:53.439725 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-dc2c58d3-3fd2-4659-9896-eb10724cd726 admin admin] The token cache is being invalidate because project e533ba61edc64066a1c66fecce8c83fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:27:53.440112 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-dc2c58d3-3fd2-4659-9896-eb10724cd726 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:53.440681 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-dc2c58d3-3fd2-4659-9896-eb10724cd726 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:53.442403 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1075/2137] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:27:53 2022] DELETE /identity/v3/projects/e533ba61edc64066a1c66fecce8c83fa => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:27:53.446625 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fffa30-5ae5-4df6-a6d9-10906f45e7f7 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:53.450366 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-94fffa30-5ae5-4df6-a6d9-10906f45e7f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:53.528292 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fffa30-5ae5-4df6-a6d9-10906f45e7f7 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:53.598128 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611116b2-b99b-40d3-b961-d08243f21bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:53.599038 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611116b2-b99b-40d3-b961-d08243f21bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:53.599325 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611116b2-b99b-40d3-b961-d08243f21bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:53.599607 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611116b2-b99b-40d3-b961-d08243f21bb7 admin admin] PATH_INFO: `/v3/users/2893f76c5f874f1c802e714649803ad7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:53.600817 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611116b2-b99b-40d3-b961-d08243f21bb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2893f76c5f874f1c802e714649803ad7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:53.602775 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611116b2-b99b-40d3-b961-d08243f21bb7 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:53.756068 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c58d3-3fd2-4659-9896-eb10724cd726 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:53.757839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-dc2c58d3-3fd2-4659-9896-eb10724cd726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:53.778913 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c58d3-3fd2-4659-9896-eb10724cd726 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:53.786154 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05caa41d-102c-4bab-8dc3-498cc8e3a326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:53.787058 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05caa41d-102c-4bab-8dc3-498cc8e3a326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:53.787357 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05caa41d-102c-4bab-8dc3-498cc8e3a326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:53.791087 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05caa41d-102c-4bab-8dc3-498cc8e3a326 admin admin] PATH_INFO: `/v3/projects/d80888aeade54eff9c547d723d450fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:53.791087 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05caa41d-102c-4bab-8dc3-498cc8e3a326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d80888aeade54eff9c547d723d450fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:53.792039 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05caa41d-102c-4bab-8dc3-498cc8e3a326 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:53.819800 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:53.867563 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-611116b2-b99b-40d3-b961-d08243f21bb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2893f76c5f874f1c802e714649803ad7'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:53.868175 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-611116b2-b99b-40d3-b961-d08243f21bb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2893f76c5f874f1c802e714649803ad7'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:53.875540 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-611116b2-b99b-40d3-b961-d08243f21bb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2893f76c5f874f1c802e714649803ad7'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:53.996286 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-05caa41d-102c-4bab-8dc3-498cc8e3a326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd80888aeade54eff9c547d723d450fb1', 'request_id': 'req-05caa41d-102c-4bab-8dc3-498cc8e3a326'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:54.008007 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-611116b2-b99b-40d3-b961-d08243f21bb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2893f76c5f874f1c802e714649803ad7'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:54.021702 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-611116b2-b99b-40d3-b961-d08243f21bb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2893f76c5f874f1c802e714649803ad7'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:54.029140 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1063/2138] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:27:53 2022] DELETE /identity/v3/users/2893f76c5f874f1c802e714649803ad7 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:27:54.162759 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-05caa41d-102c-4bab-8dc3-498cc8e3a326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd80888aeade54eff9c547d723d450fb1', 'request_id': 'req-05caa41d-102c-4bab-8dc3-498cc8e3a326'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:54.170520 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-05caa41d-102c-4bab-8dc3-498cc8e3a326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd80888aeade54eff9c547d723d450fb1', 'request_id': 'req-05caa41d-102c-4bab-8dc3-498cc8e3a326'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:54.181261 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-05caa41d-102c-4bab-8dc3-498cc8e3a326 admin admin] The token cache is being invalidate because project d80888aeade54eff9c547d723d450fb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:27:54.181547 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-05caa41d-102c-4bab-8dc3-498cc8e3a326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:54.182301 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-05caa41d-102c-4bab-8dc3-498cc8e3a326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:54.183998 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1076/2139] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:27:53 2022] DELETE /identity/v3/projects/d80888aeade54eff9c547d723d450fb1 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:54.190010 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c2b45-834c-402f-af7a-c5c1f3fdd5a5 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:54.191099 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c2b45-834c-402f-af7a-c5c1f3fdd5a5 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:54.191662 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c2b45-834c-402f-af7a-c5c1f3fdd5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:54.213035 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-150c2b45-834c-402f-af7a-c5c1f3fdd5a5 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:54.214495 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-150c2b45-834c-402f-af7a-c5c1f3fdd5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:54.280943 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1064/2140] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:27:54.289823 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0157fbe-417f-478f-9fa8-3fb873ad59e5 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:54.290191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0157fbe-417f-478f-9fa8-3fb873ad59e5 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:54.292152 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0157fbe-417f-478f-9fa8-3fb873ad59e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:54.327203 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-d0157fbe-417f-478f-9fa8-3fb873ad59e5 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:54.328700 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-d0157fbe-417f-478f-9fa8-3fb873ad59e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:54.344703 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1077/2141] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:54.349126 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c2b45-834c-402f-af7a-c5c1f3fdd5a5 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:54.364963 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c2b45-834c-402f-af7a-c5c1f3fdd5a5 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:54.371621 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c0bff-a8cd-4135-82b3-c13bcf2c23e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:54.371924 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c0bff-a8cd-4135-82b3-c13bcf2c23e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:54.373213 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c0bff-a8cd-4135-82b3-c13bcf2c23e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:54.373213 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c0bff-a8cd-4135-82b3-c13bcf2c23e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:54.373836 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c0bff-a8cd-4135-82b3-c13bcf2c23e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:27:54.374305 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c0bff-a8cd-4135-82b3-c13bcf2c23e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:54.376520 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c0bff-a8cd-4135-82b3-c13bcf2c23e3 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:54.393847 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1065/2142] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:27:54.397030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0157fbe-417f-478f-9fa8-3fb873ad59e5 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:54.409443 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0157fbe-417f-478f-9fa8-3fb873ad59e5 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:54.414848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecda205-3898-4551-b8c4-475301174346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:54.416333 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecda205-3898-4551-b8c4-475301174346 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:54.416630 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecda205-3898-4551-b8c4-475301174346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:54.416914 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecda205-3898-4551-b8c4-475301174346 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:54.417931 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecda205-3898-4551-b8c4-475301174346 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:54.419792 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecda205-3898-4551-b8c4-475301174346 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:54.541969 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1078/2143] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:27:54 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:27:54.543124 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c0bff-a8cd-4135-82b3-c13bcf2c23e3 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:54.555183 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c0bff-a8cd-4135-82b3-c13bcf2c23e3 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:54.621258 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40292241-ca12-413d-8ddc-b98ee7a54339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:54.622147 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40292241-ca12-413d-8ddc-b98ee7a54339 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:54.622487 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40292241-ca12-413d-8ddc-b98ee7a54339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:54.622833 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40292241-ca12-413d-8ddc-b98ee7a54339 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:54.623596 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40292241-ca12-413d-8ddc-b98ee7a54339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:54.625722 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40292241-ca12-413d-8ddc-b98ee7a54339 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:54.706565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1066/2144] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:27:54 2022] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:27:54.710729 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecda205-3898-4551-b8c4-475301174346 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:54.722008 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecda205-3898-4551-b8c4-475301174346 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:54.726849 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807944e-5992-4507-a456-c7ec3985bc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:54.727556 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807944e-5992-4507-a456-c7ec3985bc0d admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:54.728397 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807944e-5992-4507-a456-c7ec3985bc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:54.730019 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807944e-5992-4507-a456-c7ec3985bc0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:54.730817 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807944e-5992-4507-a456-c7ec3985bc0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:54.732438 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807944e-5992-4507-a456-c7ec3985bc0d admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:54.744198 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1079/2145] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:27:54.748234 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40292241-ca12-413d-8ddc-b98ee7a54339 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:54.758413 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40292241-ca12-413d-8ddc-b98ee7a54339 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:54.767403 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a773f-f55e-479c-8264-83e419c1ffc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:54.768105 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a773f-f55e-479c-8264-83e419c1ffc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:54.768317 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a773f-f55e-479c-8264-83e419c1ffc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:54.768625 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a773f-f55e-479c-8264-83e419c1ffc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:54.769932 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a773f-f55e-479c-8264-83e419c1ffc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:54.772584 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a773f-f55e-479c-8264-83e419c1ffc2 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:54.785316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1067/2146] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:27:54.788346 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807944e-5992-4507-a456-c7ec3985bc0d admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:54.799713 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807944e-5992-4507-a456-c7ec3985bc0d admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:54.803709 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:54.809270 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7e34b-a753-4ff9-b94c-3b412f7d71cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:54.809270 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7e34b-a753-4ff9-b94c-3b412f7d71cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:54.809598 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7e34b-a753-4ff9-b94c-3b412f7d71cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:54.809857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7e34b-a753-4ff9-b94c-3b412f7d71cd admin admin] PATH_INFO: `/v3/projects/fb8fb5dce2f54fa9adc6068a15182644/users/f2211a8570d0492c9ff2b6e67eb868e1/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:54.823258 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a773f-f55e-479c-8264-83e419c1ffc2 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:54.826326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8c1a773f-f55e-479c-8264-83e419c1ffc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:54.832925 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7e34b-a753-4ff9-b94c-3b412f7d71cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb8fb5dce2f54fa9adc6068a15182644, user_id=f2211a8570d0492c9ff2b6e67eb868e1, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:54.836259 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7e34b-a753-4ff9-b94c-3b412f7d71cd admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:54.844331 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a773f-f55e-479c-8264-83e419c1ffc2 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:54.849929 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ba750-6592-4258-8b8f-1b36a4a976e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:54.851148 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ba750-6592-4258-8b8f-1b36a4a976e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:54.851490 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ba750-6592-4258-8b8f-1b36a4a976e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:54.851822 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ba750-6592-4258-8b8f-1b36a4a976e8 admin admin] PATH_INFO: `/v3/projects/a8663bc56e0f4f2aa3368045bf6f3f95` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:54.853894 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ba750-6592-4258-8b8f-1b36a4a976e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8663bc56e0f4f2aa3368045bf6f3f95)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:54.855895 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ba750-6592-4258-8b8f-1b36a4a976e8 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:54.946103 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1080/2147] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:27:54 2022] PUT /identity/v3/projects/fb8fb5dce2f54fa9adc6068a15182644/users/f2211a8570d0492c9ff2b6e67eb868e1/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:54.957515 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d47a22-563b-4318-a756-207819db9592 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:54.957857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d47a22-563b-4318-a756-207819db9592 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:54.958141 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d47a22-563b-4318-a756-207819db9592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:54.982279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-820ba750-6592-4258-8b8f-1b36a4a976e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8663bc56e0f4f2aa3368045bf6f3f95', 'request_id': 'req-820ba750-6592-4258-8b8f-1b36a4a976e8'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:54.985858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-f8d47a22-563b-4318-a756-207819db9592 None None] MFA Rules not processed for user `f2211a8570d0492c9ff2b6e67eb868e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:54.987101 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-f8d47a22-563b-4318-a756-207819db9592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:54.988122 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-820ba750-6592-4258-8b8f-1b36a4a976e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8663bc56e0f4f2aa3368045bf6f3f95', 'request_id': 'req-820ba750-6592-4258-8b8f-1b36a4a976e8'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:55.049615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1081/2148] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:27:55.060912 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d47a22-563b-4318-a756-207819db9592 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:55.062289 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-f8d47a22-563b-4318-a756-207819db9592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:55.063636 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-820ba750-6592-4258-8b8f-1b36a4a976e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8663bc56e0f4f2aa3368045bf6f3f95', 'request_id': 'req-820ba750-6592-4258-8b8f-1b36a4a976e8'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:55.076336 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-820ba750-6592-4258-8b8f-1b36a4a976e8 admin admin] The token cache is being invalidate because project a8663bc56e0f4f2aa3368045bf6f3f95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:27:55.076614 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-820ba750-6592-4258-8b8f-1b36a4a976e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:55.077274 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-820ba750-6592-4258-8b8f-1b36a4a976e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:27:55.078873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1068/2149] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:27:54 2022] DELETE /identity/v3/projects/a8663bc56e0f4f2aa3368045bf6f3f95 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:55.083926 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685be91-1550-45f9-95eb-1307874af923 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:55.084235 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685be91-1550-45f9-95eb-1307874af923 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:55.084519 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685be91-1550-45f9-95eb-1307874af923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:55.102173 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-7685be91-1550-45f9-95eb-1307874af923 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:55.104167 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7685be91-1550-45f9-95eb-1307874af923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:55.126063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d47a22-563b-4318-a756-207819db9592 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:55.129785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ec749-6d84-4752-8f67-a137d3bb32d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:55.130440 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ec749-6d84-4752-8f67-a137d3bb32d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:55.133911 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ec749-6d84-4752-8f67-a137d3bb32d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:55.133911 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ec749-6d84-4752-8f67-a137d3bb32d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:55.133911 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-107ec749-6d84-4752-8f67-a137d3bb32d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:55.144598 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ec749-6d84-4752-8f67-a137d3bb32d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:55.146095 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ec749-6d84-4752-8f67-a137d3bb32d4 service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:55.156057 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1082/2150] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:27:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:27:55.163737 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1069/2151] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:27:55.174636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e88c6-812b-4435-87bf-dc75ca5fc271 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:55.174636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e88c6-812b-4435-87bf-dc75ca5fc271 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:55.174636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e88c6-812b-4435-87bf-dc75ca5fc271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:55.191727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-5d0e88c6-812b-4435-87bf-dc75ca5fc271 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:55.192927 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-5d0e88c6-812b-4435-87bf-dc75ca5fc271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:55.201718 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1083/2152] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:55.202913 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:55.205995 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685be91-1550-45f9-95eb-1307874af923 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:55.216975 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685be91-1550-45f9-95eb-1307874af923 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:55.221801 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9a8d9-a0e2-486a-a9bf-ab95b5985987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:55.222478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9a8d9-a0e2-486a-a9bf-ab95b5985987 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:55.222762 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9a8d9-a0e2-486a-a9bf-ab95b5985987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:55.223043 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9a8d9-a0e2-486a-a9bf-ab95b5985987 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:55.224024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be9a8d9-a0e2-486a-a9bf-ab95b5985987 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:27:55.224152 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be9a8d9-a0e2-486a-a9bf-ab95b5985987 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:55.225781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be9a8d9-a0e2-486a-a9bf-ab95b5985987 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:55.241813 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1070/2153] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:27:55.245555 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e88c6-812b-4435-87bf-dc75ca5fc271 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:55.255443 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e88c6-812b-4435-87bf-dc75ca5fc271 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:55.261437 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb7ff50-e653-46ac-9a7d-ac319d03a36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:55.262221 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7ff50-e653-46ac-9a7d-ac319d03a36f admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:55.262577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7ff50-e653-46ac-9a7d-ac319d03a36f admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:55.262933 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7ff50-e653-46ac-9a7d-ac319d03a36f admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:55.263730 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb7ff50-e653-46ac-9a7d-ac319d03a36f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:55.265668 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb7ff50-e653-46ac-9a7d-ac319d03a36f admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:55.370930 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1084/2154] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:27:55 2022] POST /identity/v3/projects => generated 401 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:27:55.375636 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9a8d9-a0e2-486a-a9bf-ab95b5985987 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:55.386297 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9a8d9-a0e2-486a-a9bf-ab95b5985987 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:55.441322 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129d7df-c889-49c1-a5b7-427b68bb781f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:55.442025 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129d7df-c889-49c1-a5b7-427b68bb781f admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:55.442314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129d7df-c889-49c1-a5b7-427b68bb781f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:55.442590 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129d7df-c889-49c1-a5b7-427b68bb781f admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:55.443272 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129d7df-c889-49c1-a5b7-427b68bb781f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:55.445204 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129d7df-c889-49c1-a5b7-427b68bb781f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:55.595965 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1071/2155] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:27:55 2022] POST /identity/v3/users => generated 301 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:27:55.596602 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb7ff50-e653-46ac-9a7d-ac319d03a36f admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:55.596602 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb7ff50-e653-46ac-9a7d-ac319d03a36f admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:55.596602 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf94235-34c8-4d37-a725-cb88a622f800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:55.596602 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf94235-34c8-4d37-a725-cb88a622f800 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:55.596948 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf94235-34c8-4d37-a725-cb88a622f800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:55.596948 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf94235-34c8-4d37-a725-cb88a622f800 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:55.596948 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf94235-34c8-4d37-a725-cb88a622f800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:55.598235 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf94235-34c8-4d37-a725-cb88a622f800 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:55.609049 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1085/2156] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:27:55.613163 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129d7df-c889-49c1-a5b7-427b68bb781f admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:55.623789 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129d7df-c889-49c1-a5b7-427b68bb781f admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:55.628518 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4071aa-4365-4092-a1c1-b3a142787824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:55.629278 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4071aa-4365-4092-a1c1-b3a142787824 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:55.629563 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4071aa-4365-4092-a1c1-b3a142787824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:55.629867 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4071aa-4365-4092-a1c1-b3a142787824 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:55.630636 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4071aa-4365-4092-a1c1-b3a142787824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:55.632224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4071aa-4365-4092-a1c1-b3a142787824 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:55.642958 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1072/2157] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:27:55.647262 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf94235-34c8-4d37-a725-cb88a622f800 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:55.657953 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf94235-34c8-4d37-a725-cb88a622f800 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:55.665319 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3aceea-0748-4457-b19a-055857598ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:55.666301 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3aceea-0748-4457-b19a-055857598ffa admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:55.666602 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3aceea-0748-4457-b19a-055857598ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:55.666891 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3aceea-0748-4457-b19a-055857598ffa admin admin] PATH_INFO: `/v3/projects/18f4f6fc6c79454183eeee8a4f8324cd/users/b315b58b08f64285a49a7f1696e2e570/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:55.686177 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3aceea-0748-4457-b19a-055857598ffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=18f4f6fc6c79454183eeee8a4f8324cd, user_id=b315b58b08f64285a49a7f1696e2e570, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:55.689212 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3aceea-0748-4457-b19a-055857598ffa admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:55.780848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1086/2158] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:27:55 2022] PUT /identity/v3/projects/18f4f6fc6c79454183eeee8a4f8324cd/users/b315b58b08f64285a49a7f1696e2e570/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:55.791378 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb64a1f-059c-4ce4-9618-e15f9b0eeb31 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:55.791677 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb64a1f-059c-4ce4-9618-e15f9b0eeb31 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:55.791989 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb64a1f-059c-4ce4-9618-e15f9b0eeb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:55.818786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-ecb64a1f-059c-4ce4-9618-e15f9b0eeb31 None None] MFA Rules not processed for user `b315b58b08f64285a49a7f1696e2e570`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:55.819984 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ecb64a1f-059c-4ce4-9618-e15f9b0eeb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:55.887625 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1073/2159] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:27:55.890717 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3aceea-0748-4457-b19a-055857598ffa admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:55.925386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:55.977454 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3aceea-0748-4457-b19a-055857598ffa admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:55.982657 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432bb7b8-f662-4a48-b152-01ad701a9356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:55.983328 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432bb7b8-f662-4a48-b152-01ad701a9356 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:55.983607 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432bb7b8-f662-4a48-b152-01ad701a9356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:55.983888 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432bb7b8-f662-4a48-b152-01ad701a9356 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:55.984585 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432bb7b8-f662-4a48-b152-01ad701a9356 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:55.986539 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432bb7b8-f662-4a48-b152-01ad701a9356 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:56.129754 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1087/2160] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:27:55 2022] POST /identity/v3/projects => generated 401 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:27:56.133839 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb64a1f-059c-4ce4-9618-e15f9b0eeb31 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:56.144939 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb64a1f-059c-4ce4-9618-e15f9b0eeb31 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:56.202059 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fcb96-0277-458b-862b-ff978da97e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:56.202743 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fcb96-0277-458b-862b-ff978da97e23 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:56.203038 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fcb96-0277-458b-862b-ff978da97e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:56.203322 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fcb96-0277-458b-862b-ff978da97e23 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:56.204026 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fcb96-0277-458b-862b-ff978da97e23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:56.206004 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fcb96-0277-458b-862b-ff978da97e23 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:56.328661 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1074/2161] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:27:56 2022] POST /identity/v3/users => generated 307 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:27:56.332551 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432bb7b8-f662-4a48-b152-01ad701a9356 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:56.342629 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432bb7b8-f662-4a48-b152-01ad701a9356 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:56.347174 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65778c3-a25d-42dc-8c10-8585ba064b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:56.348062 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65778c3-a25d-42dc-8c10-8585ba064b4a admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:56.348355 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65778c3-a25d-42dc-8c10-8585ba064b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:56.348633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65778c3-a25d-42dc-8c10-8585ba064b4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:56.349362 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65778c3-a25d-42dc-8c10-8585ba064b4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:56.351081 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65778c3-a25d-42dc-8c10-8585ba064b4a admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:56.362391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1088/2162] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:27:56.366673 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fcb96-0277-458b-862b-ff978da97e23 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:56.377317 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fcb96-0277-458b-862b-ff978da97e23 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:56.381977 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a53e8e-7c6e-4b7e-a006-1691d5e059f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:56.382804 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a53e8e-7c6e-4b7e-a006-1691d5e059f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:56.383092 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a53e8e-7c6e-4b7e-a006-1691d5e059f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:56.383372 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a53e8e-7c6e-4b7e-a006-1691d5e059f5 admin admin] PATH_INFO: `/v3/projects/a958bce03f85457dbbc4abed277f2e38/users/e2fd955cf5b54612ba53eb0a4799a77e/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:56.399006 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a53e8e-7c6e-4b7e-a006-1691d5e059f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a958bce03f85457dbbc4abed277f2e38, user_id=e2fd955cf5b54612ba53eb0a4799a77e, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:56.402688 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a53e8e-7c6e-4b7e-a006-1691d5e059f5 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:56.488678 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1075/2163] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:27:56 2022] PUT /identity/v3/projects/a958bce03f85457dbbc4abed277f2e38/users/e2fd955cf5b54612ba53eb0a4799a77e/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:56.495145 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65778c3-a25d-42dc-8c10-8585ba064b4a admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:56.503018 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65778c3-a25d-42dc-8c10-8585ba064b4a admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:56.560370 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12ba71-0350-461a-8d94-9d4ae7c92a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:56.561068 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12ba71-0350-461a-8d94-9d4ae7c92a01 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:56.561365 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12ba71-0350-461a-8d94-9d4ae7c92a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:56.561650 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12ba71-0350-461a-8d94-9d4ae7c92a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:56.562416 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12ba71-0350-461a-8d94-9d4ae7c92a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:56.564054 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12ba71-0350-461a-8d94-9d4ae7c92a01 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:56.574971 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1089/2164] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:27:56.579239 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a53e8e-7c6e-4b7e-a006-1691d5e059f5 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:56.590412 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a53e8e-7c6e-4b7e-a006-1691d5e059f5 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:56.595106 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f6532-78b2-4eda-8229-b6579adda7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:56.595986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f6532-78b2-4eda-8229-b6579adda7d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:56.596531 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f6532-78b2-4eda-8229-b6579adda7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:56.596531 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f6532-78b2-4eda-8229-b6579adda7d6 admin admin] PATH_INFO: `/v3/projects/a958bce03f85457dbbc4abed277f2e38/users/e2fd955cf5b54612ba53eb0a4799a77e/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:56.598518 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f6532-78b2-4eda-8229-b6579adda7d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a958bce03f85457dbbc4abed277f2e38, user_id=e2fd955cf5b54612ba53eb0a4799a77e, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:56.601176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f6532-78b2-4eda-8229-b6579adda7d6 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:56.612205 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1076/2165] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:27:56 2022] PUT /identity/v3/projects/a958bce03f85457dbbc4abed277f2e38/users/e2fd955cf5b54612ba53eb0a4799a77e/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:27:56.623505 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a801162-3902-44e7-822f-5d874ecb26ac None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:56.623802 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a801162-3902-44e7-822f-5d874ecb26ac None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:56.624085 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a801162-3902-44e7-822f-5d874ecb26ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:56.650892 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-4a801162-3902-44e7-822f-5d874ecb26ac None None] MFA Rules not processed for user `e2fd955cf5b54612ba53eb0a4799a77e`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:27:56.652324 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-4a801162-3902-44e7-822f-5d874ecb26ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:56.682497 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:56.723835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1090/2166] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:27:56 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:27:56.732199 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f6532-78b2-4eda-8229-b6579adda7d6 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:56.734030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9f2f6532-78b2-4eda-8229-b6579adda7d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:27:56.798336 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f6532-78b2-4eda-8229-b6579adda7d6 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:56.802195 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce640ae1-8824-43de-b9c2-705ff834b977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:56.803103 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce640ae1-8824-43de-b9c2-705ff834b977 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:56.803396 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce640ae1-8824-43de-b9c2-705ff834b977 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:56.803674 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce640ae1-8824-43de-b9c2-705ff834b977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:56.813206 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce640ae1-8824-43de-b9c2-705ff834b977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:56.814657 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce640ae1-8824-43de-b9c2-705ff834b977 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:56.832081 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1077/2167] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:27:56 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:27:57.185540 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a801162-3902-44e7-822f-5d874ecb26ac None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:27:57.199493 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a801162-3902-44e7-822f-5d874ecb26ac None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:27:57.203784 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946c289-03d1-4cb1-8d0a-f128bdc90302 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:27:57.204553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946c289-03d1-4cb1-8d0a-f128bdc90302 service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:27:57.204903 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946c289-03d1-4cb1-8d0a-f128bdc90302 service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:27:57.205247 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946c289-03d1-4cb1-8d0a-f128bdc90302 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:27:57.290082 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946c289-03d1-4cb1-8d0a-f128bdc90302 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:27:57.292166 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946c289-03d1-4cb1-8d0a-f128bdc90302 service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:27:57.303845 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1091/2168] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:27:57 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:27:57.414204 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:57.843669 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:58.271272 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:58.402978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:58.974169 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:59.002711 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:59.728342 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:59.819997 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:00.472254 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:00.570137 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:01.161508 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:01.281163 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:01.739853 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:01.893968 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:02.338128 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:02.454403 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:02.677340 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:03.155729 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:03.243212 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:03.602557 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:03.654299 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:03.847701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce640ae1-8824-43de-b9c2-705ff834b977 service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:03.849315 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ce640ae1-8824-43de-b9c2-705ff834b977 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:03.918241 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce640ae1-8824-43de-b9c2-705ff834b977 service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:03.922984 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc393c99-8b02-4273-9fa5-7a1688f8d23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:03.923982 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc393c99-8b02-4273-9fa5-7a1688f8d23d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:03.924266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc393c99-8b02-4273-9fa5-7a1688f8d23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:03.924570 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc393c99-8b02-4273-9fa5-7a1688f8d23d admin admin] PATH_INFO: `/v3/users/f2211a8570d0492c9ff2b6e67eb868e1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:03.925977 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc393c99-8b02-4273-9fa5-7a1688f8d23d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2211a8570d0492c9ff2b6e67eb868e1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:03.928316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc393c99-8b02-4273-9fa5-7a1688f8d23d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:03.936008 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:03.974961 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:03.977841 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946c289-03d1-4cb1-8d0a-f128bdc90302 service cinder] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:03.988743 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946c289-03d1-4cb1-8d0a-f128bdc90302 service cinder] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:03.993414 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ff937-9799-4ca6-b092-8f63752638f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:03.994310 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ff937-9799-4ca6-b092-8f63752638f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:03.994599 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ff937-9799-4ca6-b092-8f63752638f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:03.995373 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ff937-9799-4ca6-b092-8f63752638f1 admin admin] PATH_INFO: `/v3/users/b315b58b08f64285a49a7f1696e2e570` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:03.996613 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055ff937-9799-4ca6-b092-8f63752638f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b315b58b08f64285a49a7f1696e2e570)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:03.998650 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055ff937-9799-4ca6-b092-8f63752638f1 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:04.142157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-dc393c99-8b02-4273-9fa5-7a1688f8d23d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2211a8570d0492c9ff2b6e67eb868e1'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:04.142855 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-dc393c99-8b02-4273-9fa5-7a1688f8d23d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2211a8570d0492c9ff2b6e67eb868e1'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:04.150161 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-dc393c99-8b02-4273-9fa5-7a1688f8d23d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2211a8570d0492c9ff2b6e67eb868e1'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:04.206638 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-055ff937-9799-4ca6-b092-8f63752638f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b315b58b08f64285a49a7f1696e2e570'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:04.231376 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-dc393c99-8b02-4273-9fa5-7a1688f8d23d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2211a8570d0492c9ff2b6e67eb868e1'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:04.243542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-dc393c99-8b02-4273-9fa5-7a1688f8d23d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2211a8570d0492c9ff2b6e67eb868e1'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:04.250016 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1078/2169] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:28:03 2022] DELETE /identity/v3/users/f2211a8570d0492c9ff2b6e67eb868e1 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:28:04.254310 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a52fd5-ec11-42c7-b883-afc61163e3d0 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:04.254601 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a52fd5-ec11-42c7-b883-afc61163e3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:04.254881 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a52fd5-ec11-42c7-b883-afc61163e3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:04.271533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-b9a52fd5-ec11-42c7-b883-afc61163e3d0 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:04.272744 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b9a52fd5-ec11-42c7-b883-afc61163e3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:04.327786 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-055ff937-9799-4ca6-b092-8f63752638f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b315b58b08f64285a49a7f1696e2e570'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:04.330912 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1079/2170] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:28:04.335522 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-055ff937-9799-4ca6-b092-8f63752638f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b315b58b08f64285a49a7f1696e2e570'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:04.336302 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-055ff937-9799-4ca6-b092-8f63752638f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b315b58b08f64285a49a7f1696e2e570'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:04.336916 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-055ff937-9799-4ca6-b092-8f63752638f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b315b58b08f64285a49a7f1696e2e570'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:04.341433 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a52fd5-ec11-42c7-b883-afc61163e3d0 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:04.342978 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b9a52fd5-ec11-42c7-b883-afc61163e3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:04.355295 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1092/2171] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:28:03 2022] DELETE /identity/v3/users/b315b58b08f64285a49a7f1696e2e570 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:28:04.359667 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfa280-5550-411a-a8ad-5b50c0c204de None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:04.360577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfa280-5550-411a-a8ad-5b50c0c204de None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:04.360577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfa280-5550-411a-a8ad-5b50c0c204de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:04.378507 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-b3dfa280-5550-411a-a8ad-5b50c0c204de None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:04.379716 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-b3dfa280-5550-411a-a8ad-5b50c0c204de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:04.402013 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a52fd5-ec11-42c7-b883-afc61163e3d0 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:04.440005 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1093/2172] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:28:04.450857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dfa280-5550-411a-a8ad-5b50c0c204de None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:04.452200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-b3dfa280-5550-411a-a8ad-5b50c0c204de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:04.456722 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f1004-9420-460a-b5c4-90f946d391b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:04.457383 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f1004-9420-460a-b5c4-90f946d391b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:04.457707 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f1004-9420-460a-b5c4-90f946d391b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:04.457978 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f1004-9420-460a-b5c4-90f946d391b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:04.459763 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8a7f1004-9420-460a-b5c4-90f946d391b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:04.464570 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dfa280-5550-411a-a8ad-5b50c0c204de None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:04.468140 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddc8af-2fba-4b64-bded-b6c99d50ff16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:04.468858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddc8af-2fba-4b64-bded-b6c99d50ff16 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:04.469091 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddc8af-2fba-4b64-bded-b6c99d50ff16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:04.469327 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddc8af-2fba-4b64-bded-b6c99d50ff16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:04.473068 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f1004-9420-460a-b5c4-90f946d391b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:04.474390 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f1004-9420-460a-b5c4-90f946d391b7 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:04.480135 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddc8af-2fba-4b64-bded-b6c99d50ff16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:04.481618 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddc8af-2fba-4b64-bded-b6c99d50ff16 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:04.486162 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1080/2173] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:28:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:28:04.491705 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1094/2174] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:28:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:28:04.580071 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:04.763253 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:05.093964 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f1004-9420-460a-b5c4-90f946d391b7 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:05.095876 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8a7f1004-9420-460a-b5c4-90f946d391b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:05.111893 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f1004-9420-460a-b5c4-90f946d391b7 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:05.117025 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faad387-c534-475e-89cc-a58acb657d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:05.118647 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faad387-c534-475e-89cc-a58acb657d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:05.118647 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faad387-c534-475e-89cc-a58acb657d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:05.118647 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faad387-c534-475e-89cc-a58acb657d10 admin admin] PATH_INFO: `/v3/projects/18f4f6fc6c79454183eeee8a4f8324cd` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:05.119788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faad387-c534-475e-89cc-a58acb657d10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18f4f6fc6c79454183eeee8a4f8324cd)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:05.125029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faad387-c534-475e-89cc-a58acb657d10 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:05.126711 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddc8af-2fba-4b64-bded-b6c99d50ff16 service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:05.128838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-46ddc8af-2fba-4b64-bded-b6c99d50ff16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:05.143362 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddc8af-2fba-4b64-bded-b6c99d50ff16 service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:05.148130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4540b6c-15d1-4719-9ed2-a5f5ebdb4965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:05.149028 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4540b6c-15d1-4719-9ed2-a5f5ebdb4965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:05.149318 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4540b6c-15d1-4719-9ed2-a5f5ebdb4965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:05.149598 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4540b6c-15d1-4719-9ed2-a5f5ebdb4965 admin admin] PATH_INFO: `/v3/projects/fb8fb5dce2f54fa9adc6068a15182644` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:05.150924 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4540b6c-15d1-4719-9ed2-a5f5ebdb4965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb8fb5dce2f54fa9adc6068a15182644)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:05.153487 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4540b6c-15d1-4719-9ed2-a5f5ebdb4965 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:05.244146 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1faad387-c534-475e-89cc-a58acb657d10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18f4f6fc6c79454183eeee8a4f8324cd', 'request_id': 'req-1faad387-c534-475e-89cc-a58acb657d10'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:05.251611 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1faad387-c534-475e-89cc-a58acb657d10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18f4f6fc6c79454183eeee8a4f8324cd', 'request_id': 'req-1faad387-c534-475e-89cc-a58acb657d10'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:05.273736 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-f4540b6c-15d1-4719-9ed2-a5f5ebdb4965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb8fb5dce2f54fa9adc6068a15182644', 'request_id': 'req-f4540b6c-15d1-4719-9ed2-a5f5ebdb4965'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:05.328030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1faad387-c534-475e-89cc-a58acb657d10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18f4f6fc6c79454183eeee8a4f8324cd', 'request_id': 'req-1faad387-c534-475e-89cc-a58acb657d10'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:05.339856 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1faad387-c534-475e-89cc-a58acb657d10 admin admin] The token cache is being invalidate because project 18f4f6fc6c79454183eeee8a4f8324cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:28:05.340149 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1faad387-c534-475e-89cc-a58acb657d10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:05.340825 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1faad387-c534-475e-89cc-a58acb657d10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:05.342392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1081/2175] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:28:05 2022] DELETE /identity/v3/projects/18f4f6fc6c79454183eeee8a4f8324cd => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:28:05.343614 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768f803-e07b-460b-85d1-f3e832a162d6 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:05.343901 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768f803-e07b-460b-85d1-f3e832a162d6 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:05.344178 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768f803-e07b-460b-85d1-f3e832a162d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:05.363747 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-b768f803-e07b-460b-85d1-f3e832a162d6 None None] MFA Rules not processed for user `cdfa8f4012c2471b81f8749b013d3117`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:05.364968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b768f803-e07b-460b-85d1-f3e832a162d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:05.422498 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1082/2176] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Jul 11 11:28:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:28:05.424585 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768f803-e07b-460b-85d1-f3e832a162d6 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:05.426011 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b768f803-e07b-460b-85d1-f3e832a162d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:05.436552 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-f4540b6c-15d1-4719-9ed2-a5f5ebdb4965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb8fb5dce2f54fa9adc6068a15182644', 'request_id': 'req-f4540b6c-15d1-4719-9ed2-a5f5ebdb4965'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:05.443353 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-f4540b6c-15d1-4719-9ed2-a5f5ebdb4965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb8fb5dce2f54fa9adc6068a15182644', 'request_id': 'req-f4540b6c-15d1-4719-9ed2-a5f5ebdb4965'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:05.454418 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-f4540b6c-15d1-4719-9ed2-a5f5ebdb4965 admin admin] The token cache is being invalidate because project fb8fb5dce2f54fa9adc6068a15182644 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:28:05.454709 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-f4540b6c-15d1-4719-9ed2-a5f5ebdb4965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:05.455401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-f4540b6c-15d1-4719-9ed2-a5f5ebdb4965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:05.457224 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1095/2177] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:28:05 2022] DELETE /identity/v3/projects/fb8fb5dce2f54fa9adc6068a15182644 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:28:05.459731 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4540b6c-15d1-4719-9ed2-a5f5ebdb4965 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:05.461071 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-f4540b6c-15d1-4719-9ed2-a5f5ebdb4965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:05.499849 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768f803-e07b-460b-85d1-f3e832a162d6 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:05.504936 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0e530-7a88-4b0e-8650-7ddbd937ac72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:05.507086 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0e530-7a88-4b0e-8650-7ddbd937ac72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:05.507086 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0e530-7a88-4b0e-8650-7ddbd937ac72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:05.507086 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0e530-7a88-4b0e-8650-7ddbd937ac72 admin admin] PATH_INFO: `/v3/users/e2fd955cf5b54612ba53eb0a4799a77e` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:05.507724 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0e530-7a88-4b0e-8650-7ddbd937ac72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2fd955cf5b54612ba53eb0a4799a77e)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:05.509625 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0e530-7a88-4b0e-8650-7ddbd937ac72 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:05.536053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4540b6c-15d1-4719-9ed2-a5f5ebdb4965 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:05.541136 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4808f40-1811-4743-b67b-51d5a608e6a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736f6d4d1dbb47ff98bc67e53614d49c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:05.542378 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4808f40-1811-4743-b67b-51d5a608e6a7 service swift] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:05.542663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4808f40-1811-4743-b67b-51d5a608e6a7 service swift] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:05.542949 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4808f40-1811-4743-b67b-51d5a608e6a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:05.544806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-e4808f40-1811-4743-b67b-51d5a608e6a7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:05.555843 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4808f40-1811-4743-b67b-51d5a608e6a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:05.557444 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4808f40-1811-4743-b67b-51d5a608e6a7 service swift] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:05.561137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:05.565968 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1096/2178] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jul 11 11:28:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 11:28:05.567345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea29f4a-555d-415b-bf4f-24db4cc06833 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:05.567723 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea29f4a-555d-415b-bf4f-24db4cc06833 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:05.568034 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea29f4a-555d-415b-bf4f-24db4cc06833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:05.588309 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-0ea29f4a-555d-415b-bf4f-24db4cc06833 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:05.590569 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-0ea29f4a-555d-415b-bf4f-24db4cc06833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:05.598785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1097/2179] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:28:05.606694 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f758d-2a5a-4b1f-8eef-1d90c081be6a None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:05.606987 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f758d-2a5a-4b1f-8eef-1d90c081be6a None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:05.607270 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f758d-2a5a-4b1f-8eef-1d90c081be6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:05.626490 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-674f758d-2a5a-4b1f-8eef-1d90c081be6a None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:05.627693 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-674f758d-2a5a-4b1f-8eef-1d90c081be6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:05.635730 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1098/2180] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:28:05.639690 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f758d-2a5a-4b1f-8eef-1d90c081be6a None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:05.648851 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f758d-2a5a-4b1f-8eef-1d90c081be6a None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:05.654663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33632cce-6277-4366-bf44-51b91f3f03a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:05.655379 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33632cce-6277-4366-bf44-51b91f3f03a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:05.655704 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33632cce-6277-4366-bf44-51b91f3f03a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:05.656049 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33632cce-6277-4366-bf44-51b91f3f03a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:05.656773 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33632cce-6277-4366-bf44-51b91f3f03a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:28:05.657123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33632cce-6277-4366-bf44-51b91f3f03a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:05.658861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33632cce-6277-4366-bf44-51b91f3f03a3 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:05.671826 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1099/2181] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:28:05.676489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33632cce-6277-4366-bf44-51b91f3f03a3 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:05.687095 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33632cce-6277-4366-bf44-51b91f3f03a3 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:05.692182 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd3dda-86e7-408e-a78c-f274ad466a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:05.692921 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd3dda-86e7-408e-a78c-f274ad466a20 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:05.693239 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd3dda-86e7-408e-a78c-f274ad466a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:05.693668 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd3dda-86e7-408e-a78c-f274ad466a20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:05.694259 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd3dda-86e7-408e-a78c-f274ad466a20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:05.696311 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd3dda-86e7-408e-a78c-f274ad466a20 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:05.714406 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:05.716308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-e3e0e530-7a88-4b0e-8650-7ddbd937ac72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2fd955cf5b54612ba53eb0a4799a77e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:05.717196 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-e3e0e530-7a88-4b0e-8650-7ddbd937ac72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2fd955cf5b54612ba53eb0a4799a77e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:05.731453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-e3e0e530-7a88-4b0e-8650-7ddbd937ac72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2fd955cf5b54612ba53eb0a4799a77e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:05.843954 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-e3e0e530-7a88-4b0e-8650-7ddbd937ac72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2fd955cf5b54612ba53eb0a4799a77e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:05.857989 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1100/2182] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:28:05 2022] POST /identity/v3/projects => generated 375 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:28:05.863105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd3dda-86e7-408e-a78c-f274ad466a20 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:05.866105 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-e3e0e530-7a88-4b0e-8650-7ddbd937ac72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2fd955cf5b54612ba53eb0a4799a77e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:05.874704 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1083/2183] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:28:05 2022] DELETE /identity/v3/users/e2fd955cf5b54612ba53eb0a4799a77e => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:28:05.991546 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd3dda-86e7-408e-a78c-f274ad466a20 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:06.061426 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310fbdeb-e672-490c-89cb-a6f4ac739936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:06.062300 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fbdeb-e672-490c-89cb-a6f4ac739936 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:06.062609 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fbdeb-e672-490c-89cb-a6f4ac739936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:06.068030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fbdeb-e672-490c-89cb-a6f4ac739936 admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:06.068030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310fbdeb-e672-490c-89cb-a6f4ac739936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:06.068030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310fbdeb-e672-490c-89cb-a6f4ac739936 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:06.112056 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:06.154895 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1101/2184] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:28:05 2022] POST /identity/v3/users => generated 288 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:28:06.157744 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0e530-7a88-4b0e-8650-7ddbd937ac72 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:06.159504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e3e0e530-7a88-4b0e-8650-7ddbd937ac72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:06.175020 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:06.180210 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0e530-7a88-4b0e-8650-7ddbd937ac72 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:06.197488 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4034543-2490-494b-9c65-a776c8cbb313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:06.199576 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4034543-2490-494b-9c65-a776c8cbb313 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:06.200086 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4034543-2490-494b-9c65-a776c8cbb313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:06.200700 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4034543-2490-494b-9c65-a776c8cbb313 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:06.201888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4034543-2490-494b-9c65-a776c8cbb313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:06.203714 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4034543-2490-494b-9c65-a776c8cbb313 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:06.220794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1084/2185] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:28:06.221888 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310fbdeb-e672-490c-89cb-a6f4ac739936 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:06.236195 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310fbdeb-e672-490c-89cb-a6f4ac739936 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:06.242648 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9f493-a7e1-46d8-96a4-17357bc76d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:06.243877 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9f493-a7e1-46d8-96a4-17357bc76d11 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:06.244355 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9f493-a7e1-46d8-96a4-17357bc76d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:06.244942 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9f493-a7e1-46d8-96a4-17357bc76d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:06.245957 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9f493-a7e1-46d8-96a4-17357bc76d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:06.249013 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9f493-a7e1-46d8-96a4-17357bc76d11 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:06.261220 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1102/2186] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:28:06.265453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4034543-2490-494b-9c65-a776c8cbb313 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:06.277052 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4034543-2490-494b-9c65-a776c8cbb313 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:06.283019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3def88-13e1-4f8e-a479-6c1a4d7d3e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:06.284699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3def88-13e1-4f8e-a479-6c1a4d7d3e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:06.285246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3def88-13e1-4f8e-a479-6c1a4d7d3e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:06.285997 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3def88-13e1-4f8e-a479-6c1a4d7d3e12 admin admin] PATH_INFO: `/v3/projects/cd1ec2e18bbd4d6c82a7941aae71c6d6/users/3fd1c0be055f4a2f9b033175f9a9d088/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:06.306571 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3def88-13e1-4f8e-a479-6c1a4d7d3e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd1ec2e18bbd4d6c82a7941aae71c6d6, user_id=3fd1c0be055f4a2f9b033175f9a9d088, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:06.311510 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3def88-13e1-4f8e-a479-6c1a4d7d3e12 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:06.431745 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:06.456945 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9f493-a7e1-46d8-96a4-17357bc76d11 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:06.457174 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1085/2187] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:28:06 2022] PUT /identity/v3/projects/cd1ec2e18bbd4d6c82a7941aae71c6d6/users/3fd1c0be055f4a2f9b033175f9a9d088/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:28:06.467834 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-2ea9f493-a7e1-46d8-96a4-17357bc76d11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:06.468992 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e36413-88c3-47d4-b7b5-bd284e5cb3df None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:06.469949 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e36413-88c3-47d4-b7b5-bd284e5cb3df None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:06.474783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e36413-88c3-47d4-b7b5-bd284e5cb3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:06.495638 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9f493-a7e1-46d8-96a4-17357bc76d11 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:06.499822 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:06.513827 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-39e36413-88c3-47d4-b7b5-bd284e5cb3df None None] MFA Rules not processed for user `3fd1c0be055f4a2f9b033175f9a9d088`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:06.515754 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-39e36413-88c3-47d4-b7b5-bd284e5cb3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:06.577738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fa186-74cc-4b80-8fc1-ed38c1d06345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:06.578643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fa186-74cc-4b80-8fc1-ed38c1d06345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:06.578945 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fa186-74cc-4b80-8fc1-ed38c1d06345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:06.579208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fa186-74cc-4b80-8fc1-ed38c1d06345 admin admin] PATH_INFO: `/v3/projects/a958bce03f85457dbbc4abed277f2e38` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:06.581886 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fa186-74cc-4b80-8fc1-ed38c1d06345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a958bce03f85457dbbc4abed277f2e38)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:06.584308 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fa186-74cc-4b80-8fc1-ed38c1d06345 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:06.620754 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1086/2188] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:28:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:28:06.625269 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e36413-88c3-47d4-b7b5-bd284e5cb3df None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:06.637120 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e36413-88c3-47d4-b7b5-bd284e5cb3df None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:06.647658 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9019e-bd32-40be-8577-a819e90bac4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:06.647658 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9019e-bd32-40be-8577-a819e90bac4b admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:06.647658 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9019e-bd32-40be-8577-a819e90bac4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:06.647658 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9019e-bd32-40be-8577-a819e90bac4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:06.648197 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9019e-bd32-40be-8577-a819e90bac4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:06.649864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9019e-bd32-40be-8577-a819e90bac4b admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:06.786254 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:06.806136 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6f4fa186-74cc-4b80-8fc1-ed38c1d06345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a958bce03f85457dbbc4abed277f2e38', 'request_id': 'req-6f4fa186-74cc-4b80-8fc1-ed38c1d06345'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:06.868390 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1087/2189] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:28:06 2022] POST /identity/v3/projects => generated 373 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:28:06.872627 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9019e-bd32-40be-8577-a819e90bac4b admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:06.883347 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:06.887468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6f4fa186-74cc-4b80-8fc1-ed38c1d06345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a958bce03f85457dbbc4abed277f2e38', 'request_id': 'req-6f4fa186-74cc-4b80-8fc1-ed38c1d06345'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:06.900512 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6f4fa186-74cc-4b80-8fc1-ed38c1d06345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a958bce03f85457dbbc4abed277f2e38', 'request_id': 'req-6f4fa186-74cc-4b80-8fc1-ed38c1d06345'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:06.925790 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6f4fa186-74cc-4b80-8fc1-ed38c1d06345 admin admin] The token cache is being invalidate because project a958bce03f85457dbbc4abed277f2e38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:28:06.926559 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6f4fa186-74cc-4b80-8fc1-ed38c1d06345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:06.927413 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6f4fa186-74cc-4b80-8fc1-ed38c1d06345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:06.934759 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1103/2190] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:28:06 2022] DELETE /identity/v3/projects/a958bce03f85457dbbc4abed277f2e38 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:28:06.938665 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037335e8-b78e-41be-8fcd-36ef63d5d009 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:06.941650 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037335e8-b78e-41be-8fcd-36ef63d5d009 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:06.941650 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037335e8-b78e-41be-8fcd-36ef63d5d009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:06.962846 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9019e-bd32-40be-8577-a819e90bac4b admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:06.972462 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-037335e8-b78e-41be-8fcd-36ef63d5d009 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:06.973350 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089fd2a-d8be-4c26-b959-3c29a43c5795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:06.973754 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-037335e8-b78e-41be-8fcd-36ef63d5d009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:06.974081 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089fd2a-d8be-4c26-b959-3c29a43c5795 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:06.974367 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089fd2a-d8be-4c26-b959-3c29a43c5795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:06.974649 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089fd2a-d8be-4c26-b959-3c29a43c5795 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:06.975367 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7089fd2a-d8be-4c26-b959-3c29a43c5795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:06.977381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7089fd2a-d8be-4c26-b959-3c29a43c5795 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:06.999741 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1104/2191] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:28:07.001103 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478e1d2-41bd-43cb-9ccc-a226c0701a7e None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:07.001451 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478e1d2-41bd-43cb-9ccc-a226c0701a7e None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:07.003775 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478e1d2-41bd-43cb-9ccc-a226c0701a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:07.030457 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-c478e1d2-41bd-43cb-9ccc-a226c0701a7e None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:07.031834 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-c478e1d2-41bd-43cb-9ccc-a226c0701a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:07.047795 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1105/2192] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:28:07.048722 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478e1d2-41bd-43cb-9ccc-a226c0701a7e None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:07.060110 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478e1d2-41bd-43cb-9ccc-a226c0701a7e None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:07.069094 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cac0dd-66b1-4684-b5fd-653f4510d3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:07.069945 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cac0dd-66b1-4684-b5fd-653f4510d3ef admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:07.070274 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cac0dd-66b1-4684-b5fd-653f4510d3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:07.070555 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cac0dd-66b1-4684-b5fd-653f4510d3ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:07.073786 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cac0dd-66b1-4684-b5fd-653f4510d3ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:28:07.073786 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cac0dd-66b1-4684-b5fd-653f4510d3ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:07.074018 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cac0dd-66b1-4684-b5fd-653f4510d3ef admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:07.088718 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1106/2193] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:28:07.089947 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1088/2194] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:28:06 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:28:07.096184 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089fd2a-d8be-4c26-b959-3c29a43c5795 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:07.098285 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cac0dd-66b1-4684-b5fd-653f4510d3ef admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:07.104780 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-42cac0dd-66b1-4684-b5fd-653f4510d3ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:07.114272 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089fd2a-d8be-4c26-b959-3c29a43c5795 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:07.124559 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7111e0a-2cad-4829-945f-20cd7e8513a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:07.125083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cac0dd-66b1-4684-b5fd-653f4510d3ef admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:07.125211 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7111e0a-2cad-4829-945f-20cd7e8513a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:07.125444 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7111e0a-2cad-4829-945f-20cd7e8513a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:07.125729 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7111e0a-2cad-4829-945f-20cd7e8513a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:07.126466 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7111e0a-2cad-4829-945f-20cd7e8513a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:07.128371 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7111e0a-2cad-4829-945f-20cd7e8513a4 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:07.130061 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab20d2-bf5b-4c49-909d-956ffa960640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:07.132646 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab20d2-bf5b-4c49-909d-956ffa960640 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:07.132646 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab20d2-bf5b-4c49-909d-956ffa960640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:07.132646 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab20d2-bf5b-4c49-909d-956ffa960640 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:07.132646 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab20d2-bf5b-4c49-909d-956ffa960640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:07.133558 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab20d2-bf5b-4c49-909d-956ffa960640 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:07.144468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1107/2195] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:28:07.148432 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab20d2-bf5b-4c49-909d-956ffa960640 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:07.158293 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab20d2-bf5b-4c49-909d-956ffa960640 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:07.167390 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a86e0b-95ea-4205-ae09-1d331b093ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:07.167390 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a86e0b-95ea-4205-ae09-1d331b093ef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:07.167390 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a86e0b-95ea-4205-ae09-1d331b093ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:07.167390 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a86e0b-95ea-4205-ae09-1d331b093ef1 admin admin] PATH_INFO: `/v3/projects/b206b92139534bab9377206707f572b4/users/a0f68b8a229d4c05bc070006c2c985a5/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:07.180542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a86e0b-95ea-4205-ae09-1d331b093ef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b206b92139534bab9377206707f572b4, user_id=a0f68b8a229d4c05bc070006c2c985a5, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:07.183969 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a86e0b-95ea-4205-ae09-1d331b093ef1 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:07.227983 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1089/2196] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:28:07 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:28:07.232666 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7111e0a-2cad-4829-945f-20cd7e8513a4 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:07.260027 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1108/2197] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:28:07 2022] PUT /identity/v3/projects/b206b92139534bab9377206707f572b4/users/a0f68b8a229d4c05bc070006c2c985a5/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:28:07.271299 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a86e0b-95ea-4205-ae09-1d331b093ef1 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:07.319087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7111e0a-2cad-4829-945f-20cd7e8513a4 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:07.344495 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:07.354107 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a86e0b-95ea-4205-ae09-1d331b093ef1 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:07.361584 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a8014-5c9a-47f1-9170-dc3d1b858a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:07.362968 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a8014-5c9a-47f1-9170-dc3d1b858a68 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:07.362968 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a8014-5c9a-47f1-9170-dc3d1b858a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:07.362968 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a8014-5c9a-47f1-9170-dc3d1b858a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:07.363662 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a8014-5c9a-47f1-9170-dc3d1b858a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:07.365678 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a8014-5c9a-47f1-9170-dc3d1b858a68 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:07.376212 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:07.382178 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1109/2198] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:28:07.384822 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a8014-5c9a-47f1-9170-dc3d1b858a68 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:07.411147 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a8014-5c9a-47f1-9170-dc3d1b858a68 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:07.421447 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e684e-c644-42ff-876d-b4d4b238ddee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:07.422276 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b034059-a2a1-4a7f-9bf4-8aa3b4f18b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:07.423554 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e684e-c644-42ff-876d-b4d4b238ddee admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:07.423711 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b034059-a2a1-4a7f-9bf4-8aa3b4f18b76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:07.423808 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e684e-c644-42ff-876d-b4d4b238ddee admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:07.424041 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e684e-c644-42ff-876d-b4d4b238ddee admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:07.424433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b034059-a2a1-4a7f-9bf4-8aa3b4f18b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:07.424749 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b034059-a2a1-4a7f-9bf4-8aa3b4f18b76 admin admin] PATH_INFO: `/v3/projects/b206b92139534bab9377206707f572b4/users/a0f68b8a229d4c05bc070006c2c985a5/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:07.425522 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e684e-c644-42ff-876d-b4d4b238ddee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:07.427953 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b034059-a2a1-4a7f-9bf4-8aa3b4f18b76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b206b92139534bab9377206707f572b4, user_id=a0f68b8a229d4c05bc070006c2c985a5, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:07.428819 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e684e-c644-42ff-876d-b4d4b238ddee admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:07.433305 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b034059-a2a1-4a7f-9bf4-8aa3b4f18b76 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:07.453732 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1110/2199] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:28:07 2022] PUT /identity/v3/projects/b206b92139534bab9377206707f572b4/users/a0f68b8a229d4c05bc070006c2c985a5/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:28:07.466070 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d574c6-96cc-46e3-b647-96887fffe170 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:07.470735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d574c6-96cc-46e3-b647-96887fffe170 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:07.470735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d574c6-96cc-46e3-b647-96887fffe170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:07.498396 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-16d574c6-96cc-46e3-b647-96887fffe170 None None] MFA Rules not processed for user `a0f68b8a229d4c05bc070006c2c985a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:07.499638 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-16d574c6-96cc-46e3-b647-96887fffe170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:07.536069 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1090/2200] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:28:07 2022] POST /identity/v3/users => generated 289 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:28:07.540036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e684e-c644-42ff-876d-b4d4b238ddee admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:07.555087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e684e-c644-42ff-876d-b4d4b238ddee admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:07.601571 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1111/2201] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:28:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:28:07.613032 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d574c6-96cc-46e3-b647-96887fffe170 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:07.620024 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-16d574c6-96cc-46e3-b647-96887fffe170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:07.634724 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50ef39-8f4e-4e28-933f-c7f35080778c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:07.644682 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50ef39-8f4e-4e28-933f-c7f35080778c admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:07.648650 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:07.648650 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50ef39-8f4e-4e28-933f-c7f35080778c admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:07.648650 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50ef39-8f4e-4e28-933f-c7f35080778c admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:07.648650 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50ef39-8f4e-4e28-933f-c7f35080778c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:07.649552 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50ef39-8f4e-4e28-933f-c7f35080778c admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:07.667828 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1091/2202] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:28:07.669220 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50ef39-8f4e-4e28-933f-c7f35080778c admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:07.680538 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50ef39-8f4e-4e28-933f-c7f35080778c admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:07.691855 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5fac3-9b2c-4ec2-9237-e6c416690003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:07.692548 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5fac3-9b2c-4ec2-9237-e6c416690003 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:07.692833 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5fac3-9b2c-4ec2-9237-e6c416690003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:07.693751 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5fac3-9b2c-4ec2-9237-e6c416690003 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:07.694519 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5fac3-9b2c-4ec2-9237-e6c416690003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:07.696828 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5fac3-9b2c-4ec2-9237-e6c416690003 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:07.709932 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1092/2203] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:28:07.714757 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5fac3-9b2c-4ec2-9237-e6c416690003 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:07.714930 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:07.720027 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d574c6-96cc-46e3-b647-96887fffe170 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:07.728835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f034d30-f28a-4a6c-8bab-8d080682a240 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:07.728835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f034d30-f28a-4a6c-8bab-8d080682a240 service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:07.728835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f034d30-f28a-4a6c-8bab-8d080682a240 service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:07.728835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f034d30-f28a-4a6c-8bab-8d080682a240 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:07.731000 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-2f034d30-f28a-4a6c-8bab-8d080682a240 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:07.731446 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5fac3-9b2c-4ec2-9237-e6c416690003 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:07.739019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfaaad1-7abf-42f1-b7c5-a26583bacbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:07.740201 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfaaad1-7abf-42f1-b7c5-a26583bacbb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:07.740640 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfaaad1-7abf-42f1-b7c5-a26583bacbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:07.741100 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfaaad1-7abf-42f1-b7c5-a26583bacbb7 admin admin] PATH_INFO: `/v3/projects/e5e5654be7d348109dec4eeb8ebd320f/users/f08214da2763419295cd75ff8c008031/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:07.768333 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfaaad1-7abf-42f1-b7c5-a26583bacbb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5e5654be7d348109dec4eeb8ebd320f, user_id=f08214da2763419295cd75ff8c008031, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:07.774137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfaaad1-7abf-42f1-b7c5-a26583bacbb7 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:07.811224 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f034d30-f28a-4a6c-8bab-8d080682a240 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:07.813040 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f034d30-f28a-4a6c-8bab-8d080682a240 service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:07.825038 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1112/2204] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:28:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:28:07.954572 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cf5d7-49f4-4b6e-a212-c869e25bb58c None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:07.955935 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cf5d7-49f4-4b6e-a212-c869e25bb58c None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:07.956430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cf5d7-49f4-4b6e-a212-c869e25bb58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:07.958562 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1093/2205] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:28:07 2022] PUT /identity/v3/projects/e5e5654be7d348109dec4eeb8ebd320f/users/f08214da2763419295cd75ff8c008031/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:28:08.007667 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-8b5cf5d7-49f4-4b6e-a212-c869e25bb58c None None] MFA Rules not processed for user `f08214da2763419295cd75ff8c008031`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:08.009641 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-8b5cf5d7-49f4-4b6e-a212-c869e25bb58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:08.106795 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1113/2206] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:28:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:28:08.111554 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfaaad1-7abf-42f1-b7c5-a26583bacbb7 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:08.130151 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:08.200621 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfaaad1-7abf-42f1-b7c5-a26583bacbb7 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:08.207658 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2d478-2c69-461c-ba35-a7862739b1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:08.208827 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2d478-2c69-461c-ba35-a7862739b1eb admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:08.209114 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2d478-2c69-461c-ba35-a7862739b1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:08.209484 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2d478-2c69-461c-ba35-a7862739b1eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:08.210441 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2d478-2c69-461c-ba35-a7862739b1eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:08.215051 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2d478-2c69-461c-ba35-a7862739b1eb admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:08.271584 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:08.340144 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1094/2207] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:28:08 2022] POST /identity/v3/projects => generated 379 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:28:08.347318 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cf5d7-49f4-4b6e-a212-c869e25bb58c None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:08.360853 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cf5d7-49f4-4b6e-a212-c869e25bb58c None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:08.421490 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5dda7e-202e-4804-8015-e997232595e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:08.422218 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dda7e-202e-4804-8015-e997232595e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:08.422508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dda7e-202e-4804-8015-e997232595e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:08.422787 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dda7e-202e-4804-8015-e997232595e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:08.423476 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5dda7e-202e-4804-8015-e997232595e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:08.425530 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5dda7e-202e-4804-8015-e997232595e3 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:08.500465 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1114/2208] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:28:08 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:28:08.504796 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2d478-2c69-461c-ba35-a7862739b1eb admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:08.515701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2d478-2c69-461c-ba35-a7862739b1eb admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:08.520343 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c882686-f686-4fb9-87d5-8a0f95d0df0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:08.523441 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c882686-f686-4fb9-87d5-8a0f95d0df0c admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:08.523441 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c882686-f686-4fb9-87d5-8a0f95d0df0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:08.523441 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c882686-f686-4fb9-87d5-8a0f95d0df0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:08.523441 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c882686-f686-4fb9-87d5-8a0f95d0df0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:08.523846 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c882686-f686-4fb9-87d5-8a0f95d0df0c admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:08.535313 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1095/2209] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:28:08.539340 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5dda7e-202e-4804-8015-e997232595e3 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:08.549889 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5dda7e-202e-4804-8015-e997232595e3 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:08.554600 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da9ead-f274-4a10-96ea-b8f7601a4a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:08.555260 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da9ead-f274-4a10-96ea-b8f7601a4a61 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:08.555549 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da9ead-f274-4a10-96ea-b8f7601a4a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:08.555830 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da9ead-f274-4a10-96ea-b8f7601a4a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:08.556590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da9ead-f274-4a10-96ea-b8f7601a4a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:08.558361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da9ead-f274-4a10-96ea-b8f7601a4a61 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:08.573965 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1115/2210] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:28:08.574945 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c882686-f686-4fb9-87d5-8a0f95d0df0c admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:08.589245 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c882686-f686-4fb9-87d5-8a0f95d0df0c admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:08.594003 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584967db-b306-422f-9636-4411ad22c0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:08.594887 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584967db-b306-422f-9636-4411ad22c0e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:08.595171 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584967db-b306-422f-9636-4411ad22c0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:08.595447 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584967db-b306-422f-9636-4411ad22c0e2 admin admin] PATH_INFO: `/v3/projects/8af37a8c75c947fc9cf575757f1bbeca/users/2e733d4c4cf940efb8b7555f549443d0/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:08.607020 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:08.613793 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584967db-b306-422f-9636-4411ad22c0e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8af37a8c75c947fc9cf575757f1bbeca, user_id=2e733d4c4cf940efb8b7555f549443d0, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:08.616658 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584967db-b306-422f-9636-4411ad22c0e2 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:08.729336 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1096/2211] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:28:08 2022] PUT /identity/v3/projects/8af37a8c75c947fc9cf575757f1bbeca/users/2e733d4c4cf940efb8b7555f549443d0/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:28:08.742039 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2635e-738a-413f-84e4-36cb001d14f7 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:08.742334 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2635e-738a-413f-84e4-36cb001d14f7 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:08.742618 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2635e-738a-413f-84e4-36cb001d14f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:08.780119 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-08f2635e-738a-413f-84e4-36cb001d14f7 None None] MFA Rules not processed for user `2e733d4c4cf940efb8b7555f549443d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:08.781373 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-08f2635e-738a-413f-84e4-36cb001d14f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:08.866365 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:08.880023 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1116/2212] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:28:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:28:08.884789 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584967db-b306-422f-9636-4411ad22c0e2 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:08.955010 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584967db-b306-422f-9636-4411ad22c0e2 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:08.961250 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269fa2a-fbd1-4d9b-8bf6-f85adcffc1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:08.961948 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269fa2a-fbd1-4d9b-8bf6-f85adcffc1b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:08.962244 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269fa2a-fbd1-4d9b-8bf6-f85adcffc1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:08.962527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269fa2a-fbd1-4d9b-8bf6-f85adcffc1b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:08.963228 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269fa2a-fbd1-4d9b-8bf6-f85adcffc1b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:08.965258 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269fa2a-fbd1-4d9b-8bf6-f85adcffc1b4 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:09.152809 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1097/2213] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:28:08 2022] POST /identity/v3/projects => generated 377 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:28:09.156886 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2635e-738a-413f-84e4-36cb001d14f7 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:09.168019 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2635e-738a-413f-84e4-36cb001d14f7 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:09.228329 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67691cce-cf9e-4914-872b-ec56ee442fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:09.229512 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67691cce-cf9e-4914-872b-ec56ee442fed admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:09.229858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67691cce-cf9e-4914-872b-ec56ee442fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:09.230139 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67691cce-cf9e-4914-872b-ec56ee442fed admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:09.230929 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67691cce-cf9e-4914-872b-ec56ee442fed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:09.233490 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67691cce-cf9e-4914-872b-ec56ee442fed admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:09.362708 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1117/2214] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:28:09 2022] POST /identity/v3/users => generated 295 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:28:09.366819 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269fa2a-fbd1-4d9b-8bf6-f85adcffc1b4 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:09.378725 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269fa2a-fbd1-4d9b-8bf6-f85adcffc1b4 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:09.383779 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96866a-b412-41f2-9178-016f3cf04636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:09.384471 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96866a-b412-41f2-9178-016f3cf04636 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:09.384754 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96866a-b412-41f2-9178-016f3cf04636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:09.385033 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96866a-b412-41f2-9178-016f3cf04636 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:09.386019 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96866a-b412-41f2-9178-016f3cf04636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:09.388435 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96866a-b412-41f2-9178-016f3cf04636 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:09.403800 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1098/2215] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:28:09.405469 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67691cce-cf9e-4914-872b-ec56ee442fed admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:09.417653 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67691cce-cf9e-4914-872b-ec56ee442fed admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:09.422512 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50a081-3a17-4428-ab5f-72ac51f7c0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:09.427333 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50a081-3a17-4428-ab5f-72ac51f7c0c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:09.427333 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50a081-3a17-4428-ab5f-72ac51f7c0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:09.427333 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50a081-3a17-4428-ab5f-72ac51f7c0c2 admin admin] PATH_INFO: `/v3/projects/964d6b27a4824e05a71f7942b5994547/users/5008601df65b4935bbf96516e9670763/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:09.441665 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50a081-3a17-4428-ab5f-72ac51f7c0c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=964d6b27a4824e05a71f7942b5994547, user_id=5008601df65b4935bbf96516e9670763, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:09.444487 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50a081-3a17-4428-ab5f-72ac51f7c0c2 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:09.518710 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1118/2216] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:28:09 2022] PUT /identity/v3/projects/964d6b27a4824e05a71f7942b5994547/users/5008601df65b4935bbf96516e9670763/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:28:09.520211 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96866a-b412-41f2-9178-016f3cf04636 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:09.533841 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96866a-b412-41f2-9178-016f3cf04636 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:09.574885 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:09.609389 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663296b4-0a23-4dd7-9cc0-16087d025e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:09.610062 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663296b4-0a23-4dd7-9cc0-16087d025e7f admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:09.610349 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663296b4-0a23-4dd7-9cc0-16087d025e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:09.610635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663296b4-0a23-4dd7-9cc0-16087d025e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:09.611453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663296b4-0a23-4dd7-9cc0-16087d025e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:09.613075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663296b4-0a23-4dd7-9cc0-16087d025e7f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:09.623801 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1099/2217] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:28:09.628195 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50a081-3a17-4428-ab5f-72ac51f7c0c2 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:09.641864 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50a081-3a17-4428-ab5f-72ac51f7c0c2 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:09.647711 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd38fd-0a9f-4499-86e4-6bd30b53a458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:09.648737 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd38fd-0a9f-4499-86e4-6bd30b53a458 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:09.649096 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd38fd-0a9f-4499-86e4-6bd30b53a458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:09.649459 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd38fd-0a9f-4499-86e4-6bd30b53a458 admin admin] PATH_INFO: `/v3/projects/964d6b27a4824e05a71f7942b5994547/users/5008601df65b4935bbf96516e9670763/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:09.652750 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd38fd-0a9f-4499-86e4-6bd30b53a458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=964d6b27a4824e05a71f7942b5994547, user_id=5008601df65b4935bbf96516e9670763, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:09.656353 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd38fd-0a9f-4499-86e4-6bd30b53a458 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:09.668631 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1119/2218] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:28:09 2022] PUT /identity/v3/projects/964d6b27a4824e05a71f7942b5994547/users/5008601df65b4935bbf96516e9670763/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:28:09.678704 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27a801-65f6-45af-a0b5-84491507df0a None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:09.678998 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27a801-65f6-45af-a0b5-84491507df0a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:09.679273 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27a801-65f6-45af-a0b5-84491507df0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:09.712115 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-aa27a801-65f6-45af-a0b5-84491507df0a None None] MFA Rules not processed for user `5008601df65b4935bbf96516e9670763`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:09.714423 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-aa27a801-65f6-45af-a0b5-84491507df0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:09.812145 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1100/2219] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:28:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:28:09.826807 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd38fd-0a9f-4499-86e4-6bd30b53a458 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:09.828448 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-fadd38fd-0a9f-4499-86e4-6bd30b53a458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:09.891685 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd38fd-0a9f-4499-86e4-6bd30b53a458 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:09.895410 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20260e4-de07-469b-9b1b-af16db65760f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:09.896057 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20260e4-de07-469b-9b1b-af16db65760f service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:09.896344 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20260e4-de07-469b-9b1b-af16db65760f service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:09.896620 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20260e4-de07-469b-9b1b-af16db65760f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:09.907149 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20260e4-de07-469b-9b1b-af16db65760f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:09.911084 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20260e4-de07-469b-9b1b-af16db65760f service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:09.918411 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1120/2220] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:28:09 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:28:10.083061 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27a801-65f6-45af-a0b5-84491507df0a None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:10.094298 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27a801-65f6-45af-a0b5-84491507df0a None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:10.098492 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba41a1-d8fe-433e-b02c-fdaba9dc8995 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:10.099509 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba41a1-d8fe-433e-b02c-fdaba9dc8995 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:10.099909 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba41a1-d8fe-433e-b02c-fdaba9dc8995 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:10.100273 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba41a1-d8fe-433e-b02c-fdaba9dc8995 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:10.188454 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba41a1-d8fe-433e-b02c-fdaba9dc8995 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:10.191195 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba41a1-d8fe-433e-b02c-fdaba9dc8995 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:10.208588 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1101/2221] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:28:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:28:12.300784 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20260e4-de07-469b-9b1b-af16db65760f service cinder] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:12.363424 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:12.380205 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20260e4-de07-469b-9b1b-af16db65760f service cinder] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:12.389177 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a720435-0cec-4ee3-b261-affce3c249c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:12.390713 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a720435-0cec-4ee3-b261-affce3c249c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:12.390713 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a720435-0cec-4ee3-b261-affce3c249c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:12.390713 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a720435-0cec-4ee3-b261-affce3c249c2 admin admin] PATH_INFO: `/v3/users/3fd1c0be055f4a2f9b033175f9a9d088` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:12.392462 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a720435-0cec-4ee3-b261-affce3c249c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fd1c0be055f4a2f9b033175f9a9d088)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:12.394522 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a720435-0cec-4ee3-b261-affce3c249c2 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:12.624472 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-7a720435-0cec-4ee3-b261-affce3c249c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fd1c0be055f4a2f9b033175f9a9d088'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:12.700729 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-7a720435-0cec-4ee3-b261-affce3c249c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fd1c0be055f4a2f9b033175f9a9d088'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:12.717989 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-7a720435-0cec-4ee3-b261-affce3c249c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fd1c0be055f4a2f9b033175f9a9d088'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:12.718977 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-7a720435-0cec-4ee3-b261-affce3c249c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fd1c0be055f4a2f9b033175f9a9d088'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:12.719689 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-7a720435-0cec-4ee3-b261-affce3c249c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fd1c0be055f4a2f9b033175f9a9d088'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:12.737783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ba386-095f-470a-b291-bbf6d6316293 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:12.738311 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ba386-095f-470a-b291-bbf6d6316293 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:12.738569 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ba386-095f-470a-b291-bbf6d6316293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:12.742987 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1121/2222] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:28:12 2022] DELETE /identity/v3/users/3fd1c0be055f4a2f9b033175f9a9d088 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:28:12.748025 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed33ad-636e-423b-8d38-2db8145ea4ec None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:12.748470 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed33ad-636e-423b-8d38-2db8145ea4ec None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:12.748711 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed33ad-636e-423b-8d38-2db8145ea4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:12.778965 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-16ed33ad-636e-423b-8d38-2db8145ea4ec None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:12.779209 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-c88ba386-095f-470a-b291-bbf6d6316293 None None] MFA Rules not processed for user `62bacc0d6a2342deac533c4de67041b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:12.781135 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-16ed33ad-636e-423b-8d38-2db8145ea4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:12.781278 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c88ba386-095f-470a-b291-bbf6d6316293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:12.853372 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:12.867023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1102/2223] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:28:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:28:12.879955 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1122/2224] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:28:12.892430 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ba386-095f-470a-b291-bbf6d6316293 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:12.893876 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c88ba386-095f-470a-b291-bbf6d6316293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:12.969559 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ba386-095f-470a-b291-bbf6d6316293 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:12.973573 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c258fd6-a67b-4026-8314-bbfaf21b7018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:12.974668 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c258fd6-a67b-4026-8314-bbfaf21b7018 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:12.975245 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c258fd6-a67b-4026-8314-bbfaf21b7018 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:12.975530 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c258fd6-a67b-4026-8314-bbfaf21b7018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:12.988266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c258fd6-a67b-4026-8314-bbfaf21b7018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:12.990046 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c258fd6-a67b-4026-8314-bbfaf21b7018 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:13.000703 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1103/2225] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:28:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:28:13.501061 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed33ad-636e-423b-8d38-2db8145ea4ec None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:13.515833 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-16ed33ad-636e-423b-8d38-2db8145ea4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:13.538503 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed33ad-636e-423b-8d38-2db8145ea4ec None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:13.546822 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc688fd-524f-4502-a275-c66fec2ed554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:13.547871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc688fd-524f-4502-a275-c66fec2ed554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:13.548157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc688fd-524f-4502-a275-c66fec2ed554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:13.548430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc688fd-524f-4502-a275-c66fec2ed554 admin admin] PATH_INFO: `/v3/projects/cd1ec2e18bbd4d6c82a7941aae71c6d6` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:13.550053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc688fd-524f-4502-a275-c66fec2ed554 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd1ec2e18bbd4d6c82a7941aae71c6d6)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:13.552028 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc688fd-524f-4502-a275-c66fec2ed554 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:13.716108 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-dbc688fd-524f-4502-a275-c66fec2ed554 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd1ec2e18bbd4d6c82a7941aae71c6d6', 'request_id': 'req-dbc688fd-524f-4502-a275-c66fec2ed554'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:13.783646 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-dbc688fd-524f-4502-a275-c66fec2ed554 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd1ec2e18bbd4d6c82a7941aae71c6d6', 'request_id': 'req-dbc688fd-524f-4502-a275-c66fec2ed554'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:13.793131 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-dbc688fd-524f-4502-a275-c66fec2ed554 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd1ec2e18bbd4d6c82a7941aae71c6d6', 'request_id': 'req-dbc688fd-524f-4502-a275-c66fec2ed554'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:13.794937 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:13.806048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-dbc688fd-524f-4502-a275-c66fec2ed554 admin admin] The token cache is being invalidate because project cd1ec2e18bbd4d6c82a7941aae71c6d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:28:13.806467 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-dbc688fd-524f-4502-a275-c66fec2ed554 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:13.807784 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-dbc688fd-524f-4502-a275-c66fec2ed554 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:13.809687 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1123/2226] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:28:13 2022] DELETE /identity/v3/projects/cd1ec2e18bbd4d6c82a7941aae71c6d6 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:28:13.814221 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c258fd6-a67b-4026-8314-bbfaf21b7018 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:13.828397 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c258fd6-a67b-4026-8314-bbfaf21b7018 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:13.898375 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0496c4-18cb-43f2-adad-d2a6e3a23e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:13.899548 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0496c4-18cb-43f2-adad-d2a6e3a23e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:13.900075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0496c4-18cb-43f2-adad-d2a6e3a23e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:13.900494 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0496c4-18cb-43f2-adad-d2a6e3a23e83 admin admin] PATH_INFO: `/v3/users/a0f68b8a229d4c05bc070006c2c985a5` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:13.902035 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0496c4-18cb-43f2-adad-d2a6e3a23e83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0f68b8a229d4c05bc070006c2c985a5)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:13.904452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0496c4-18cb-43f2-adad-d2a6e3a23e83 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:14.153582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bc0496c4-18cb-43f2-adad-d2a6e3a23e83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0f68b8a229d4c05bc070006c2c985a5'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:14.154745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bc0496c4-18cb-43f2-adad-d2a6e3a23e83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0f68b8a229d4c05bc070006c2c985a5'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:14.169967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bc0496c4-18cb-43f2-adad-d2a6e3a23e83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0f68b8a229d4c05bc070006c2c985a5'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:14.259620 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bc0496c4-18cb-43f2-adad-d2a6e3a23e83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0f68b8a229d4c05bc070006c2c985a5'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:14.278975 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bc0496c4-18cb-43f2-adad-d2a6e3a23e83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0f68b8a229d4c05bc070006c2c985a5'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:14.286663 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1104/2227] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:28:13 2022] DELETE /identity/v3/users/a0f68b8a229d4c05bc070006c2c985a5 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:28:14.720460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc688fd-524f-4502-a275-c66fec2ed554 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:14.720460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-dbc688fd-524f-4502-a275-c66fec2ed554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:14.742130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc688fd-524f-4502-a275-c66fec2ed554 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:14.814396 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa22091-3929-4814-9e35-b2917f90d4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:14.815397 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa22091-3929-4814-9e35-b2917f90d4ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:14.815683 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa22091-3929-4814-9e35-b2917f90d4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:14.815976 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa22091-3929-4814-9e35-b2917f90d4ce admin admin] PATH_INFO: `/v3/projects/b206b92139534bab9377206707f572b4` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:14.817166 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa22091-3929-4814-9e35-b2917f90d4ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=b206b92139534bab9377206707f572b4)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:14.819183 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa22091-3929-4814-9e35-b2917f90d4ce admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:14.986841 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-1aa22091-3929-4814-9e35-b2917f90d4ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b206b92139534bab9377206707f572b4', 'request_id': 'req-1aa22091-3929-4814-9e35-b2917f90d4ce'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:15.083126 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-1aa22091-3929-4814-9e35-b2917f90d4ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b206b92139534bab9377206707f572b4', 'request_id': 'req-1aa22091-3929-4814-9e35-b2917f90d4ce'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:15.092386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-1aa22091-3929-4814-9e35-b2917f90d4ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b206b92139534bab9377206707f572b4', 'request_id': 'req-1aa22091-3929-4814-9e35-b2917f90d4ce'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:15.105449 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-1aa22091-3929-4814-9e35-b2917f90d4ce admin admin] The token cache is being invalidate because project b206b92139534bab9377206707f572b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:28:15.105791 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-1aa22091-3929-4814-9e35-b2917f90d4ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:15.106497 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-1aa22091-3929-4814-9e35-b2917f90d4ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:15.109881 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1124/2228] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:28:14 2022] DELETE /identity/v3/projects/b206b92139534bab9377206707f572b4 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:28:15.115279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c00a39-a51d-4cf5-a4e9-a2ef32befd36 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:15.115780 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c00a39-a51d-4cf5-a4e9-a2ef32befd36 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:15.116066 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c00a39-a51d-4cf5-a4e9-a2ef32befd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:15.138266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-b0c00a39-a51d-4cf5-a4e9-a2ef32befd36 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:15.139442 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b0c00a39-a51d-4cf5-a4e9-a2ef32befd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:15.153747 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:15.210644 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1105/2229] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:28:15.224302 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8cd6e-32cc-4d7d-8834-198e6a1cb4d8 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:15.224792 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8cd6e-32cc-4d7d-8834-198e6a1cb4d8 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:15.225178 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8cd6e-32cc-4d7d-8834-198e6a1cb4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:15.252587 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-a7c8cd6e-32cc-4d7d-8834-198e6a1cb4d8 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:15.253819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-a7c8cd6e-32cc-4d7d-8834-198e6a1cb4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:15.263616 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1125/2230] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:28:15.270637 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c00a39-a51d-4cf5-a4e9-a2ef32befd36 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:15.290442 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c00a39-a51d-4cf5-a4e9-a2ef32befd36 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:15.299112 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493aac3-8092-48a2-9896-afac79e9be67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:15.300279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493aac3-8092-48a2-9896-afac79e9be67 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:15.300731 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493aac3-8092-48a2-9896-afac79e9be67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:15.301209 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493aac3-8092-48a2-9896-afac79e9be67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:15.302629 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f493aac3-8092-48a2-9896-afac79e9be67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:28:15.303044 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f493aac3-8092-48a2-9896-afac79e9be67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:15.305780 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f493aac3-8092-48a2-9896-afac79e9be67 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:15.332221 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1106/2231] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:28:15.333019 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8cd6e-32cc-4d7d-8834-198e6a1cb4d8 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:15.345035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8cd6e-32cc-4d7d-8834-198e6a1cb4d8 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:15.350433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b44f05-a419-4144-9b69-ef7752b6cf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:15.352852 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b44f05-a419-4144-9b69-ef7752b6cf3c admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:15.352852 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b44f05-a419-4144-9b69-ef7752b6cf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:15.352852 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b44f05-a419-4144-9b69-ef7752b6cf3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:15.352852 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b44f05-a419-4144-9b69-ef7752b6cf3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:15.354855 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b44f05-a419-4144-9b69-ef7752b6cf3c admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:15.439386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1126/2232] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:28:15 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:28:15.443564 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493aac3-8092-48a2-9896-afac79e9be67 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:15.456431 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493aac3-8092-48a2-9896-afac79e9be67 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:15.535869 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057b85d-794a-4397-8da3-c2c07aa9b74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:15.536658 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057b85d-794a-4397-8da3-c2c07aa9b74c admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:15.536908 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057b85d-794a-4397-8da3-c2c07aa9b74c admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:15.537206 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057b85d-794a-4397-8da3-c2c07aa9b74c admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:15.537983 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057b85d-794a-4397-8da3-c2c07aa9b74c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:15.540012 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057b85d-794a-4397-8da3-c2c07aa9b74c admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:15.617377 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b44f05-a419-4144-9b69-ef7752b6cf3c admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:15.624398 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-a7b44f05-a419-4144-9b69-ef7752b6cf3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:15.633442 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1107/2233] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:28:15 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:28:15.638471 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057b85d-794a-4397-8da3-c2c07aa9b74c admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:15.643642 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b44f05-a419-4144-9b69-ef7752b6cf3c admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:15.649531 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057b85d-794a-4397-8da3-c2c07aa9b74c admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:15.650095 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aff419-d394-4132-b464-7dcf72b78f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:15.652255 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aff419-d394-4132-b464-7dcf72b78f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:15.652606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aff419-d394-4132-b464-7dcf72b78f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:15.652891 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aff419-d394-4132-b464-7dcf72b78f56 admin admin] PATH_INFO: `/v3/users/f08214da2763419295cd75ff8c008031` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:15.654442 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aff419-d394-4132-b464-7dcf72b78f56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f08214da2763419295cd75ff8c008031)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:15.656070 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a93d99-155b-4de6-bc22-ade930f1e4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:15.656590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aff419-d394-4132-b464-7dcf72b78f56 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:15.656716 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a93d99-155b-4de6-bc22-ade930f1e4ed admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:15.657070 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a93d99-155b-4de6-bc22-ade930f1e4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:15.657505 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a93d99-155b-4de6-bc22-ade930f1e4ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:15.658405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a93d99-155b-4de6-bc22-ade930f1e4ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:15.660681 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a93d99-155b-4de6-bc22-ade930f1e4ed admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:15.679053 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1108/2234] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:28:15.683653 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a93d99-155b-4de6-bc22-ade930f1e4ed admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:15.695344 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a93d99-155b-4de6-bc22-ade930f1e4ed admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:15.702742 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe14f3c-9f73-4a8f-a580-f9198faec1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:15.711328 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe14f3c-9f73-4a8f-a580-f9198faec1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:15.711328 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe14f3c-9f73-4a8f-a580-f9198faec1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:15.711328 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe14f3c-9f73-4a8f-a580-f9198faec1e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:15.711328 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe14f3c-9f73-4a8f-a580-f9198faec1e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:15.711328 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe14f3c-9f73-4a8f-a580-f9198faec1e9 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:15.722850 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1109/2235] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:28:15.727061 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe14f3c-9f73-4a8f-a580-f9198faec1e9 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:15.741481 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe14f3c-9f73-4a8f-a580-f9198faec1e9 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:15.748969 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192409bb-7908-4e1b-9f88-f1295093118b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:15.750772 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192409bb-7908-4e1b-9f88-f1295093118b admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:15.751215 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192409bb-7908-4e1b-9f88-f1295093118b admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:15.751622 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192409bb-7908-4e1b-9f88-f1295093118b admin admin] PATH_INFO: `/v3/projects/616a6c8c53fb42e0978efe37c13fdf91/users/2417b79334c843e6a0d061d315b9cb35/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:15.776400 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192409bb-7908-4e1b-9f88-f1295093118b admin admin] RBAC: Authorizing `identity:create_grant(project_id=616a6c8c53fb42e0978efe37c13fdf91, user_id=2417b79334c843e6a0d061d315b9cb35, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:15.780389 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192409bb-7908-4e1b-9f88-f1295093118b admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:15.872744 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1110/2236] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:28:15 2022] PUT /identity/v3/projects/616a6c8c53fb42e0978efe37c13fdf91/users/2417b79334c843e6a0d061d315b9cb35/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:28:15.889883 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461d1b1-c109-4e9c-8718-dc7f649d69d2 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:15.892161 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461d1b1-c109-4e9c-8718-dc7f649d69d2 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:15.893296 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461d1b1-c109-4e9c-8718-dc7f649d69d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:15.921722 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-81aff419-d394-4132-b464-7dcf72b78f56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f08214da2763419295cd75ff8c008031'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:15.924693 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:15.954282 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-d461d1b1-c109-4e9c-8718-dc7f649d69d2 None None] MFA Rules not processed for user `2417b79334c843e6a0d061d315b9cb35`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:15.956885 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d461d1b1-c109-4e9c-8718-dc7f649d69d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:16.020573 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:16.073893 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-81aff419-d394-4132-b464-7dcf72b78f56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f08214da2763419295cd75ff8c008031'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:16.076541 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-81aff419-d394-4132-b464-7dcf72b78f56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f08214da2763419295cd75ff8c008031'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:16.077638 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-81aff419-d394-4132-b464-7dcf72b78f56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f08214da2763419295cd75ff8c008031'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:16.078360 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-81aff419-d394-4132-b464-7dcf72b78f56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f08214da2763419295cd75ff8c008031'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:16.139488 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1127/2237] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:28:15 2022] DELETE /identity/v3/users/f08214da2763419295cd75ff8c008031 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:28:16.146908 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73365f-980c-4d80-b232-64b5c72b8813 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:16.153314 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73365f-980c-4d80-b232-64b5c72b8813 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:16.158208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73365f-980c-4d80-b232-64b5c72b8813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:16.164972 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1111/2238] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:28:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:28:16.183339 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461d1b1-c109-4e9c-8718-dc7f649d69d2 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:16.185544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d461d1b1-c109-4e9c-8718-dc7f649d69d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:16.197747 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-bf73365f-980c-4d80-b232-64b5c72b8813 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:16.199620 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-bf73365f-980c-4d80-b232-64b5c72b8813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:16.298947 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461d1b1-c109-4e9c-8718-dc7f649d69d2 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:16.301074 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1128/2239] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:28:16.320210 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73365f-980c-4d80-b232-64b5c72b8813 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:16.321798 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-bf73365f-980c-4d80-b232-64b5c72b8813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:16.362004 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453fc00-5230-49f4-8ba3-cf1e236970a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:16.362602 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453fc00-5230-49f4-8ba3-cf1e236970a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:16.362892 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453fc00-5230-49f4-8ba3-cf1e236970a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:16.363176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453fc00-5230-49f4-8ba3-cf1e236970a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:16.365093 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1453fc00-5230-49f4-8ba3-cf1e236970a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:16.383027 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73365f-980c-4d80-b232-64b5c72b8813 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:16.387195 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea508695-f904-42a3-b288-40f43a288716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:16.387850 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea508695-f904-42a3-b288-40f43a288716 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:16.388136 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea508695-f904-42a3-b288-40f43a288716 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:16.388433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea508695-f904-42a3-b288-40f43a288716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:16.401903 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea508695-f904-42a3-b288-40f43a288716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:16.403363 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea508695-f904-42a3-b288-40f43a288716 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:16.414051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1129/2240] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:28:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:28:16.430458 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453fc00-5230-49f4-8ba3-cf1e236970a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:16.431933 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453fc00-5230-49f4-8ba3-cf1e236970a5 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:16.442293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1112/2241] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:28:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:28:16.938672 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea508695-f904-42a3-b288-40f43a288716 service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:16.941240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-ea508695-f904-42a3-b288-40f43a288716 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:16.958292 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea508695-f904-42a3-b288-40f43a288716 service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:16.964261 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb3531-4026-4f5d-ba10-a00e782a06e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:16.965647 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb3531-4026-4f5d-ba10-a00e782a06e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:16.966076 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb3531-4026-4f5d-ba10-a00e782a06e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:16.966820 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb3531-4026-4f5d-ba10-a00e782a06e6 admin admin] PATH_INFO: `/v3/projects/e5e5654be7d348109dec4eeb8ebd320f` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:16.968189 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb3531-4026-4f5d-ba10-a00e782a06e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5e5654be7d348109dec4eeb8ebd320f)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:16.970743 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb3531-4026-4f5d-ba10-a00e782a06e6 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:17.114553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-7afb3531-4026-4f5d-ba10-a00e782a06e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5e5654be7d348109dec4eeb8ebd320f', 'request_id': 'req-7afb3531-4026-4f5d-ba10-a00e782a06e6'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:17.225937 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-7afb3531-4026-4f5d-ba10-a00e782a06e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5e5654be7d348109dec4eeb8ebd320f', 'request_id': 'req-7afb3531-4026-4f5d-ba10-a00e782a06e6'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:17.234811 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-7afb3531-4026-4f5d-ba10-a00e782a06e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5e5654be7d348109dec4eeb8ebd320f', 'request_id': 'req-7afb3531-4026-4f5d-ba10-a00e782a06e6'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:17.251699 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:INSERT=2,keystone:DELETE=9,keystone:SELECT=89 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:17.278834 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-7afb3531-4026-4f5d-ba10-a00e782a06e6 admin admin] The token cache is being invalidate because project e5e5654be7d348109dec4eeb8ebd320f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:28:17.280141 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-7afb3531-4026-4f5d-ba10-a00e782a06e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:17.281225 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-7afb3531-4026-4f5d-ba10-a00e782a06e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:17.286007 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1130/2242] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:28:16 2022] DELETE /identity/v3/projects/e5e5654be7d348109dec4eeb8ebd320f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:28:17.289891 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453fc00-5230-49f4-8ba3-cf1e236970a5 service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:17.310383 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453fc00-5230-49f4-8ba3-cf1e236970a5 service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:17.389316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:17.406152 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86baabf0-a178-4bb0-a735-4c96f76c4ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:17.407462 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baabf0-a178-4bb0-a735-4c96f76c4ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:17.407756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baabf0-a178-4bb0-a735-4c96f76c4ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:17.408039 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baabf0-a178-4bb0-a735-4c96f76c4ffc admin admin] PATH_INFO: `/v3/users/2e733d4c4cf940efb8b7555f549443d0` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:17.409268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86baabf0-a178-4bb0-a735-4c96f76c4ffc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e733d4c4cf940efb8b7555f549443d0)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:17.411364 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86baabf0-a178-4bb0-a735-4c96f76c4ffc admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:17.641807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-86baabf0-a178-4bb0-a735-4c96f76c4ffc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e733d4c4cf940efb8b7555f549443d0'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:17.642647 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-86baabf0-a178-4bb0-a735-4c96f76c4ffc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e733d4c4cf940efb8b7555f549443d0'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:17.650609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-86baabf0-a178-4bb0-a735-4c96f76c4ffc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e733d4c4cf940efb8b7555f549443d0'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:17.733975 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-86baabf0-a178-4bb0-a735-4c96f76c4ffc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e733d4c4cf940efb8b7555f549443d0'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:17.747938 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-86baabf0-a178-4bb0-a735-4c96f76c4ffc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e733d4c4cf940efb8b7555f549443d0'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:17.755566 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1113/2243] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:28:17 2022] DELETE /identity/v3/users/2e733d4c4cf940efb8b7555f549443d0 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:28:18.340943 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb3531-4026-4f5d-ba10-a00e782a06e6 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:18.342879 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-7afb3531-4026-4f5d-ba10-a00e782a06e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:18.356990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb3531-4026-4f5d-ba10-a00e782a06e6 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:18.426053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5961d7-6786-4bfd-898d-00aea701a1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:18.426923 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5961d7-6786-4bfd-898d-00aea701a1d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:18.427204 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5961d7-6786-4bfd-898d-00aea701a1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:18.427619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5961d7-6786-4bfd-898d-00aea701a1d0 admin admin] PATH_INFO: `/v3/projects/8af37a8c75c947fc9cf575757f1bbeca` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:18.429316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5961d7-6786-4bfd-898d-00aea701a1d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8af37a8c75c947fc9cf575757f1bbeca)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:18.431298 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5961d7-6786-4bfd-898d-00aea701a1d0 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:18.589256 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-9e5961d7-6786-4bfd-898d-00aea701a1d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8af37a8c75c947fc9cf575757f1bbeca', 'request_id': 'req-9e5961d7-6786-4bfd-898d-00aea701a1d0'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:18.682835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-9e5961d7-6786-4bfd-898d-00aea701a1d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8af37a8c75c947fc9cf575757f1bbeca', 'request_id': 'req-9e5961d7-6786-4bfd-898d-00aea701a1d0'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:18.690421 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-9e5961d7-6786-4bfd-898d-00aea701a1d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8af37a8c75c947fc9cf575757f1bbeca', 'request_id': 'req-9e5961d7-6786-4bfd-898d-00aea701a1d0'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:18.703865 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-9e5961d7-6786-4bfd-898d-00aea701a1d0 admin admin] The token cache is being invalidate because project 8af37a8c75c947fc9cf575757f1bbeca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:28:18.704162 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-9e5961d7-6786-4bfd-898d-00aea701a1d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:18.704816 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-9e5961d7-6786-4bfd-898d-00aea701a1d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:18.706889 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1131/2244] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:28:18 2022] DELETE /identity/v3/projects/8af37a8c75c947fc9cf575757f1bbeca => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:28:18.711196 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86baabf0-a178-4bb0-a735-4c96f76c4ffc admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:18.715884 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-86baabf0-a178-4bb0-a735-4c96f76c4ffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:18.742687 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86baabf0-a178-4bb0-a735-4c96f76c4ffc admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:18.846313 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0214b8c-6ad4-48af-9c35-a0e5a59072a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:18.848115 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0214b8c-6ad4-48af-9c35-a0e5a59072a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:18.849750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0214b8c-6ad4-48af-9c35-a0e5a59072a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:18.849750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0214b8c-6ad4-48af-9c35-a0e5a59072a3 admin admin] PATH_INFO: `/v3/users/5008601df65b4935bbf96516e9670763` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:18.849954 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0214b8c-6ad4-48af-9c35-a0e5a59072a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5008601df65b4935bbf96516e9670763)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:18.851814 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0214b8c-6ad4-48af-9c35-a0e5a59072a3 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:19.061698 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c0214b8c-6ad4-48af-9c35-a0e5a59072a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5008601df65b4935bbf96516e9670763'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:19.062388 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c0214b8c-6ad4-48af-9c35-a0e5a59072a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5008601df65b4935bbf96516e9670763'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:19.070319 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c0214b8c-6ad4-48af-9c35-a0e5a59072a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5008601df65b4935bbf96516e9670763'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:19.190615 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c0214b8c-6ad4-48af-9c35-a0e5a59072a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5008601df65b4935bbf96516e9670763'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:19.205092 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:19.235188 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c0214b8c-6ad4-48af-9c35-a0e5a59072a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5008601df65b4935bbf96516e9670763'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:19.243571 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1114/2245] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:28:18 2022] DELETE /identity/v3/users/5008601df65b4935bbf96516e9670763 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:28:19.733538 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5961d7-6786-4bfd-898d-00aea701a1d0 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:19.735948 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-9e5961d7-6786-4bfd-898d-00aea701a1d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:19.788297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5961d7-6786-4bfd-898d-00aea701a1d0 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:19.867548 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d19dcc-dfb4-4f70-aa9c-286c80b65578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:19.868429 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d19dcc-dfb4-4f70-aa9c-286c80b65578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:19.868717 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d19dcc-dfb4-4f70-aa9c-286c80b65578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:19.868995 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d19dcc-dfb4-4f70-aa9c-286c80b65578 admin admin] PATH_INFO: `/v3/projects/964d6b27a4824e05a71f7942b5994547` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:19.870961 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d19dcc-dfb4-4f70-aa9c-286c80b65578 admin admin] RBAC: Authorizing `identity:delete_project(project_id=964d6b27a4824e05a71f7942b5994547)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:19.872887 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d19dcc-dfb4-4f70-aa9c-286c80b65578 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:19.902814 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:20.014794 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-01d19dcc-dfb4-4f70-aa9c-286c80b65578 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '964d6b27a4824e05a71f7942b5994547', 'request_id': 'req-01d19dcc-dfb4-4f70-aa9c-286c80b65578'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:20.117110 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-01d19dcc-dfb4-4f70-aa9c-286c80b65578 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '964d6b27a4824e05a71f7942b5994547', 'request_id': 'req-01d19dcc-dfb4-4f70-aa9c-286c80b65578'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:20.130113 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-01d19dcc-dfb4-4f70-aa9c-286c80b65578 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '964d6b27a4824e05a71f7942b5994547', 'request_id': 'req-01d19dcc-dfb4-4f70-aa9c-286c80b65578'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:20.140456 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-01d19dcc-dfb4-4f70-aa9c-286c80b65578 admin admin] The token cache is being invalidate because project 964d6b27a4824e05a71f7942b5994547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:28:20.140833 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-01d19dcc-dfb4-4f70-aa9c-286c80b65578 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:20.141612 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-01d19dcc-dfb4-4f70-aa9c-286c80b65578 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:20.143495 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1132/2246] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:28:19 2022] DELETE /identity/v3/projects/964d6b27a4824e05a71f7942b5994547 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:28:20.149562 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4eb3bc-f929-4756-b105-1f8e148bb57b None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:20.150077 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4eb3bc-f929-4756-b105-1f8e148bb57b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:20.150174 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4eb3bc-f929-4756-b105-1f8e148bb57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:20.171133 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-bf4eb3bc-f929-4756-b105-1f8e148bb57b None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:20.172392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-bf4eb3bc-f929-4756-b105-1f8e148bb57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:20.294705 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1115/2247] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:28:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:28:20.295383 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b3b36-e8bc-4357-aa56-3f24f49abc51 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:20.295681 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b3b36-e8bc-4357-aa56-3f24f49abc51 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:20.295951 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b3b36-e8bc-4357-aa56-3f24f49abc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:20.339593 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-9e5b3b36-e8bc-4357-aa56-3f24f49abc51 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:20.340872 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-9e5b3b36-e8bc-4357-aa56-3f24f49abc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:20.370212 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1133/2248] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:28:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:28:20.370415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4eb3bc-f929-4756-b105-1f8e148bb57b None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:20.393181 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4eb3bc-f929-4756-b105-1f8e148bb57b None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:20.419255 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41e7f1-b4e1-4c46-baaa-1874e56e26cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:20.419960 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41e7f1-b4e1-4c46-baaa-1874e56e26cc admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:20.420258 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41e7f1-b4e1-4c46-baaa-1874e56e26cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:20.420543 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41e7f1-b4e1-4c46-baaa-1874e56e26cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:20.421298 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41e7f1-b4e1-4c46-baaa-1874e56e26cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:28:20.421719 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41e7f1-b4e1-4c46-baaa-1874e56e26cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:20.423638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41e7f1-b4e1-4c46-baaa-1874e56e26cc admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:20.448045 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1116/2249] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:28:20.461800 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b3b36-e8bc-4357-aa56-3f24f49abc51 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:20.472625 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b3b36-e8bc-4357-aa56-3f24f49abc51 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:20.481291 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5d5d8-8394-426e-b21f-d8415f15492b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:20.482213 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5d5d8-8394-426e-b21f-d8415f15492b admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:20.482884 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5d5d8-8394-426e-b21f-d8415f15492b admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:20.483180 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5d5d8-8394-426e-b21f-d8415f15492b admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:20.483992 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5d5d8-8394-426e-b21f-d8415f15492b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:20.486139 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5d5d8-8394-426e-b21f-d8415f15492b admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:20.612553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1134/2250] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:28:20 2022] POST /identity/v3/projects => generated 381 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:28:20.617439 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41e7f1-b4e1-4c46-baaa-1874e56e26cc admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:20.631644 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41e7f1-b4e1-4c46-baaa-1874e56e26cc admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:20.691127 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc04780-157c-4da6-b251-9f79c44487ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:20.691809 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc04780-157c-4da6-b251-9f79c44487ff admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:20.692091 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc04780-157c-4da6-b251-9f79c44487ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:20.692368 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc04780-157c-4da6-b251-9f79c44487ff admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:20.693189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc04780-157c-4da6-b251-9f79c44487ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:20.695242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc04780-157c-4da6-b251-9f79c44487ff admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:20.813879 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1117/2251] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:28:20 2022] POST /identity/v3/users => generated 291 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:28:20.816838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5d5d8-8394-426e-b21f-d8415f15492b admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:20.831452 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5d5d8-8394-426e-b21f-d8415f15492b admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:20.855438 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430458d-20eb-4779-8e2a-b49befedb0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:20.858770 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430458d-20eb-4779-8e2a-b49befedb0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:20.858770 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430458d-20eb-4779-8e2a-b49befedb0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:20.858770 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430458d-20eb-4779-8e2a-b49befedb0e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:20.858770 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430458d-20eb-4779-8e2a-b49befedb0e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:20.862351 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430458d-20eb-4779-8e2a-b49befedb0e3 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:20.878006 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1135/2252] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:28:20.882908 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc04780-157c-4da6-b251-9f79c44487ff admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:20.894869 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc04780-157c-4da6-b251-9f79c44487ff admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:20.906052 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028890f8-8737-496f-be20-62f54ce45b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:20.906748 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028890f8-8737-496f-be20-62f54ce45b6d admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:20.907037 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028890f8-8737-496f-be20-62f54ce45b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:20.907322 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028890f8-8737-496f-be20-62f54ce45b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:20.908123 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028890f8-8737-496f-be20-62f54ce45b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:20.909737 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028890f8-8737-496f-be20-62f54ce45b6d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:20.922398 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1118/2253] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:28:20.926412 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430458d-20eb-4779-8e2a-b49befedb0e3 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:20.938076 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430458d-20eb-4779-8e2a-b49befedb0e3 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:20.943054 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777d9a6-2c7f-4e96-a22b-54f2878dd427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:20.944026 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777d9a6-2c7f-4e96-a22b-54f2878dd427 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:20.944310 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777d9a6-2c7f-4e96-a22b-54f2878dd427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:20.944586 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777d9a6-2c7f-4e96-a22b-54f2878dd427 admin admin] PATH_INFO: `/v3/projects/d08b381b1e294e488d90a89d3263afba/users/8bca85addc7a4bcea5ef1a640963f2d1/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:20.963664 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d777d9a6-2c7f-4e96-a22b-54f2878dd427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d08b381b1e294e488d90a89d3263afba, user_id=8bca85addc7a4bcea5ef1a640963f2d1, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:20.966510 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d777d9a6-2c7f-4e96-a22b-54f2878dd427 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:21.082344 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1136/2254] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:28:20 2022] PUT /identity/v3/projects/d08b381b1e294e488d90a89d3263afba/users/8bca85addc7a4bcea5ef1a640963f2d1/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:28:21.094218 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d312cd7-2e24-4e1b-ba4b-bc227fc20a10 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:21.094519 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d312cd7-2e24-4e1b-ba4b-bc227fc20a10 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:21.094804 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d312cd7-2e24-4e1b-ba4b-bc227fc20a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:21.130261 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-2d312cd7-2e24-4e1b-ba4b-bc227fc20a10 None None] MFA Rules not processed for user `8bca85addc7a4bcea5ef1a640963f2d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:21.131744 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2d312cd7-2e24-4e1b-ba4b-bc227fc20a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:21.202108 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:21.228730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1119/2255] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:28:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:28:21.234268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777d9a6-2c7f-4e96-a22b-54f2878dd427 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:21.348180 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777d9a6-2c7f-4e96-a22b-54f2878dd427 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:21.355778 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab37da-c4aa-44a8-b5aa-7b263aee12a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:21.356455 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab37da-c4aa-44a8-b5aa-7b263aee12a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:21.356856 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab37da-c4aa-44a8-b5aa-7b263aee12a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:21.357825 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab37da-c4aa-44a8-b5aa-7b263aee12a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:21.359445 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab37da-c4aa-44a8-b5aa-7b263aee12a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:21.362573 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab37da-c4aa-44a8-b5aa-7b263aee12a8 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:21.477258 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1137/2256] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:28:21 2022] POST /identity/v3/projects => generated 381 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:28:21.482122 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d312cd7-2e24-4e1b-ba4b-bc227fc20a10 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:21.497880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d312cd7-2e24-4e1b-ba4b-bc227fc20a10 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:21.621199 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5fa70-dc48-4804-9d7d-6633c22a8c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:21.622433 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5fa70-dc48-4804-9d7d-6633c22a8c7d admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:21.622727 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5fa70-dc48-4804-9d7d-6633c22a8c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:21.623011 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5fa70-dc48-4804-9d7d-6633c22a8c7d admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:21.623734 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5fa70-dc48-4804-9d7d-6633c22a8c7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:21.625940 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5fa70-dc48-4804-9d7d-6633c22a8c7d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:21.771781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1120/2257] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:28:21 2022] POST /identity/v3/users => generated 297 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:28:21.774933 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab37da-c4aa-44a8-b5aa-7b263aee12a8 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:21.789324 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab37da-c4aa-44a8-b5aa-7b263aee12a8 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:21.799529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ceb007-8faf-4187-968f-15c9bd257dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:21.800518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ceb007-8faf-4187-968f-15c9bd257dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:21.801195 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ceb007-8faf-4187-968f-15c9bd257dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:21.801563 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ceb007-8faf-4187-968f-15c9bd257dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:21.802609 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ceb007-8faf-4187-968f-15c9bd257dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:21.804779 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ceb007-8faf-4187-968f-15c9bd257dc7 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:21.843247 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1138/2258] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:28:21.845252 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5fa70-dc48-4804-9d7d-6633c22a8c7d admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:21.859682 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5fa70-dc48-4804-9d7d-6633c22a8c7d admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:21.881720 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e9c5b-0207-418c-96a2-8f2b1164c6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:21.884995 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e9c5b-0207-418c-96a2-8f2b1164c6f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:21.887639 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e9c5b-0207-418c-96a2-8f2b1164c6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:21.889403 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e9c5b-0207-418c-96a2-8f2b1164c6f8 admin admin] PATH_INFO: `/v3/projects/6fd40969773d43adb9beb3a35946bf47/users/790a476a5fd64a7cac9587907ef5af0a/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:21.934870 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e9c5b-0207-418c-96a2-8f2b1164c6f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fd40969773d43adb9beb3a35946bf47, user_id=790a476a5fd64a7cac9587907ef5af0a, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:21.939015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e9c5b-0207-418c-96a2-8f2b1164c6f8 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:22.062414 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1121/2259] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:28:21 2022] PUT /identity/v3/projects/6fd40969773d43adb9beb3a35946bf47/users/790a476a5fd64a7cac9587907ef5af0a/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:28:22.068581 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ceb007-8faf-4187-968f-15c9bd257dc7 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:22.088001 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ceb007-8faf-4187-968f-15c9bd257dc7 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:22.118230 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:22.164315 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f09023-75b6-4ec9-a3ad-1d28bc3e2eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:22.165006 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f09023-75b6-4ec9-a3ad-1d28bc3e2eaf admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:22.165289 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f09023-75b6-4ec9-a3ad-1d28bc3e2eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:22.165575 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f09023-75b6-4ec9-a3ad-1d28bc3e2eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:22.166391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f09023-75b6-4ec9-a3ad-1d28bc3e2eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:22.168649 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f09023-75b6-4ec9-a3ad-1d28bc3e2eaf admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:22.183095 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1139/2260] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:28:22.184173 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e9c5b-0207-418c-96a2-8f2b1164c6f8 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:22.195820 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e9c5b-0207-418c-96a2-8f2b1164c6f8 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:22.210332 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab9a03-234b-430b-8c99-3818f8261545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:22.211271 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab9a03-234b-430b-8c99-3818f8261545 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:22.212076 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab9a03-234b-430b-8c99-3818f8261545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:22.212076 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab9a03-234b-430b-8c99-3818f8261545 admin admin] PATH_INFO: `/v3/projects/6fd40969773d43adb9beb3a35946bf47/users/790a476a5fd64a7cac9587907ef5af0a/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:22.214362 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ab9a03-234b-430b-8c99-3818f8261545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fd40969773d43adb9beb3a35946bf47, user_id=790a476a5fd64a7cac9587907ef5af0a, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:22.216987 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ab9a03-234b-430b-8c99-3818f8261545 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:22.241864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1122/2261] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:28:22 2022] PUT /identity/v3/projects/6fd40969773d43adb9beb3a35946bf47/users/790a476a5fd64a7cac9587907ef5af0a/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:28:22.243607 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f765e6f-720e-4726-80e3-b7b6a4c1499d None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:22.243712 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f765e6f-720e-4726-80e3-b7b6a4c1499d None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:22.244073 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f765e6f-720e-4726-80e3-b7b6a4c1499d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:22.293862 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-9f765e6f-720e-4726-80e3-b7b6a4c1499d None None] MFA Rules not processed for user `790a476a5fd64a7cac9587907ef5af0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:22.296600 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-9f765e6f-720e-4726-80e3-b7b6a4c1499d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:22.451692 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1140/2262] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:28:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:28:22.465126 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab9a03-234b-430b-8c99-3818f8261545 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:22.468320 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d1ab9a03-234b-430b-8c99-3818f8261545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:22.577033 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab9a03-234b-430b-8c99-3818f8261545 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:22.583547 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ff78f-ab41-41a3-a961-cbdb32b6c978 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:22.584268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ff78f-ab41-41a3-a961-cbdb32b6c978 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:22.584725 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ff78f-ab41-41a3-a961-cbdb32b6c978 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:22.585134 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ff78f-ab41-41a3-a961-cbdb32b6c978 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:22.597572 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ff78f-ab41-41a3-a961-cbdb32b6c978 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:22.599199 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ff78f-ab41-41a3-a961-cbdb32b6c978 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:22.613227 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1123/2263] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:28:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:28:23.438148 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f765e6f-720e-4726-80e3-b7b6a4c1499d None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:23.544063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f765e6f-720e-4726-80e3-b7b6a4c1499d None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:23.550330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09982f8b-f533-4363-8cc6-2baa32718f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:23.551350 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09982f8b-f533-4363-8cc6-2baa32718f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:23.551694 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09982f8b-f533-4363-8cc6-2baa32718f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:23.552070 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09982f8b-f533-4363-8cc6-2baa32718f4d admin admin] PATH_INFO: `/v3/users/8bca85addc7a4bcea5ef1a640963f2d1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:23.553377 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09982f8b-f533-4363-8cc6-2baa32718f4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bca85addc7a4bcea5ef1a640963f2d1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:23.555632 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09982f8b-f533-4363-8cc6-2baa32718f4d admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:23.742203 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:23.752822 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-09982f8b-f533-4363-8cc6-2baa32718f4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bca85addc7a4bcea5ef1a640963f2d1'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:23.854031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-09982f8b-f533-4363-8cc6-2baa32718f4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bca85addc7a4bcea5ef1a640963f2d1'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:23.865263 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-09982f8b-f533-4363-8cc6-2baa32718f4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bca85addc7a4bcea5ef1a640963f2d1'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:23.866661 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-09982f8b-f533-4363-8cc6-2baa32718f4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bca85addc7a4bcea5ef1a640963f2d1'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:23.867783 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-09982f8b-f533-4363-8cc6-2baa32718f4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bca85addc7a4bcea5ef1a640963f2d1'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:23.891828 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1141/2264] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:28:23 2022] DELETE /identity/v3/users/8bca85addc7a4bcea5ef1a640963f2d1 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:28:23.896626 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5693d-ee5f-4b9e-8724-93b95c0f9cbe None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:23.897088 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5693d-ee5f-4b9e-8724-93b95c0f9cbe None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:23.897238 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5693d-ee5f-4b9e-8724-93b95c0f9cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:23.918795 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-f2a5693d-ee5f-4b9e-8724-93b95c0f9cbe None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:23.920307 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f2a5693d-ee5f-4b9e-8724-93b95c0f9cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:23.959732 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:23.998086 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1124/2265] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:28:24.009601 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09982f8b-f533-4363-8cc6-2baa32718f4d admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:24.013531 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-09982f8b-f533-4363-8cc6-2baa32718f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:24.092742 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09982f8b-f533-4363-8cc6-2baa32718f4d admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:24.098700 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3adc5ea-f315-4cb1-a621-813508aa11e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:24.099414 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3adc5ea-f315-4cb1-a621-813508aa11e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:24.099776 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3adc5ea-f315-4cb1-a621-813508aa11e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:24.100172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3adc5ea-f315-4cb1-a621-813508aa11e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:24.115095 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3adc5ea-f315-4cb1-a621-813508aa11e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:24.115095 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3adc5ea-f315-4cb1-a621-813508aa11e1 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:24.126874 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1142/2266] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:28:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:28:24.661920 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5693d-ee5f-4b9e-8724-93b95c0f9cbe None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:24.664018 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f2a5693d-ee5f-4b9e-8724-93b95c0f9cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:24.679932 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5693d-ee5f-4b9e-8724-93b95c0f9cbe None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:24.686439 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16576779-6dc7-4a0e-a8b7-50265216da48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:24.687956 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16576779-6dc7-4a0e-a8b7-50265216da48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:24.688250 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16576779-6dc7-4a0e-a8b7-50265216da48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:24.688524 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16576779-6dc7-4a0e-a8b7-50265216da48 admin admin] PATH_INFO: `/v3/projects/d08b381b1e294e488d90a89d3263afba` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:24.689782 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16576779-6dc7-4a0e-a8b7-50265216da48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d08b381b1e294e488d90a89d3263afba)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:24.697370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16576779-6dc7-4a0e-a8b7-50265216da48 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:24.906813 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-16576779-6dc7-4a0e-a8b7-50265216da48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd08b381b1e294e488d90a89d3263afba', 'request_id': 'req-16576779-6dc7-4a0e-a8b7-50265216da48'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:24.912949 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-16576779-6dc7-4a0e-a8b7-50265216da48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd08b381b1e294e488d90a89d3263afba', 'request_id': 'req-16576779-6dc7-4a0e-a8b7-50265216da48'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:25.036727 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-16576779-6dc7-4a0e-a8b7-50265216da48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd08b381b1e294e488d90a89d3263afba', 'request_id': 'req-16576779-6dc7-4a0e-a8b7-50265216da48'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:25.057819 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-16576779-6dc7-4a0e-a8b7-50265216da48 admin admin] The token cache is being invalidate because project d08b381b1e294e488d90a89d3263afba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:28:25.058287 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-16576779-6dc7-4a0e-a8b7-50265216da48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:25.059214 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-16576779-6dc7-4a0e-a8b7-50265216da48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:25.063943 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1125/2267] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:28:24 2022] DELETE /identity/v3/projects/d08b381b1e294e488d90a89d3263afba => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:28:25.065320 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3adc5ea-f315-4cb1-a621-813508aa11e1 service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:25.077529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3adc5ea-f315-4cb1-a621-813508aa11e1 service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:25.140706 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75558342-7191-4b17-851a-9b9e4f9ec9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:25.141588 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75558342-7191-4b17-851a-9b9e4f9ec9a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:25.141919 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75558342-7191-4b17-851a-9b9e4f9ec9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:25.142186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75558342-7191-4b17-851a-9b9e4f9ec9a6 admin admin] PATH_INFO: `/v3/users/790a476a5fd64a7cac9587907ef5af0a` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:25.143425 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75558342-7191-4b17-851a-9b9e4f9ec9a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=790a476a5fd64a7cac9587907ef5af0a)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:25.145529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75558342-7191-4b17-851a-9b9e4f9ec9a6 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:25.361356 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-75558342-7191-4b17-851a-9b9e4f9ec9a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '790a476a5fd64a7cac9587907ef5af0a'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:25.430532 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-75558342-7191-4b17-851a-9b9e4f9ec9a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '790a476a5fd64a7cac9587907ef5af0a'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:25.437587 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-75558342-7191-4b17-851a-9b9e4f9ec9a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '790a476a5fd64a7cac9587907ef5af0a'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:25.438241 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-75558342-7191-4b17-851a-9b9e4f9ec9a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '790a476a5fd64a7cac9587907ef5af0a'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:25.438847 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-75558342-7191-4b17-851a-9b9e4f9ec9a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '790a476a5fd64a7cac9587907ef5af0a'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:25.443503 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:25.459688 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1143/2268] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:28:25 2022] DELETE /identity/v3/users/790a476a5fd64a7cac9587907ef5af0a => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:28:25.999709 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16576779-6dc7-4a0e-a8b7-50265216da48 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:26.001353 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-16576779-6dc7-4a0e-a8b7-50265216da48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:26.015691 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16576779-6dc7-4a0e-a8b7-50265216da48 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:26.116728 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021db35-dede-44ac-ae29-d1dea8bc77d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:26.118934 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021db35-dede-44ac-ae29-d1dea8bc77d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:26.119560 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021db35-dede-44ac-ae29-d1dea8bc77d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:26.120073 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021db35-dede-44ac-ae29-d1dea8bc77d8 admin admin] PATH_INFO: `/v3/projects/6fd40969773d43adb9beb3a35946bf47` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:26.122086 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021db35-dede-44ac-ae29-d1dea8bc77d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fd40969773d43adb9beb3a35946bf47)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:26.124437 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021db35-dede-44ac-ae29-d1dea8bc77d8 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:26.239956 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4021db35-dede-44ac-ae29-d1dea8bc77d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fd40969773d43adb9beb3a35946bf47', 'request_id': 'req-4021db35-dede-44ac-ae29-d1dea8bc77d8'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:26.248146 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4021db35-dede-44ac-ae29-d1dea8bc77d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fd40969773d43adb9beb3a35946bf47', 'request_id': 'req-4021db35-dede-44ac-ae29-d1dea8bc77d8'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:26.252683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:26.397037 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4021db35-dede-44ac-ae29-d1dea8bc77d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fd40969773d43adb9beb3a35946bf47', 'request_id': 'req-4021db35-dede-44ac-ae29-d1dea8bc77d8'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:26.424238 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4021db35-dede-44ac-ae29-d1dea8bc77d8 admin admin] The token cache is being invalidate because project 6fd40969773d43adb9beb3a35946bf47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:28:26.424550 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4021db35-dede-44ac-ae29-d1dea8bc77d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:26.438017 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4021db35-dede-44ac-ae29-d1dea8bc77d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:26.443210 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1126/2269] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:28:25 2022] DELETE /identity/v3/projects/6fd40969773d43adb9beb3a35946bf47 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:28:26.448710 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5c128-ae53-43a8-82d5-5a38bb366e81 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:26.449606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5c128-ae53-43a8-82d5-5a38bb366e81 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:26.450076 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5c128-ae53-43a8-82d5-5a38bb366e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:26.485951 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-f8a5c128-ae53-43a8-82d5-5a38bb366e81 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:26.487961 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-f8a5c128-ae53-43a8-82d5-5a38bb366e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:26.619441 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1144/2270] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:28:26.627799 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3aebed-6bec-415d-b840-6390dc3c76d2 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:26.628193 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3aebed-6bec-415d-b840-6390dc3c76d2 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:26.628588 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3aebed-6bec-415d-b840-6390dc3c76d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:26.651921 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-9a3aebed-6bec-415d-b840-6390dc3c76d2 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:26.653226 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9a3aebed-6bec-415d-b840-6390dc3c76d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:26.662370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1127/2271] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:28:26.668984 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5c128-ae53-43a8-82d5-5a38bb366e81 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:26.679732 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5c128-ae53-43a8-82d5-5a38bb366e81 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:26.684384 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31a15e-5152-4292-af8e-ed0a78f9c41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:26.685095 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31a15e-5152-4292-af8e-ed0a78f9c41d admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:26.685386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31a15e-5152-4292-af8e-ed0a78f9c41d admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:26.685666 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31a15e-5152-4292-af8e-ed0a78f9c41d admin admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:26.686430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31a15e-5152-4292-af8e-ed0a78f9c41d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:28:26.686758 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31a15e-5152-4292-af8e-ed0a78f9c41d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:26.688454 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31a15e-5152-4292-af8e-ed0a78f9c41d admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:26.706860 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1145/2272] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:28:26.710994 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3aebed-6bec-415d-b840-6390dc3c76d2 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:26.721635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3aebed-6bec-415d-b840-6390dc3c76d2 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:26.726724 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9358dce-d949-4372-8de3-b7da9c6a195c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:26.727515 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9358dce-d949-4372-8de3-b7da9c6a195c admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:26.727874 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9358dce-d949-4372-8de3-b7da9c6a195c admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:26.728153 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9358dce-d949-4372-8de3-b7da9c6a195c admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:26.728861 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9358dce-d949-4372-8de3-b7da9c6a195c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:26.730892 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9358dce-d949-4372-8de3-b7da9c6a195c admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:26.838393 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1128/2273] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:28:26 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:28:26.839254 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31a15e-5152-4292-af8e-ed0a78f9c41d admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:26.851728 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31a15e-5152-4292-af8e-ed0a78f9c41d admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:26.924904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0aef3-5c37-421e-9bba-640073d101a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:26.925595 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0aef3-5c37-421e-9bba-640073d101a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:26.925999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0aef3-5c37-421e-9bba-640073d101a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:26.926291 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0aef3-5c37-421e-9bba-640073d101a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:26.926999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0aef3-5c37-421e-9bba-640073d101a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:26.929165 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0aef3-5c37-421e-9bba-640073d101a0 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:27.074026 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1146/2274] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:28:26 2022] POST /identity/v3/users => generated 287 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:28:27.078880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9358dce-d949-4372-8de3-b7da9c6a195c admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:27.096231 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9358dce-d949-4372-8de3-b7da9c6a195c admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:27.103337 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8f322-661c-4b7e-a68c-2c05f4a57bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:27.104354 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8f322-661c-4b7e-a68c-2c05f4a57bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:27.104822 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8f322-661c-4b7e-a68c-2c05f4a57bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:27.105219 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8f322-661c-4b7e-a68c-2c05f4a57bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:27.106125 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8f322-661c-4b7e-a68c-2c05f4a57bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:27.108010 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8f322-661c-4b7e-a68c-2c05f4a57bb3 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:27.120584 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1129/2275] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:28:27.125161 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0aef3-5c37-421e-9bba-640073d101a0 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:27.136561 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0aef3-5c37-421e-9bba-640073d101a0 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:27.143106 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97c6ed-cc4e-43f4-a555-33c6ed418707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:27.143792 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97c6ed-cc4e-43f4-a555-33c6ed418707 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:27.144069 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97c6ed-cc4e-43f4-a555-33c6ed418707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:27.144345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97c6ed-cc4e-43f4-a555-33c6ed418707 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:27.145080 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97c6ed-cc4e-43f4-a555-33c6ed418707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:27.146870 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97c6ed-cc4e-43f4-a555-33c6ed418707 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:27.158428 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1147/2276] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:28:27.162260 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8f322-661c-4b7e-a68c-2c05f4a57bb3 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:27.173799 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8f322-661c-4b7e-a68c-2c05f4a57bb3 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:27.178873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522266fe-06f2-4265-b3ff-fb626ef58904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:27.179904 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522266fe-06f2-4265-b3ff-fb626ef58904 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:27.180192 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522266fe-06f2-4265-b3ff-fb626ef58904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:27.180479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522266fe-06f2-4265-b3ff-fb626ef58904 admin admin] PATH_INFO: `/v3/projects/aff73ee7334c4cc3bce66492cf001c2f/users/6b01d48939b947a18947ec35f74a666e/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:27.206319 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522266fe-06f2-4265-b3ff-fb626ef58904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aff73ee7334c4cc3bce66492cf001c2f, user_id=6b01d48939b947a18947ec35f74a666e, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:27.209310 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522266fe-06f2-4265-b3ff-fb626ef58904 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:27.278377 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1130/2277] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:28:27 2022] PUT /identity/v3/projects/aff73ee7334c4cc3bce66492cf001c2f/users/6b01d48939b947a18947ec35f74a666e/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:28:27.283721 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd0376-1ba5-4a8f-b84a-6b9dd339b8dd None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:27.284227 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd0376-1ba5-4a8f-b84a-6b9dd339b8dd None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:27.284717 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd0376-1ba5-4a8f-b84a-6b9dd339b8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:27.304125 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-20fd0376-1ba5-4a8f-b84a-6b9dd339b8dd None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:27.305338 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-20fd0376-1ba5-4a8f-b84a-6b9dd339b8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:27.365399 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:27.383796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1148/2278] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:28:27.396865 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522266fe-06f2-4265-b3ff-fb626ef58904 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:27.398652 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-522266fe-06f2-4265-b3ff-fb626ef58904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:27.476045 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522266fe-06f2-4265-b3ff-fb626ef58904 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:27.480155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5573e7f-2dd5-4ebf-bc2b-a319627449ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:27.480827 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5573e7f-2dd5-4ebf-bc2b-a319627449ba service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:27.484169 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5573e7f-2dd5-4ebf-bc2b-a319627449ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:27.484550 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5573e7f-2dd5-4ebf-bc2b-a319627449ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:27.495951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5573e7f-2dd5-4ebf-bc2b-a319627449ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:27.497444 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5573e7f-2dd5-4ebf-bc2b-a319627449ba service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:27.507826 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1131/2279] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:28:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:28:29.528182 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b601a55-ffc9-46a2-9412-79178be798c8 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:29.528701 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b601a55-ffc9-46a2-9412-79178be798c8 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:29.528898 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b601a55-ffc9-46a2-9412-79178be798c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:29.557524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-5b601a55-ffc9-46a2-9412-79178be798c8 None None] MFA Rules not processed for user `6b01d48939b947a18947ec35f74a666e`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:29.558772 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-5b601a55-ffc9-46a2-9412-79178be798c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:29.630339 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1149/2280] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:28:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:28:29.635009 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5573e7f-2dd5-4ebf-bc2b-a319627449ba service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:29.645165 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5573e7f-2dd5-4ebf-bc2b-a319627449ba service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:29.649869 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada867c1-ecfc-426d-946f-8f5f566d12f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:29.650534 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada867c1-ecfc-426d-946f-8f5f566d12f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:29.651535 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada867c1-ecfc-426d-946f-8f5f566d12f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:29.651839 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada867c1-ecfc-426d-946f-8f5f566d12f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:29.652739 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada867c1-ecfc-426d-946f-8f5f566d12f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:29.654700 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada867c1-ecfc-426d-946f-8f5f566d12f8 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:29.742206 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1132/2281] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:28:29 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:28:29.743382 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b601a55-ffc9-46a2-9412-79178be798c8 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:29.754308 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b601a55-ffc9-46a2-9412-79178be798c8 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:29.825354 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52220f-0fe0-4121-93e7-acf729c17f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:29.826075 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52220f-0fe0-4121-93e7-acf729c17f00 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:29.826369 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52220f-0fe0-4121-93e7-acf729c17f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:29.827186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52220f-0fe0-4121-93e7-acf729c17f00 admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:29.827368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52220f-0fe0-4121-93e7-acf729c17f00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:29.829391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52220f-0fe0-4121-93e7-acf729c17f00 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:29.934955 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1150/2282] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:28:29 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:28:29.938828 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada867c1-ecfc-426d-946f-8f5f566d12f8 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:29.950457 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada867c1-ecfc-426d-946f-8f5f566d12f8 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:29.955296 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a42573-03a0-430a-ac5e-3ba53982243c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:29.955962 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a42573-03a0-430a-ac5e-3ba53982243c admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:29.956252 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a42573-03a0-430a-ac5e-3ba53982243c admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:29.956536 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a42573-03a0-430a-ac5e-3ba53982243c admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:29.957270 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a42573-03a0-430a-ac5e-3ba53982243c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:29.958948 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a42573-03a0-430a-ac5e-3ba53982243c admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:29.971032 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1133/2283] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:28:29.975421 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52220f-0fe0-4121-93e7-acf729c17f00 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:29.985508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52220f-0fe0-4121-93e7-acf729c17f00 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:29.990382 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487ead3-8ddc-4a00-9e8b-63a12a54bde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:29.991267 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487ead3-8ddc-4a00-9e8b-63a12a54bde3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:29.991587 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487ead3-8ddc-4a00-9e8b-63a12a54bde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:29.991868 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487ead3-8ddc-4a00-9e8b-63a12a54bde3 admin admin] PATH_INFO: `/v3/projects/a76a2868fbb44c5ea08332e3fd7183d1/users/0aaf493e5c6a4dc8992ec68fbfe5d0a5/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:30.007418 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f487ead3-8ddc-4a00-9e8b-63a12a54bde3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a76a2868fbb44c5ea08332e3fd7183d1, user_id=0aaf493e5c6a4dc8992ec68fbfe5d0a5, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:30.010164 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f487ead3-8ddc-4a00-9e8b-63a12a54bde3 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:30.126723 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1151/2284] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:28:29 2022] PUT /identity/v3/projects/a76a2868fbb44c5ea08332e3fd7183d1/users/0aaf493e5c6a4dc8992ec68fbfe5d0a5/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:28:30.130819 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a42573-03a0-430a-ac5e-3ba53982243c admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:30.141487 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a42573-03a0-430a-ac5e-3ba53982243c admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:30.195660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:30.201888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609c43e-4314-4e01-8987-f03a40c99c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:30.202560 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609c43e-4314-4e01-8987-f03a40c99c93 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:30.202849 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609c43e-4314-4e01-8987-f03a40c99c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:30.203130 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609c43e-4314-4e01-8987-f03a40c99c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:30.203863 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609c43e-4314-4e01-8987-f03a40c99c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:30.205445 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609c43e-4314-4e01-8987-f03a40c99c93 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:30.215508 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1134/2285] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:28:30.224813 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487ead3-8ddc-4a00-9e8b-63a12a54bde3 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:30.235975 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487ead3-8ddc-4a00-9e8b-63a12a54bde3 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:30.240879 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1243cc2-e05a-4b31-8df8-d5cb7f4bc60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:30.241783 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1243cc2-e05a-4b31-8df8-d5cb7f4bc60c admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:30.242086 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1243cc2-e05a-4b31-8df8-d5cb7f4bc60c admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:30.242370 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1243cc2-e05a-4b31-8df8-d5cb7f4bc60c admin admin] PATH_INFO: `/v3/projects/a76a2868fbb44c5ea08332e3fd7183d1/users/0aaf493e5c6a4dc8992ec68fbfe5d0a5/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:30.244377 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1243cc2-e05a-4b31-8df8-d5cb7f4bc60c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a76a2868fbb44c5ea08332e3fd7183d1, user_id=0aaf493e5c6a4dc8992ec68fbfe5d0a5, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:30.247667 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1243cc2-e05a-4b31-8df8-d5cb7f4bc60c admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:30.258839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1152/2286] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:28:30 2022] PUT /identity/v3/projects/a76a2868fbb44c5ea08332e3fd7183d1/users/0aaf493e5c6a4dc8992ec68fbfe5d0a5/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:28:30.574971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa7c19-4ef5-43db-8673-fe7573e784fa None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:30.575342 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa7c19-4ef5-43db-8673-fe7573e784fa None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:30.575695 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa7c19-4ef5-43db-8673-fe7573e784fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:30.597356 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-7efa7c19-4ef5-43db-8673-fe7573e784fa None None] MFA Rules not processed for user `cdfa8f4012c2471b81f8749b013d3117`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:30.604733 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7efa7c19-4ef5-43db-8673-fe7573e784fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:30.691241 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1243cc2-e05a-4b31-8df8-d5cb7f4bc60c admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:30.691917 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1135/2287] 10.222.0.23 () {58 vars in 967 bytes} [Mon Jul 11 11:28:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:28:30.693701 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-f1243cc2-e05a-4b31-8df8-d5cb7f4bc60c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:30.733465 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:30.776788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1243cc2-e05a-4b31-8df8-d5cb7f4bc60c admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:30.781997 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e80fd-2eee-425a-acbb-b5e45cf5360d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736f6d4d1dbb47ff98bc67e53614d49c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:30.782658 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e80fd-2eee-425a-acbb-b5e45cf5360d service swift] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:30.782952 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e80fd-2eee-425a-acbb-b5e45cf5360d service swift] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:30.783234 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e80fd-2eee-425a-acbb-b5e45cf5360d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:30.792490 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e80fd-2eee-425a-acbb-b5e45cf5360d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:30.794299 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e80fd-2eee-425a-acbb-b5e45cf5360d service swift] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:30.802928 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1153/2288] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jul 11 11:28:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 11:28:31.806223 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f32c1d-a38f-4096-8c82-5229b502af65 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:31.806760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f32c1d-a38f-4096-8c82-5229b502af65 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:31.806855 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f32c1d-a38f-4096-8c82-5229b502af65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:31.837434 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-87f32c1d-a38f-4096-8c82-5229b502af65 None None] MFA Rules not processed for user `0aaf493e5c6a4dc8992ec68fbfe5d0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:31.839185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-87f32c1d-a38f-4096-8c82-5229b502af65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:31.920158 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1136/2289] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:28:31 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:28:31.930753 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee088eb-f25f-4b60-b02d-d8f5b89bad18 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:31.931266 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee088eb-f25f-4b60-b02d-d8f5b89bad18 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:31.931361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee088eb-f25f-4b60-b02d-d8f5b89bad18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:31.950162 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-aee088eb-f25f-4b60-b02d-d8f5b89bad18 None None] MFA Rules not processed for user `6b01d48939b947a18947ec35f74a666e`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:31.951252 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-aee088eb-f25f-4b60-b02d-d8f5b89bad18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:32.010097 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1154/2290] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:28:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:28:32.022499 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f32c1d-a38f-4096-8c82-5229b502af65 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:32.024035 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-87f32c1d-a38f-4096-8c82-5229b502af65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:32.099522 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f32c1d-a38f-4096-8c82-5229b502af65 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:32.105321 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e30e7c-1e93-4d0c-8619-458dc5bb2e1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:32.106109 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e30e7c-1e93-4d0c-8619-458dc5bb2e1e service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:32.106423 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e30e7c-1e93-4d0c-8619-458dc5bb2e1e service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:32.106705 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e30e7c-1e93-4d0c-8619-458dc5bb2e1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:32.114495 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e30e7c-1e93-4d0c-8619-458dc5bb2e1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:32.116058 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e30e7c-1e93-4d0c-8619-458dc5bb2e1e service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:32.125245 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1137/2291] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:28:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:28:32.980932 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38e8dc-c819-4a81-b830-15815aacb9cb None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:32.981498 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38e8dc-c819-4a81-b830-15815aacb9cb None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:32.981498 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38e8dc-c819-4a81-b830-15815aacb9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:33.000712 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-de38e8dc-c819-4a81-b830-15815aacb9cb None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:33.002295 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-de38e8dc-c819-4a81-b830-15815aacb9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:33.079733 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1155/2292] 10.222.0.47 () {58 vars in 1016 bytes} [Mon Jul 11 11:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:28:33.099666 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e30e7c-1e93-4d0c-8619-458dc5bb2e1e service nova] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:33.112755 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e30e7c-1e93-4d0c-8619-458dc5bb2e1e service nova] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:33.119177 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaff288-65fb-46c9-8453-742010009080 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:33.119975 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaff288-65fb-46c9-8453-742010009080 service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:33.120466 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaff288-65fb-46c9-8453-742010009080 service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:33.120839 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaff288-65fb-46c9-8453-742010009080 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:33.127458 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:33.129859 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaff288-65fb-46c9-8453-742010009080 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:33.131433 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaff288-65fb-46c9-8453-742010009080 service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:33.141644 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1138/2293] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:28:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:28:33.914859 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859a3d0-b314-49c8-83a3-30dc4215f3cd None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:33.915337 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859a3d0-b314-49c8-83a3-30dc4215f3cd None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:33.915743 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859a3d0-b314-49c8-83a3-30dc4215f3cd None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:33.918141 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1156/2294] 10.222.0.23 () {54 vars in 921 bytes} [Mon Jul 11 11:28:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:28:33.937715 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8a7e7-8f15-4fae-8566-31460d3e9e3c None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:33.937715 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8a7e7-8f15-4fae-8566-31460d3e9e3c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:33.937715 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8a7e7-8f15-4fae-8566-31460d3e9e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:33.950721 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-32f8a7e7-8f15-4fae-8566-31460d3e9e3c None None] MFA Rules not processed for user `12b7c9264495433985185332778dbc8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:33.952044 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-32f8a7e7-8f15-4fae-8566-31460d3e9e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:34.016585 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1139/2295] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Jul 11 11:28:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:28:34.027536 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f859a3d0-b314-49c8-83a3-30dc4215f3cd None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:34.029282 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-f859a3d0-b314-49c8-83a3-30dc4215f3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:34.046446 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f859a3d0-b314-49c8-83a3-30dc4215f3cd None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:34.051436 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba88f17-48fb-4552-9fea-674557e51743 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b7c9264495433985185332778dbc8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:34.052079 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba88f17-48fb-4552-9fea-674557e51743 service placement] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:34.052371 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba88f17-48fb-4552-9fea-674557e51743 service placement] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:34.052632 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba88f17-48fb-4552-9fea-674557e51743 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:34.063111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba88f17-48fb-4552-9fea-674557e51743 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:34.064319 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba88f17-48fb-4552-9fea-674557e51743 service placement] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:34.066538 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8a7e7-8f15-4fae-8566-31460d3e9e3c None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:34.068198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-32f8a7e7-8f15-4fae-8566-31460d3e9e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:34.076005 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1157/2296] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:28:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:28:34.086990 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8a7e7-8f15-4fae-8566-31460d3e9e3c None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:34.092448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683d6de-2e92-4804-8f5c-f5f32ca94e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:34.093391 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683d6de-2e92-4804-8f5c-f5f32ca94e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:34.093719 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683d6de-2e92-4804-8f5c-f5f32ca94e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:34.094035 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683d6de-2e92-4804-8f5c-f5f32ca94e39 admin admin] PATH_INFO: `/v3/users/b6454da0eba2404ab599b3c80c06b8dc` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:34.095318 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c683d6de-2e92-4804-8f5c-f5f32ca94e39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6454da0eba2404ab599b3c80c06b8dc)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:34.097304 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c683d6de-2e92-4804-8f5c-f5f32ca94e39 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:34.370609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c683d6de-2e92-4804-8f5c-f5f32ca94e39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6454da0eba2404ab599b3c80c06b8dc'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:34.371363 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c683d6de-2e92-4804-8f5c-f5f32ca94e39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6454da0eba2404ab599b3c80c06b8dc'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:34.378351 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c683d6de-2e92-4804-8f5c-f5f32ca94e39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6454da0eba2404ab599b3c80c06b8dc'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:34.454327 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c683d6de-2e92-4804-8f5c-f5f32ca94e39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6454da0eba2404ab599b3c80c06b8dc'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:34.467769 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c683d6de-2e92-4804-8f5c-f5f32ca94e39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6454da0eba2404ab599b3c80c06b8dc'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:34.474012 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1140/2297] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:28:34 2022] DELETE /identity/v3/users/b6454da0eba2404ab599b3c80c06b8dc => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:28:34.711422 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba88f17-48fb-4552-9fea-674557e51743 service placement] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:34.732453 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba88f17-48fb-4552-9fea-674557e51743 service placement] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:34.805599 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:34.815407 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df1dd0-663f-4ed7-bf3c-b07961ca4835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:34.816292 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df1dd0-663f-4ed7-bf3c-b07961ca4835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:34.816583 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df1dd0-663f-4ed7-bf3c-b07961ca4835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:34.816867 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df1dd0-663f-4ed7-bf3c-b07961ca4835 admin admin] PATH_INFO: `/v3/projects/4830b8c5376341eda5202c6b1e66c7a1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:34.818148 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df1dd0-663f-4ed7-bf3c-b07961ca4835 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4830b8c5376341eda5202c6b1e66c7a1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:34.820325 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df1dd0-663f-4ed7-bf3c-b07961ca4835 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:35.003575 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-b4df1dd0-663f-4ed7-bf3c-b07961ca4835 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4830b8c5376341eda5202c6b1e66c7a1', 'request_id': 'req-b4df1dd0-663f-4ed7-bf3c-b07961ca4835'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:35.146077 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-b4df1dd0-663f-4ed7-bf3c-b07961ca4835 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4830b8c5376341eda5202c6b1e66c7a1', 'request_id': 'req-b4df1dd0-663f-4ed7-bf3c-b07961ca4835'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:35.153166 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-b4df1dd0-663f-4ed7-bf3c-b07961ca4835 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4830b8c5376341eda5202c6b1e66c7a1', 'request_id': 'req-b4df1dd0-663f-4ed7-bf3c-b07961ca4835'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:35.164027 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-b4df1dd0-663f-4ed7-bf3c-b07961ca4835 admin admin] The token cache is being invalidate because project 4830b8c5376341eda5202c6b1e66c7a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:28:35.164319 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-b4df1dd0-663f-4ed7-bf3c-b07961ca4835 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:35.164991 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-b4df1dd0-663f-4ed7-bf3c-b07961ca4835 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:35.166878 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1158/2298] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:28:34 2022] DELETE /identity/v3/projects/4830b8c5376341eda5202c6b1e66c7a1 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:28:35.172044 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57408212-e69c-4dc0-b8bd-e7830131c7d8 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:35.172361 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57408212-e69c-4dc0-b8bd-e7830131c7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:35.172644 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57408212-e69c-4dc0-b8bd-e7830131c7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:35.191380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-57408212-e69c-4dc0-b8bd-e7830131c7d8 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:35.192585 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-57408212-e69c-4dc0-b8bd-e7830131c7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:35.254797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1141/2299] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:28:35.264216 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a1523-8a5d-4613-a86b-ce6a9b334f01 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:35.264513 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a1523-8a5d-4613-a86b-ce6a9b334f01 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:35.264971 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a1523-8a5d-4613-a86b-ce6a9b334f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:35.284323 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-ba8a1523-8a5d-4613-a86b-ce6a9b334f01 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:35.285573 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-ba8a1523-8a5d-4613-a86b-ce6a9b334f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:35.294280 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1159/2300] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:28:35.298606 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57408212-e69c-4dc0-b8bd-e7830131c7d8 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:35.308679 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:35.312017 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57408212-e69c-4dc0-b8bd-e7830131c7d8 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:35.318283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ade23-2a80-4a26-aa73-d23e39e43756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:35.319174 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ade23-2a80-4a26-aa73-d23e39e43756 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:35.319622 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ade23-2a80-4a26-aa73-d23e39e43756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:35.319900 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ade23-2a80-4a26-aa73-d23e39e43756 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:35.320635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ade23-2a80-4a26-aa73-d23e39e43756 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:28:35.320943 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ade23-2a80-4a26-aa73-d23e39e43756 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:35.323423 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ade23-2a80-4a26-aa73-d23e39e43756 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:35.336301 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1142/2301] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:28:35.342883 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a1523-8a5d-4613-a86b-ce6a9b334f01 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:35.352771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a1523-8a5d-4613-a86b-ce6a9b334f01 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:35.357886 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ed332-5e13-4e74-b13e-95ce50946a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:35.358602 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ed332-5e13-4e74-b13e-95ce50946a8f admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:35.362655 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ed332-5e13-4e74-b13e-95ce50946a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:35.362655 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ed332-5e13-4e74-b13e-95ce50946a8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:35.362655 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888ed332-5e13-4e74-b13e-95ce50946a8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:35.362655 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888ed332-5e13-4e74-b13e-95ce50946a8f admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:35.445264 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1160/2302] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:28:35 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:28:35.446545 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ade23-2a80-4a26-aa73-d23e39e43756 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:35.457059 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ade23-2a80-4a26-aa73-d23e39e43756 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:35.515952 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a5177-2595-4971-b223-7d26dd0d6928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:35.516808 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a5177-2595-4971-b223-7d26dd0d6928 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:35.517226 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a5177-2595-4971-b223-7d26dd0d6928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:35.517584 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a5177-2595-4971-b223-7d26dd0d6928 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:35.518648 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a5177-2595-4971-b223-7d26dd0d6928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:35.520588 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a5177-2595-4971-b223-7d26dd0d6928 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:35.595735 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1143/2303] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:28:35 2022] POST /identity/v3/users => generated 284 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:28:35.596949 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ed332-5e13-4e74-b13e-95ce50946a8f admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:35.610997 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ed332-5e13-4e74-b13e-95ce50946a8f admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:35.623766 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad7454-626e-4414-92c1-db41a447bbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:35.624601 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad7454-626e-4414-92c1-db41a447bbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:35.625096 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad7454-626e-4414-92c1-db41a447bbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:35.625701 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad7454-626e-4414-92c1-db41a447bbd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:35.626814 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad7454-626e-4414-92c1-db41a447bbd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:35.629258 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad7454-626e-4414-92c1-db41a447bbd1 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:35.653082 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1161/2304] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:28:35.656841 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a5177-2595-4971-b223-7d26dd0d6928 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:35.669395 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a5177-2595-4971-b223-7d26dd0d6928 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:35.676094 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213d191-c153-495c-aa1d-2abf55cd597a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:35.676782 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213d191-c153-495c-aa1d-2abf55cd597a admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:35.677072 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213d191-c153-495c-aa1d-2abf55cd597a admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:35.677355 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213d191-c153-495c-aa1d-2abf55cd597a admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:35.678175 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c213d191-c153-495c-aa1d-2abf55cd597a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:35.679760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c213d191-c153-495c-aa1d-2abf55cd597a admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:35.698432 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1144/2305] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:28:35.702793 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad7454-626e-4414-92c1-db41a447bbd1 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:35.713610 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad7454-626e-4414-92c1-db41a447bbd1 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:35.718676 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0c0c7-bb14-4391-91f4-9654ab32411a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:35.719745 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0c0c7-bb14-4391-91f4-9654ab32411a admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:35.720030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0c0c7-bb14-4391-91f4-9654ab32411a admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:35.720304 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0c0c7-bb14-4391-91f4-9654ab32411a admin admin] PATH_INFO: `/v3/projects/6afabd87e978492c8601f7fc170c86e7/users/23f1225dd9c140489aa3cf014acf000c/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:35.743716 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0c0c7-bb14-4391-91f4-9654ab32411a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6afabd87e978492c8601f7fc170c86e7, user_id=23f1225dd9c140489aa3cf014acf000c, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:35.747799 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0c0c7-bb14-4391-91f4-9654ab32411a admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:35.861903 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1162/2306] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:28:35 2022] PUT /identity/v3/projects/6afabd87e978492c8601f7fc170c86e7/users/23f1225dd9c140489aa3cf014acf000c/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:28:35.872338 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c47f0a-9c63-47c0-9f25-df4ad006beab None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:35.872647 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c47f0a-9c63-47c0-9f25-df4ad006beab None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:35.872912 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c47f0a-9c63-47c0-9f25-df4ad006beab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:35.899570 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-04c47f0a-9c63-47c0-9f25-df4ad006beab None None] MFA Rules not processed for user `23f1225dd9c140489aa3cf014acf000c`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:35.901373 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-04c47f0a-9c63-47c0-9f25-df4ad006beab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:35.967345 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1145/2307] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:28:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:28:35.978649 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0c0c7-bb14-4391-91f4-9654ab32411a admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:35.981175 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-13c0c0c7-bb14-4391-91f4-9654ab32411a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:36.071796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0c0c7-bb14-4391-91f4-9654ab32411a admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:36.076164 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02209b97-fbc5-4d27-ba77-ff182270a526 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a2d8d24562459493a3bcd399665a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:36.076820 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02209b97-fbc5-4d27-ba77-ff182270a526 service glance] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:36.077273 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02209b97-fbc5-4d27-ba77-ff182270a526 service glance] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:36.077555 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02209b97-fbc5-4d27-ba77-ff182270a526 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:36.087849 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02209b97-fbc5-4d27-ba77-ff182270a526 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:36.089942 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02209b97-fbc5-4d27-ba77-ff182270a526 service glance] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:36.102552 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1163/2308] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:28:35 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:28:39.480040 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5592aa9-78cb-456a-8d24-54edc86b5667 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:39.480536 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5592aa9-78cb-456a-8d24-54edc86b5667 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:39.480640 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5592aa9-78cb-456a-8d24-54edc86b5667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:39.499287 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-b5592aa9-78cb-456a-8d24-54edc86b5667 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:39.500514 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b5592aa9-78cb-456a-8d24-54edc86b5667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:39.591914 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:39.602629 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1146/2309] 10.222.0.47 () {58 vars in 1016 bytes} [Mon Jul 11 11:28:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:28:39.632099 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02209b97-fbc5-4d27-ba77-ff182270a526 service glance] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:39.632099 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-02209b97-fbc5-4d27-ba77-ff182270a526 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:39.639538 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:39.736183 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02209b97-fbc5-4d27-ba77-ff182270a526 service glance] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:39.746585 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f5128-3941-4504-9dd5-6b98b3cab71d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:39.747269 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f5128-3941-4504-9dd5-6b98b3cab71d service nova] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:39.747556 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f5128-3941-4504-9dd5-6b98b3cab71d service nova] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:39.747832 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f5128-3941-4504-9dd5-6b98b3cab71d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:39.747924 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5592aa9-78cb-456a-8d24-54edc86b5667 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:39.749230 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b5592aa9-78cb-456a-8d24-54edc86b5667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:39.757054 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f5128-3941-4504-9dd5-6b98b3cab71d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:39.759292 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f5128-3941-4504-9dd5-6b98b3cab71d service nova] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:39.761871 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5592aa9-78cb-456a-8d24-54edc86b5667 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:39.774608 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1164/2310] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:28:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:28:39.777736 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da266974-fda8-42c5-bb9f-472afb38bd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:39.778909 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da266974-fda8-42c5-bb9f-472afb38bd01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:39.779207 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da266974-fda8-42c5-bb9f-472afb38bd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:39.779405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da266974-fda8-42c5-bb9f-472afb38bd01 admin admin] PATH_INFO: `/v3/users/2417b79334c843e6a0d061d315b9cb35` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:39.780913 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da266974-fda8-42c5-bb9f-472afb38bd01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2417b79334c843e6a0d061d315b9cb35)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:39.783190 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da266974-fda8-42c5-bb9f-472afb38bd01 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:40.044858 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-da266974-fda8-42c5-bb9f-472afb38bd01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2417b79334c843e6a0d061d315b9cb35'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:40.045518 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-da266974-fda8-42c5-bb9f-472afb38bd01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2417b79334c843e6a0d061d315b9cb35'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:40.054123 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-da266974-fda8-42c5-bb9f-472afb38bd01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2417b79334c843e6a0d061d315b9cb35'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:40.128535 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-da266974-fda8-42c5-bb9f-472afb38bd01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2417b79334c843e6a0d061d315b9cb35'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:40.141524 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-da266974-fda8-42c5-bb9f-472afb38bd01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2417b79334c843e6a0d061d315b9cb35'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:40.148609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1147/2311] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:28:39 2022] DELETE /identity/v3/users/2417b79334c843e6a0d061d315b9cb35 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:28:40.153880 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f955e3-441f-4eb3-9190-dc65e92a8987 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:40.154191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f955e3-441f-4eb3-9190-dc65e92a8987 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:40.154453 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f955e3-441f-4eb3-9190-dc65e92a8987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:40.172440 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-97f955e3-441f-4eb3-9190-dc65e92a8987 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:40.173683 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-97f955e3-441f-4eb3-9190-dc65e92a8987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:40.235526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1165/2312] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:28:40.245267 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da266974-fda8-42c5-bb9f-472afb38bd01 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:40.246790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-da266974-fda8-42c5-bb9f-472afb38bd01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:40.308118 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da266974-fda8-42c5-bb9f-472afb38bd01 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:40.311667 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81881c3-ee32-435d-a42c-922871ea4aef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:40.312316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81881c3-ee32-435d-a42c-922871ea4aef service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:40.312602 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81881c3-ee32-435d-a42c-922871ea4aef service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:40.312883 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81881c3-ee32-435d-a42c-922871ea4aef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:40.321730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81881c3-ee32-435d-a42c-922871ea4aef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:40.324068 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81881c3-ee32-435d-a42c-922871ea4aef service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:40.333567 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1148/2313] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:28:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:28:40.737614 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f955e3-441f-4eb3-9190-dc65e92a8987 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:40.740503 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-97f955e3-441f-4eb3-9190-dc65e92a8987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:40.757808 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f955e3-441f-4eb3-9190-dc65e92a8987 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:40.764051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3400d-1785-4cad-aba3-6964dadcd19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:40.769279 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3400d-1785-4cad-aba3-6964dadcd19e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:40.769279 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3400d-1785-4cad-aba3-6964dadcd19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:40.769279 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3400d-1785-4cad-aba3-6964dadcd19e admin admin] PATH_INFO: `/v3/projects/616a6c8c53fb42e0978efe37c13fdf91` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:40.769279 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3400d-1785-4cad-aba3-6964dadcd19e admin admin] RBAC: Authorizing `identity:delete_project(project_id=616a6c8c53fb42e0978efe37c13fdf91)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:40.769279 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3400d-1785-4cad-aba3-6964dadcd19e admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:40.892788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-3bb3400d-1785-4cad-aba3-6964dadcd19e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '616a6c8c53fb42e0978efe37c13fdf91', 'request_id': 'req-3bb3400d-1785-4cad-aba3-6964dadcd19e'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:40.962467 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-3bb3400d-1785-4cad-aba3-6964dadcd19e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '616a6c8c53fb42e0978efe37c13fdf91', 'request_id': 'req-3bb3400d-1785-4cad-aba3-6964dadcd19e'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:40.969708 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-3bb3400d-1785-4cad-aba3-6964dadcd19e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '616a6c8c53fb42e0978efe37c13fdf91', 'request_id': 'req-3bb3400d-1785-4cad-aba3-6964dadcd19e'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:40.981007 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-3bb3400d-1785-4cad-aba3-6964dadcd19e admin admin] The token cache is being invalidate because project 616a6c8c53fb42e0978efe37c13fdf91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:28:40.981307 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-3bb3400d-1785-4cad-aba3-6964dadcd19e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:40.981987 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-3bb3400d-1785-4cad-aba3-6964dadcd19e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:28:40.983538 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1166/2314] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:28:40 2022] DELETE /identity/v3/projects/616a6c8c53fb42e0978efe37c13fdf91 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:28:49.131756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f0de9-1a8e-42d7-b4a6-aed5f3a36caf None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:49.132253 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f0de9-1a8e-42d7-b4a6-aed5f3a36caf None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:49.132355 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f0de9-1a8e-42d7-b4a6-aed5f3a36caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:49.150562 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-650f0de9-1a8e-42d7-b4a6-aed5f3a36caf None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:49.152404 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-650f0de9-1a8e-42d7-b4a6-aed5f3a36caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:49.214945 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1149/2315] 10.222.0.47 () {58 vars in 1016 bytes} [Mon Jul 11 11:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:28:49.422740 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3400d-1785-4cad-aba3-6964dadcd19e admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:49.424423 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-3bb3400d-1785-4cad-aba3-6964dadcd19e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:49.440764 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:49.502201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3400d-1785-4cad-aba3-6964dadcd19e admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:49.507684 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88166a5-f550-43c9-8487-37f6a44504f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:49.509702 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88166a5-f550-43c9-8487-37f6a44504f6 service nova] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:49.509702 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88166a5-f550-43c9-8487-37f6a44504f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:49.509702 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88166a5-f550-43c9-8487-37f6a44504f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:49.517821 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88166a5-f550-43c9-8487-37f6a44504f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:49.519433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88166a5-f550-43c9-8487-37f6a44504f6 service nova] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:49.529263 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1167/2316] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:28:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:28:53.265630 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f0de9-1a8e-42d7-b4a6-aed5f3a36caf None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:53.271153 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-650f0de9-1a8e-42d7-b4a6-aed5f3a36caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:53.285154 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:53.336533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f0de9-1a8e-42d7-b4a6-aed5f3a36caf None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:53.341575 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a853d-a8f1-44d6-9a4a-d1b829e6c870 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b7c9264495433985185332778dbc8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:53.342260 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a853d-a8f1-44d6-9a4a-d1b829e6c870 service placement] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:53.342639 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a853d-a8f1-44d6-9a4a-d1b829e6c870 service placement] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:53.342925 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a853d-a8f1-44d6-9a4a-d1b829e6c870 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:53.344699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-232a853d-a8f1-44d6-9a4a-d1b829e6c870 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:53.356121 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a853d-a8f1-44d6-9a4a-d1b829e6c870 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:53.357685 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a853d-a8f1-44d6-9a4a-d1b829e6c870 service placement] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:53.368350 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1150/2317] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:28:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:28:54.008829 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88166a5-f550-43c9-8487-37f6a44504f6 service nova] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:54.010857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-b88166a5-f550-43c9-8487-37f6a44504f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:54.075086 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88166a5-f550-43c9-8487-37f6a44504f6 service nova] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:54.078928 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcad74a-0480-4a44-ba1f-0871809f3ef5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:54.079918 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcad74a-0480-4a44-ba1f-0871809f3ef5 service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:54.080207 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcad74a-0480-4a44-ba1f-0871809f3ef5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:54.080484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcad74a-0480-4a44-ba1f-0871809f3ef5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:54.082297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-fbcad74a-0480-4a44-ba1f-0871809f3ef5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:54.144624 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcad74a-0480-4a44-ba1f-0871809f3ef5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:54.146051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcad74a-0480-4a44-ba1f-0871809f3ef5 service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:54.156664 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1168/2318] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:28:54 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:28:57.039363 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd39344-e33d-4ba7-bf77-e2d9da56c7df None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:57.039842 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd39344-e33d-4ba7-bf77-e2d9da56c7df None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:57.039991 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd39344-e33d-4ba7-bf77-e2d9da56c7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:57.058754 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-bdd39344-e33d-4ba7-bf77-e2d9da56c7df None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:28:57.059983 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-bdd39344-e33d-4ba7-bf77-e2d9da56c7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:57.068039 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1151/2319] 10.222.0.47 () {58 vars in 1016 bytes} [Mon Jul 11 11:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:28:57.101114 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcad74a-0480-4a44-ba1f-0871809f3ef5 service cinder] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:28:57.102549 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-fbcad74a-0480-4a44-ba1f-0871809f3ef5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:28:57.117420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcad74a-0480-4a44-ba1f-0871809f3ef5 service cinder] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:28:57.123535 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b97d3-6637-4021-9a21-5e62e0d87e9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:28:57.124169 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b97d3-6637-4021-9a21-5e62e0d87e9f service nova] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:28:57.124455 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b97d3-6637-4021-9a21-5e62e0d87e9f service nova] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:28:57.124733 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b97d3-6637-4021-9a21-5e62e0d87e9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:28:57.132713 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b97d3-6637-4021-9a21-5e62e0d87e9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:28:57.134344 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b97d3-6637-4021-9a21-5e62e0d87e9f service nova] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:28:57.145034 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1169/2320] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:28:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:29:02.289218 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228de28-24df-4936-b2cc-f8b407f1a534 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:02.289218 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228de28-24df-4936-b2cc-f8b407f1a534 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:02.289218 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228de28-24df-4936-b2cc-f8b407f1a534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:02.315313 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-b228de28-24df-4936-b2cc-f8b407f1a534 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:29:02.316557 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b228de28-24df-4936-b2cc-f8b407f1a534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:02.326215 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1152/2321] 10.222.0.47 () {58 vars in 1016 bytes} [Mon Jul 11 11:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:29:02.463014 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b97d3-6637-4021-9a21-5e62e0d87e9f service nova] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:02.474916 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b97d3-6637-4021-9a21-5e62e0d87e9f service nova] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:02.480725 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef852115-17d2-43fb-b0cb-63a097e18810 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:02.481364 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef852115-17d2-43fb-b0cb-63a097e18810 service nova] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:02.481649 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef852115-17d2-43fb-b0cb-63a097e18810 service nova] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:02.481969 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef852115-17d2-43fb-b0cb-63a097e18810 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:02.490280 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef852115-17d2-43fb-b0cb-63a097e18810 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:02.491848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef852115-17d2-43fb-b0cb-63a097e18810 service nova] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:02.501464 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1170/2322] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:29:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:29:07.681524 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586afd4-7606-4480-afa9-d4c53615803e None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:07.682662 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586afd4-7606-4480-afa9-d4c53615803e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:07.682773 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586afd4-7606-4480-afa9-d4c53615803e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:07.701401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-9586afd4-7606-4480-afa9-d4c53615803e None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:29:07.702676 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9586afd4-7606-4480-afa9-d4c53615803e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:07.711086 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1153/2323] 10.222.0.47 () {58 vars in 1016 bytes} [Mon Jul 11 11:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:29:07.734454 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef852115-17d2-43fb-b0cb-63a097e18810 service nova] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:07.747032 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef852115-17d2-43fb-b0cb-63a097e18810 service nova] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:07.754621 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89fd54-8bee-42b7-917e-60f0d118f5cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:07.755297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89fd54-8bee-42b7-917e-60f0d118f5cb service nova] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:07.755626 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89fd54-8bee-42b7-917e-60f0d118f5cb service nova] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:07.755903 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89fd54-8bee-42b7-917e-60f0d118f5cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:07.764964 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89fd54-8bee-42b7-917e-60f0d118f5cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:07.766996 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89fd54-8bee-42b7-917e-60f0d118f5cb service nova] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:07.779342 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1171/2324] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:29:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:29:14.977706 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586afd4-7606-4480-afa9-d4c53615803e None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:14.979777 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9586afd4-7606-4480-afa9-d4c53615803e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:14.991332 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586afd4-7606-4480-afa9-d4c53615803e None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:14.995935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2e859-2768-476a-8242-f8e9849a5916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:14.996801 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2e859-2768-476a-8242-f8e9849a5916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:14.997082 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2e859-2768-476a-8242-f8e9849a5916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:14.997358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2e859-2768-476a-8242-f8e9849a5916 admin admin] PATH_INFO: `/v3/users/23f1225dd9c140489aa3cf014acf000c` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:14.998571 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2e859-2768-476a-8242-f8e9849a5916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23f1225dd9c140489aa3cf014acf000c)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:15.000479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2e859-2768-476a-8242-f8e9849a5916 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:15.181898 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-62b2e859-2768-476a-8242-f8e9849a5916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23f1225dd9c140489aa3cf014acf000c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:15.182627 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-62b2e859-2768-476a-8242-f8e9849a5916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23f1225dd9c140489aa3cf014acf000c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:15.191447 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-62b2e859-2768-476a-8242-f8e9849a5916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23f1225dd9c140489aa3cf014acf000c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:15.263133 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-62b2e859-2768-476a-8242-f8e9849a5916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23f1225dd9c140489aa3cf014acf000c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:15.276382 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-62b2e859-2768-476a-8242-f8e9849a5916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23f1225dd9c140489aa3cf014acf000c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:15.282325 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1154/2325] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:29:14 2022] DELETE /identity/v3/users/23f1225dd9c140489aa3cf014acf000c => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:29:15.286837 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c0d18-1928-482a-9e50-4a86be6d8153 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:15.287295 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c0d18-1928-482a-9e50-4a86be6d8153 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:15.287389 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c0d18-1928-482a-9e50-4a86be6d8153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:15.304962 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-d51c0d18-1928-482a-9e50-4a86be6d8153 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:29:15.306127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-d51c0d18-1928-482a-9e50-4a86be6d8153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:15.310248 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:29:15.371106 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1172/2326] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:29:15.380490 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2e859-2768-476a-8242-f8e9849a5916 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:15.382022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-62b2e859-2768-476a-8242-f8e9849a5916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:15.443573 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2e859-2768-476a-8242-f8e9849a5916 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:15.447338 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cd3df-fef3-4aa2-b102-9af08aae4ab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:15.448797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cd3df-fef3-4aa2-b102-9af08aae4ab8 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:15.449094 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cd3df-fef3-4aa2-b102-9af08aae4ab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:15.449376 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cd3df-fef3-4aa2-b102-9af08aae4ab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:15.459125 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619cd3df-fef3-4aa2-b102-9af08aae4ab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:15.460692 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619cd3df-fef3-4aa2-b102-9af08aae4ab8 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:15.466876 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:29:15.471707 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1155/2327] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:29:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:29:16.057941 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c0d18-1928-482a-9e50-4a86be6d8153 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:16.059472 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-d51c0d18-1928-482a-9e50-4a86be6d8153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:16.071468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c0d18-1928-482a-9e50-4a86be6d8153 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:16.076463 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64d74d-d416-4656-b4e2-c27b90e90edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:16.077262 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64d74d-d416-4656-b4e2-c27b90e90edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:16.077546 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64d74d-d416-4656-b4e2-c27b90e90edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:16.077862 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64d74d-d416-4656-b4e2-c27b90e90edb admin admin] PATH_INFO: `/v3/projects/6afabd87e978492c8601f7fc170c86e7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:16.079067 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac64d74d-d416-4656-b4e2-c27b90e90edb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6afabd87e978492c8601f7fc170c86e7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:16.080969 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac64d74d-d416-4656-b4e2-c27b90e90edb admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:16.207510 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ac64d74d-d416-4656-b4e2-c27b90e90edb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6afabd87e978492c8601f7fc170c86e7', 'request_id': 'req-ac64d74d-d416-4656-b4e2-c27b90e90edb'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:16.317353 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ac64d74d-d416-4656-b4e2-c27b90e90edb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6afabd87e978492c8601f7fc170c86e7', 'request_id': 'req-ac64d74d-d416-4656-b4e2-c27b90e90edb'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:16.324448 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ac64d74d-d416-4656-b4e2-c27b90e90edb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6afabd87e978492c8601f7fc170c86e7', 'request_id': 'req-ac64d74d-d416-4656-b4e2-c27b90e90edb'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:16.335779 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ac64d74d-d416-4656-b4e2-c27b90e90edb admin admin] The token cache is being invalidate because project 6afabd87e978492c8601f7fc170c86e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:29:16.336010 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ac64d74d-d416-4656-b4e2-c27b90e90edb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:16.336673 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ac64d74d-d416-4656-b4e2-c27b90e90edb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:16.339099 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1173/2328] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:29:16 2022] DELETE /identity/v3/projects/6afabd87e978492c8601f7fc170c86e7 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:29:16.343651 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ba35d-82fa-42d4-ada0-71c7e8bdaa74 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:16.344097 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ba35d-82fa-42d4-ada0-71c7e8bdaa74 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:16.344219 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ba35d-82fa-42d4-ada0-71c7e8bdaa74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:16.363051 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-f45ba35d-82fa-42d4-ada0-71c7e8bdaa74 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:29:16.364262 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f45ba35d-82fa-42d4-ada0-71c7e8bdaa74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:16.427193 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1156/2329] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:29:16.435671 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af3029-40c8-4421-ba79-94fe72ed56ee None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:16.436038 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af3029-40c8-4421-ba79-94fe72ed56ee None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:16.436392 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af3029-40c8-4421-ba79-94fe72ed56ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:16.462685 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-32af3029-40c8-4421-ba79-94fe72ed56ee None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:29:16.464013 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-32af3029-40c8-4421-ba79-94fe72ed56ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:16.474783 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1174/2330] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:29:16.479288 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ba35d-82fa-42d4-ada0-71c7e8bdaa74 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:16.491352 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ba35d-82fa-42d4-ada0-71c7e8bdaa74 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:16.496828 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfd90c-9b9d-4e12-aa6e-2162530a9775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:16.505792 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfd90c-9b9d-4e12-aa6e-2162530a9775 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:16.505792 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfd90c-9b9d-4e12-aa6e-2162530a9775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:16.505792 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfd90c-9b9d-4e12-aa6e-2162530a9775 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:16.505792 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfd90c-9b9d-4e12-aa6e-2162530a9775 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:29:16.505792 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfd90c-9b9d-4e12-aa6e-2162530a9775 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:16.505792 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfd90c-9b9d-4e12-aa6e-2162530a9775 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:16.513661 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1157/2331] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:29:16.518233 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af3029-40c8-4421-ba79-94fe72ed56ee None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:16.527654 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af3029-40c8-4421-ba79-94fe72ed56ee None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:16.532252 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312521d2-a62c-4375-85af-ad190a61af97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:16.532907 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312521d2-a62c-4375-85af-ad190a61af97 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:16.533219 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312521d2-a62c-4375-85af-ad190a61af97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:16.533539 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312521d2-a62c-4375-85af-ad190a61af97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:16.534285 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312521d2-a62c-4375-85af-ad190a61af97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:16.536200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312521d2-a62c-4375-85af-ad190a61af97 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:16.639358 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1175/2332] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:29:16 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:29:16.643465 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfd90c-9b9d-4e12-aa6e-2162530a9775 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:16.653778 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfd90c-9b9d-4e12-aa6e-2162530a9775 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:16.709315 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1142711-41b1-4df3-900f-b2ca90a966eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:16.710008 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1142711-41b1-4df3-900f-b2ca90a966eb admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:16.710297 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1142711-41b1-4df3-900f-b2ca90a966eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:16.710577 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1142711-41b1-4df3-900f-b2ca90a966eb admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:16.711273 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1142711-41b1-4df3-900f-b2ca90a966eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:16.713757 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1142711-41b1-4df3-900f-b2ca90a966eb admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:16.852436 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1158/2333] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:29:16 2022] POST /identity/v3/users => generated 286 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:29:16.856619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312521d2-a62c-4375-85af-ad190a61af97 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:16.867471 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312521d2-a62c-4375-85af-ad190a61af97 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:16.872686 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f44c89-44e6-4c6b-a39a-6fd6a54949ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:16.873415 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f44c89-44e6-4c6b-a39a-6fd6a54949ce admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:16.873720 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f44c89-44e6-4c6b-a39a-6fd6a54949ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:16.874681 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f44c89-44e6-4c6b-a39a-6fd6a54949ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:16.874919 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f44c89-44e6-4c6b-a39a-6fd6a54949ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:16.876578 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f44c89-44e6-4c6b-a39a-6fd6a54949ce admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:16.890889 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1176/2334] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:29:16.894833 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1142711-41b1-4df3-900f-b2ca90a966eb admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:16.906504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1142711-41b1-4df3-900f-b2ca90a966eb admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:16.914785 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7367e7-e5b3-4e7b-958d-7885d11c5cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:16.915504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7367e7-e5b3-4e7b-958d-7885d11c5cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:16.915796 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7367e7-e5b3-4e7b-958d-7885d11c5cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:16.916729 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7367e7-e5b3-4e7b-958d-7885d11c5cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:16.917341 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7367e7-e5b3-4e7b-958d-7885d11c5cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:16.919028 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7367e7-e5b3-4e7b-958d-7885d11c5cf6 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:16.934038 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1159/2335] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:29:16.935169 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f44c89-44e6-4c6b-a39a-6fd6a54949ce admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:16.946385 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f44c89-44e6-4c6b-a39a-6fd6a54949ce admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:16.951946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2a12c-90a3-4575-88c2-8657cef499db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:16.953101 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2a12c-90a3-4575-88c2-8657cef499db admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:16.953450 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2a12c-90a3-4575-88c2-8657cef499db admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:16.953863 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2a12c-90a3-4575-88c2-8657cef499db admin admin] PATH_INFO: `/v3/projects/51e0307c0ebc4180a9902e2aaf057039/users/f580d1decb134d8b8a3218a7f7f089c8/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:16.970273 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2a12c-90a3-4575-88c2-8657cef499db admin admin] RBAC: Authorizing `identity:create_grant(project_id=51e0307c0ebc4180a9902e2aaf057039, user_id=f580d1decb134d8b8a3218a7f7f089c8, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:16.973129 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2a12c-90a3-4575-88c2-8657cef499db admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:17.060715 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1177/2336] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:29:16 2022] PUT /identity/v3/projects/51e0307c0ebc4180a9902e2aaf057039/users/f580d1decb134d8b8a3218a7f7f089c8/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:29:17.072051 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed875d84-4bab-40c4-ad41-84aa03909053 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:17.072486 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed875d84-4bab-40c4-ad41-84aa03909053 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:17.073007 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed875d84-4bab-40c4-ad41-84aa03909053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:17.101073 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-ed875d84-4bab-40c4-ad41-84aa03909053 None None] MFA Rules not processed for user `f580d1decb134d8b8a3218a7f7f089c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:29:17.102358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ed875d84-4bab-40c4-ad41-84aa03909053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:17.161827 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:29:17.172297 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1160/2337] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:29:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:29:17.184644 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2a12c-90a3-4575-88c2-8657cef499db admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:17.186512 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-27c2a12c-90a3-4575-88c2-8657cef499db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:17.220904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:29:17.247779 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2a12c-90a3-4575-88c2-8657cef499db admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:17.251891 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af85472-c710-4974-99ac-1fafc3395219 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a2d8d24562459493a3bcd399665a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:17.252551 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af85472-c710-4974-99ac-1fafc3395219 service glance] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:17.252858 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af85472-c710-4974-99ac-1fafc3395219 service glance] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:17.253142 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af85472-c710-4974-99ac-1fafc3395219 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:17.263053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af85472-c710-4974-99ac-1fafc3395219 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:17.264831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af85472-c710-4974-99ac-1fafc3395219 service glance] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:17.274466 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1178/2338] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:29:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:29:23.009163 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04490697-28ca-43ba-86d5-0685f14a6458 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:23.009666 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04490697-28ca-43ba-86d5-0685f14a6458 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:23.009788 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04490697-28ca-43ba-86d5-0685f14a6458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:23.028290 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-04490697-28ca-43ba-86d5-0685f14a6458 None None] MFA Rules not processed for user `cdfa8f4012c2471b81f8749b013d3117`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:29:23.032713 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-04490697-28ca-43ba-86d5-0685f14a6458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:23.085827 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1161/2339] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Jul 11 11:29:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:29:23.098838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af85472-c710-4974-99ac-1fafc3395219 service glance] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:23.100256 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-1af85472-c710-4974-99ac-1fafc3395219 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:23.170836 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af85472-c710-4974-99ac-1fafc3395219 service glance] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:23.175783 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50299d46-4255-4b13-8cf2-cf6ca65d44b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736f6d4d1dbb47ff98bc67e53614d49c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:23.176496 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50299d46-4255-4b13-8cf2-cf6ca65d44b6 service swift] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:23.176781 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50299d46-4255-4b13-8cf2-cf6ca65d44b6 service swift] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:23.177058 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50299d46-4255-4b13-8cf2-cf6ca65d44b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:23.185802 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50299d46-4255-4b13-8cf2-cf6ca65d44b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:23.188274 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50299d46-4255-4b13-8cf2-cf6ca65d44b6 service swift] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:23.197464 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1179/2340] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jul 11 11:29:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 11:29:25.655750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04490697-28ca-43ba-86d5-0685f14a6458 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:25.658165 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-04490697-28ca-43ba-86d5-0685f14a6458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:25.754049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04490697-28ca-43ba-86d5-0685f14a6458 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:25.759173 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7e5ba-74bf-485d-a251-296b66914eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:25.760157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7e5ba-74bf-485d-a251-296b66914eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:25.760574 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7e5ba-74bf-485d-a251-296b66914eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:25.761087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7e5ba-74bf-485d-a251-296b66914eca admin admin] PATH_INFO: `/v3/users/6b01d48939b947a18947ec35f74a666e` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:25.762384 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7e5ba-74bf-485d-a251-296b66914eca admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b01d48939b947a18947ec35f74a666e)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:25.764832 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7e5ba-74bf-485d-a251-296b66914eca admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:25.943104 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-5bc7e5ba-74bf-485d-a251-296b66914eca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b01d48939b947a18947ec35f74a666e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:25.947059 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-5bc7e5ba-74bf-485d-a251-296b66914eca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b01d48939b947a18947ec35f74a666e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:25.955595 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-5bc7e5ba-74bf-485d-a251-296b66914eca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b01d48939b947a18947ec35f74a666e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:26.023459 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-5bc7e5ba-74bf-485d-a251-296b66914eca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b01d48939b947a18947ec35f74a666e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:26.043242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-5bc7e5ba-74bf-485d-a251-296b66914eca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b01d48939b947a18947ec35f74a666e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:26.053058 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1162/2341] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:29:25 2022] DELETE /identity/v3/users/6b01d48939b947a18947ec35f74a666e => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:29:26.375375 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50299d46-4255-4b13-8cf2-cf6ca65d44b6 service swift] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:26.396987 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50299d46-4255-4b13-8cf2-cf6ca65d44b6 service swift] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:26.547491 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ef066-6f21-4ebd-a112-31fef1a2143b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:26.548395 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ef066-6f21-4ebd-a112-31fef1a2143b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:26.548685 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ef066-6f21-4ebd-a112-31fef1a2143b admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:26.548965 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ef066-6f21-4ebd-a112-31fef1a2143b admin admin] PATH_INFO: `/v3/projects/aff73ee7334c4cc3bce66492cf001c2f` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:26.550312 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ef066-6f21-4ebd-a112-31fef1a2143b admin admin] RBAC: Authorizing `identity:delete_project(project_id=aff73ee7334c4cc3bce66492cf001c2f)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:26.552292 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ef066-6f21-4ebd-a112-31fef1a2143b admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:26.802649 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-4c8ef066-6f21-4ebd-a112-31fef1a2143b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aff73ee7334c4cc3bce66492cf001c2f', 'request_id': 'req-4c8ef066-6f21-4ebd-a112-31fef1a2143b'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:27.082904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-4c8ef066-6f21-4ebd-a112-31fef1a2143b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aff73ee7334c4cc3bce66492cf001c2f', 'request_id': 'req-4c8ef066-6f21-4ebd-a112-31fef1a2143b'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:27.090481 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-4c8ef066-6f21-4ebd-a112-31fef1a2143b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aff73ee7334c4cc3bce66492cf001c2f', 'request_id': 'req-4c8ef066-6f21-4ebd-a112-31fef1a2143b'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:27.092482 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:29:27.101337 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-4c8ef066-6f21-4ebd-a112-31fef1a2143b admin admin] The token cache is being invalidate because project aff73ee7334c4cc3bce66492cf001c2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:29:27.101966 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-4c8ef066-6f21-4ebd-a112-31fef1a2143b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:27.111476 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-4c8ef066-6f21-4ebd-a112-31fef1a2143b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:27.115993 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1180/2342] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:29:26 2022] DELETE /identity/v3/projects/aff73ee7334c4cc3bce66492cf001c2f => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:29:27.121963 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7e5ba-74bf-485d-a251-296b66914eca admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:27.123499 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-5bc7e5ba-74bf-485d-a251-296b66914eca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:27.139647 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7e5ba-74bf-485d-a251-296b66914eca admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:27.157267 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:29:27.200372 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4185fc3-7fec-4be5-89da-75650c21e0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:27.201257 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4185fc3-7fec-4be5-89da-75650c21e0e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:27.201542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4185fc3-7fec-4be5-89da-75650c21e0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:27.201858 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4185fc3-7fec-4be5-89da-75650c21e0e7 admin admin] PATH_INFO: `/v3/users/0aaf493e5c6a4dc8992ec68fbfe5d0a5` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:27.203070 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4185fc3-7fec-4be5-89da-75650c21e0e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aaf493e5c6a4dc8992ec68fbfe5d0a5)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:27.204979 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4185fc3-7fec-4be5-89da-75650c21e0e7 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:27.418631 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-d4185fc3-7fec-4be5-89da-75650c21e0e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aaf493e5c6a4dc8992ec68fbfe5d0a5'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:27.419279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-d4185fc3-7fec-4be5-89da-75650c21e0e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aaf493e5c6a4dc8992ec68fbfe5d0a5'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:27.426998 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-d4185fc3-7fec-4be5-89da-75650c21e0e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aaf493e5c6a4dc8992ec68fbfe5d0a5'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:27.500434 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-d4185fc3-7fec-4be5-89da-75650c21e0e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aaf493e5c6a4dc8992ec68fbfe5d0a5'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:27.518616 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-d4185fc3-7fec-4be5-89da-75650c21e0e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aaf493e5c6a4dc8992ec68fbfe5d0a5'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:27.524930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1163/2343] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:29:27 2022] DELETE /identity/v3/users/0aaf493e5c6a4dc8992ec68fbfe5d0a5 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:29:27.897719 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ef066-6f21-4ebd-a112-31fef1a2143b admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:27.897719 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-4c8ef066-6f21-4ebd-a112-31fef1a2143b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:27.924987 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ef066-6f21-4ebd-a112-31fef1a2143b admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:28.002379 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4faa5f7-661a-4b8c-b8ac-a4f140c2d305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:28.003253 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4faa5f7-661a-4b8c-b8ac-a4f140c2d305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:28.003542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4faa5f7-661a-4b8c-b8ac-a4f140c2d305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:28.003821 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4faa5f7-661a-4b8c-b8ac-a4f140c2d305 admin admin] PATH_INFO: `/v3/projects/a76a2868fbb44c5ea08332e3fd7183d1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:28.005283 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4faa5f7-661a-4b8c-b8ac-a4f140c2d305 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a76a2868fbb44c5ea08332e3fd7183d1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:28.007580 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4faa5f7-661a-4b8c-b8ac-a4f140c2d305 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:28.117103 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e4faa5f7-661a-4b8c-b8ac-a4f140c2d305 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a76a2868fbb44c5ea08332e3fd7183d1', 'request_id': 'req-e4faa5f7-661a-4b8c-b8ac-a4f140c2d305'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:28.208388 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e4faa5f7-661a-4b8c-b8ac-a4f140c2d305 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a76a2868fbb44c5ea08332e3fd7183d1', 'request_id': 'req-e4faa5f7-661a-4b8c-b8ac-a4f140c2d305'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:28.215654 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e4faa5f7-661a-4b8c-b8ac-a4f140c2d305 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a76a2868fbb44c5ea08332e3fd7183d1', 'request_id': 'req-e4faa5f7-661a-4b8c-b8ac-a4f140c2d305'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:28.228359 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e4faa5f7-661a-4b8c-b8ac-a4f140c2d305 admin admin] The token cache is being invalidate because project a76a2868fbb44c5ea08332e3fd7183d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:29:28.229754 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e4faa5f7-661a-4b8c-b8ac-a4f140c2d305 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:28.231199 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e4faa5f7-661a-4b8c-b8ac-a4f140c2d305 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:28.233812 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1181/2344] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:29:27 2022] DELETE /identity/v3/projects/a76a2868fbb44c5ea08332e3fd7183d1 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:29:28.238558 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ce971-3356-4b03-b3fe-a7740819f6f3 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:28.239074 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ce971-3356-4b03-b3fe-a7740819f6f3 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:28.239165 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ce971-3356-4b03-b3fe-a7740819f6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:28.259101 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-989ce971-3356-4b03-b3fe-a7740819f6f3 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:29:28.260945 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-989ce971-3356-4b03-b3fe-a7740819f6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:28.335444 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1164/2345] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:29:28.345600 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7fb54-f224-4d06-82f7-0673eec3e288 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:28.345952 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7fb54-f224-4d06-82f7-0673eec3e288 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:28.346337 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7fb54-f224-4d06-82f7-0673eec3e288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:28.374608 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-73a7fb54-f224-4d06-82f7-0673eec3e288 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:29:28.375861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-73a7fb54-f224-4d06-82f7-0673eec3e288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:28.384018 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1182/2346] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:29:28.389100 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ce971-3356-4b03-b3fe-a7740819f6f3 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:28.399044 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ce971-3356-4b03-b3fe-a7740819f6f3 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:28.403843 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46617be9-f382-4927-a6e5-33f1c0dc6776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:28.404643 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46617be9-f382-4927-a6e5-33f1c0dc6776 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:28.404930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46617be9-f382-4927-a6e5-33f1c0dc6776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:28.405209 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46617be9-f382-4927-a6e5-33f1c0dc6776 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:28.406038 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46617be9-f382-4927-a6e5-33f1c0dc6776 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:29:28.406354 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46617be9-f382-4927-a6e5-33f1c0dc6776 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:28.407962 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46617be9-f382-4927-a6e5-33f1c0dc6776 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:28.423583 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1165/2347] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:29:28.428188 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7fb54-f224-4d06-82f7-0673eec3e288 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:28.439016 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7fb54-f224-4d06-82f7-0673eec3e288 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:28.444006 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d2ebe-afc3-4719-8f93-c169d61c8e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:28.444662 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d2ebe-afc3-4719-8f93-c169d61c8e04 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:28.454560 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d2ebe-afc3-4719-8f93-c169d61c8e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:28.454560 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d2ebe-afc3-4719-8f93-c169d61c8e04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:28.454560 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d2ebe-afc3-4719-8f93-c169d61c8e04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:28.454560 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d2ebe-afc3-4719-8f93-c169d61c8e04 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:28.551802 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1183/2348] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:29:28 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:29:28.556839 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46617be9-f382-4927-a6e5-33f1c0dc6776 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:28.567557 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46617be9-f382-4927-a6e5-33f1c0dc6776 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:28.598012 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:29:28.652441 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24834bbc-0d0c-418c-9b6b-9dfdb3731fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:28.653609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24834bbc-0d0c-418c-9b6b-9dfdb3731fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:28.654187 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24834bbc-0d0c-418c-9b6b-9dfdb3731fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:28.654920 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24834bbc-0d0c-418c-9b6b-9dfdb3731fc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:28.655625 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24834bbc-0d0c-418c-9b6b-9dfdb3731fc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:28.657647 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24834bbc-0d0c-418c-9b6b-9dfdb3731fc0 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:28.748743 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d2ebe-afc3-4719-8f93-c169d61c8e04 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:28.749384 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1166/2349] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:29:28 2022] POST /identity/v3/users => generated 288 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:29:28.760386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d2ebe-afc3-4719-8f93-c169d61c8e04 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:28.768242 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96c214-40e7-4e66-9f94-37eb70e33ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:28.769026 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96c214-40e7-4e66-9f94-37eb70e33ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:28.769375 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96c214-40e7-4e66-9f94-37eb70e33ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:28.769734 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96c214-40e7-4e66-9f94-37eb70e33ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:28.770566 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96c214-40e7-4e66-9f94-37eb70e33ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:28.772427 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96c214-40e7-4e66-9f94-37eb70e33ec6 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:28.785012 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1184/2350] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:29:28.789417 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24834bbc-0d0c-418c-9b6b-9dfdb3731fc0 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:28.802782 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24834bbc-0d0c-418c-9b6b-9dfdb3731fc0 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:28.816294 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858c649-81cb-49b2-8e6b-6d3eacf237dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:28.816294 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858c649-81cb-49b2-8e6b-6d3eacf237dd admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:28.816294 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858c649-81cb-49b2-8e6b-6d3eacf237dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:28.816294 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858c649-81cb-49b2-8e6b-6d3eacf237dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:28.816727 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858c649-81cb-49b2-8e6b-6d3eacf237dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:28.816727 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858c649-81cb-49b2-8e6b-6d3eacf237dd admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:28.831533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1167/2351] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:29:28.836049 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96c214-40e7-4e66-9f94-37eb70e33ec6 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:28.848746 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96c214-40e7-4e66-9f94-37eb70e33ec6 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:28.854275 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748a30e-cbae-41bb-905c-3d66306454d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:28.857260 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748a30e-cbae-41bb-905c-3d66306454d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:28.857260 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748a30e-cbae-41bb-905c-3d66306454d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:28.857260 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748a30e-cbae-41bb-905c-3d66306454d2 admin admin] PATH_INFO: `/v3/projects/c196bb5f48e142efbe53d0488461c876/users/91018a785c044344b633d67bc025866b/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:28.886537 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9748a30e-cbae-41bb-905c-3d66306454d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c196bb5f48e142efbe53d0488461c876, user_id=91018a785c044344b633d67bc025866b, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:28.889633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9748a30e-cbae-41bb-905c-3d66306454d2 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:28.982420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1185/2352] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:29:28 2022] PUT /identity/v3/projects/c196bb5f48e142efbe53d0488461c876/users/91018a785c044344b633d67bc025866b/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:29:28.991285 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40b878-00f4-46f6-aa92-fe20049f1c3b None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:28.991642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40b878-00f4-46f6-aa92-fe20049f1c3b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:28.991989 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40b878-00f4-46f6-aa92-fe20049f1c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:29.034795 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-3e40b878-00f4-46f6-aa92-fe20049f1c3b None None] MFA Rules not processed for user `91018a785c044344b633d67bc025866b`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:29:29.036212 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3e40b878-00f4-46f6-aa92-fe20049f1c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:29.132218 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1168/2353] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:29:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:29:29.145520 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748a30e-cbae-41bb-905c-3d66306454d2 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:29.147317 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-9748a30e-cbae-41bb-905c-3d66306454d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:29.170599 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:29:29.221153 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748a30e-cbae-41bb-905c-3d66306454d2 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:29.224971 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd69d6f-7e37-4a2d-92a1-8698142fa984 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:29.225633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd69d6f-7e37-4a2d-92a1-8698142fa984 service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:29.225959 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd69d6f-7e37-4a2d-92a1-8698142fa984 service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:29.226393 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd69d6f-7e37-4a2d-92a1-8698142fa984 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:29.237034 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd69d6f-7e37-4a2d-92a1-8698142fa984 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:29.238668 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd69d6f-7e37-4a2d-92a1-8698142fa984 service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:29.256525 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1186/2354] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:29:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:29:32.900340 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a9d13-8ad6-48e9-b904-809073d8feb4 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:32.900883 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a9d13-8ad6-48e9-b904-809073d8feb4 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:32.900883 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a9d13-8ad6-48e9-b904-809073d8feb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:32.919715 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-cc3a9d13-8ad6-48e9-b904-809073d8feb4 None None] MFA Rules not processed for user `58581f894dbd470a97bd92580323ac56`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:29:32.920970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-cc3a9d13-8ad6-48e9-b904-809073d8feb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:32.991718 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1169/2355] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:29:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:29:36.101156 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd69d6f-7e37-4a2d-92a1-8698142fa984 service cinder] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:36.163927 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd69d6f-7e37-4a2d-92a1-8698142fa984 service cinder] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:36.169033 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353679e-cb53-4a26-a6c8-a02097599561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:36.170019 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353679e-cb53-4a26-a6c8-a02097599561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:36.170308 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353679e-cb53-4a26-a6c8-a02097599561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:36.170586 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353679e-cb53-4a26-a6c8-a02097599561 admin admin] PATH_INFO: `/v3/users/91018a785c044344b633d67bc025866b` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:36.171789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353679e-cb53-4a26-a6c8-a02097599561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91018a785c044344b633d67bc025866b)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:36.173785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353679e-cb53-4a26-a6c8-a02097599561 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:36.393888 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-4353679e-cb53-4a26-a6c8-a02097599561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91018a785c044344b633d67bc025866b'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:36.468731 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-4353679e-cb53-4a26-a6c8-a02097599561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91018a785c044344b633d67bc025866b'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:36.476916 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-4353679e-cb53-4a26-a6c8-a02097599561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91018a785c044344b633d67bc025866b'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:36.477600 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-4353679e-cb53-4a26-a6c8-a02097599561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91018a785c044344b633d67bc025866b'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:36.478343 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-4353679e-cb53-4a26-a6c8-a02097599561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91018a785c044344b633d67bc025866b'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:36.506713 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1187/2356] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:29:36 2022] DELETE /identity/v3/users/91018a785c044344b633d67bc025866b => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:29:36.509685 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a30d02-815d-4aa3-944f-d60c58669bdd None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:36.511138 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a30d02-815d-4aa3-944f-d60c58669bdd None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:36.511138 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a30d02-815d-4aa3-944f-d60c58669bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:36.537935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-38a30d02-815d-4aa3-944f-d60c58669bdd None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:29:36.537935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-38a30d02-815d-4aa3-944f-d60c58669bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:36.571797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:29:36.603475 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1170/2357] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:29:36.607329 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353679e-cb53-4a26-a6c8-a02097599561 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:36.608849 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-4353679e-cb53-4a26-a6c8-a02097599561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:36.659863 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:29:36.675113 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353679e-cb53-4a26-a6c8-a02097599561 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:36.678655 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390adea5-045a-4386-87d9-327994b4e19c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:36.679306 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390adea5-045a-4386-87d9-327994b4e19c service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:36.684664 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390adea5-045a-4386-87d9-327994b4e19c service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:36.684664 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390adea5-045a-4386-87d9-327994b4e19c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:36.689941 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390adea5-045a-4386-87d9-327994b4e19c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:36.691424 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390adea5-045a-4386-87d9-327994b4e19c service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:36.702139 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1188/2358] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:29:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:29:37.153867 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a30d02-815d-4aa3-944f-d60c58669bdd None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:37.154756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-38a30d02-815d-4aa3-944f-d60c58669bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:37.169353 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a30d02-815d-4aa3-944f-d60c58669bdd None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:37.174590 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a70e4b-35e2-4923-a996-6a88452a4751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:37.175474 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a70e4b-35e2-4923-a996-6a88452a4751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:37.175837 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a70e4b-35e2-4923-a996-6a88452a4751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:37.176041 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a70e4b-35e2-4923-a996-6a88452a4751 admin admin] PATH_INFO: `/v3/projects/c196bb5f48e142efbe53d0488461c876` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:37.177265 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a70e4b-35e2-4923-a996-6a88452a4751 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c196bb5f48e142efbe53d0488461c876)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:37.179207 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a70e4b-35e2-4923-a996-6a88452a4751 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:37.279677 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b1a70e4b-35e2-4923-a996-6a88452a4751 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c196bb5f48e142efbe53d0488461c876', 'request_id': 'req-b1a70e4b-35e2-4923-a996-6a88452a4751'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:37.285790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b1a70e4b-35e2-4923-a996-6a88452a4751 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c196bb5f48e142efbe53d0488461c876', 'request_id': 'req-b1a70e4b-35e2-4923-a996-6a88452a4751'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:37.388754 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b1a70e4b-35e2-4923-a996-6a88452a4751 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c196bb5f48e142efbe53d0488461c876', 'request_id': 'req-b1a70e4b-35e2-4923-a996-6a88452a4751'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:37.405404 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b1a70e4b-35e2-4923-a996-6a88452a4751 admin admin] The token cache is being invalidate because project c196bb5f48e142efbe53d0488461c876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:29:37.405833 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b1a70e4b-35e2-4923-a996-6a88452a4751 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:37.406576 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b1a70e4b-35e2-4923-a996-6a88452a4751 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:37.408451 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1171/2359] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:29:37 2022] DELETE /identity/v3/projects/c196bb5f48e142efbe53d0488461c876 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:29:43.866853 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04982f-a65d-48bc-a7e8-2f06652563bb None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:43.867395 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04982f-a65d-48bc-a7e8-2f06652563bb None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:43.867395 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04982f-a65d-48bc-a7e8-2f06652563bb None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:43.869100 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1189/2360] 10.222.0.23 () {54 vars in 921 bytes} [Mon Jul 11 11:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:29:43.875483 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bd040-e1e6-4eb0-8da1-8c771a8fd4a6 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:43.875912 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bd040-e1e6-4eb0-8da1-8c771a8fd4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:43.876127 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bd040-e1e6-4eb0-8da1-8c771a8fd4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:43.895778 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-174bd040-e1e6-4eb0-8da1-8c771a8fd4a6 None None] MFA Rules not processed for user `5b9e7594afc346e593ef3e6c579e237b`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:29:43.896983 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-174bd040-e1e6-4eb0-8da1-8c771a8fd4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:43.964353 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1172/2361] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Jul 11 11:29:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:29:43.976081 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04982f-a65d-48bc-a7e8-2f06652563bb None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:43.977814 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-ec04982f-a65d-48bc-a7e8-2f06652563bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:44.035646 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04982f-a65d-48bc-a7e8-2f06652563bb None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:44.039272 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de7a13-93cc-422d-81bc-67d7b43315a8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a2d8d24562459493a3bcd399665a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:44.039913 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de7a13-93cc-422d-81bc-67d7b43315a8 service glance] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:44.040200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de7a13-93cc-422d-81bc-67d7b43315a8 service glance] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:44.040475 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de7a13-93cc-422d-81bc-67d7b43315a8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:44.050791 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de7a13-93cc-422d-81bc-67d7b43315a8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:44.052291 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de7a13-93cc-422d-81bc-67d7b43315a8 service glance] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:44.064358 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1190/2362] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:29:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:29:44.268345 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e36249-b28b-4013-a96b-782520641c29 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:44.268846 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e36249-b28b-4013-a96b-782520641c29 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:44.269351 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e36249-b28b-4013-a96b-782520641c29 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:44.272232 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1173/2363] 10.222.0.23 () {54 vars in 921 bytes} [Mon Jul 11 11:29:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:29:44.278848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e9d47-4eef-4571-9e23-a154e76c82d5 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:44.279795 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e9d47-4eef-4571-9e23-a154e76c82d5 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:44.279795 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e9d47-4eef-4571-9e23-a154e76c82d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:44.299370 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-3f5e9d47-4eef-4571-9e23-a154e76c82d5 None None] MFA Rules not processed for user `79b8c08920b0417097bebd23344ffe64`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:29:44.300574 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-3f5e9d47-4eef-4571-9e23-a154e76c82d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:44.351986 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1191/2364] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Jul 11 11:29:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:29:44.363814 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e36249-b28b-4013-a96b-782520641c29 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:44.365561 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f9e36249-b28b-4013-a96b-782520641c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:44.378779 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e36249-b28b-4013-a96b-782520641c29 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:44.382314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642c58d-bf28-4ac9-a8b7-684228e40a33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:44.382955 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642c58d-bf28-4ac9-a8b7-684228e40a33 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:44.383245 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642c58d-bf28-4ac9-a8b7-684228e40a33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:44.383525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642c58d-bf28-4ac9-a8b7-684228e40a33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:44.391124 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642c58d-bf28-4ac9-a8b7-684228e40a33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:44.392663 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642c58d-bf28-4ac9-a8b7-684228e40a33 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:44.400992 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1174/2365] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:29:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:29:44.489127 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33e3cd-ffe4-45aa-b756-7879d25f5bb3 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:44.489419 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33e3cd-ffe4-45aa-b756-7879d25f5bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:44.489696 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33e3cd-ffe4-45aa-b756-7879d25f5bb3 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:44.491318 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1192/2366] 10.222.0.23 () {54 vars in 921 bytes} [Mon Jul 11 11:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:29:44.496696 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d266448-d0ed-4e63-ac42-4b0ca52c00cf None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:44.496990 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d266448-d0ed-4e63-ac42-4b0ca52c00cf None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:44.497273 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d266448-d0ed-4e63-ac42-4b0ca52c00cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:44.515805 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-2d266448-d0ed-4e63-ac42-4b0ca52c00cf None None] MFA Rules not processed for user `5b9e7594afc346e593ef3e6c579e237b`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:29:44.517011 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2d266448-d0ed-4e63-ac42-4b0ca52c00cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:44.526938 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1175/2367] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Jul 11 11:29:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:29:44.537320 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33e3cd-ffe4-45aa-b756-7879d25f5bb3 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:44.548993 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33e3cd-ffe4-45aa-b756-7879d25f5bb3 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:44.552802 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0be9ba-3522-4310-9dfb-814131f43ca9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:44.553448 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0be9ba-3522-4310-9dfb-814131f43ca9 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:44.553728 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0be9ba-3522-4310-9dfb-814131f43ca9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:44.554031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0be9ba-3522-4310-9dfb-814131f43ca9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:44.566443 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0be9ba-3522-4310-9dfb-814131f43ca9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:44.567938 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0be9ba-3522-4310-9dfb-814131f43ca9 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:44.580130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1193/2368] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:29:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:29:49.174534 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aad2f3-0f53-466b-911e-274b4042ae20 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:49.175032 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aad2f3-0f53-466b-911e-274b4042ae20 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:49.175147 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aad2f3-0f53-466b-911e-274b4042ae20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:49.193597 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-f6aad2f3-0f53-466b-911e-274b4042ae20 None None] MFA Rules not processed for user `cdfa8f4012c2471b81f8749b013d3117`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:29:49.194899 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f6aad2f3-0f53-466b-911e-274b4042ae20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:49.227967 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:29:49.254508 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1176/2369] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Jul 11 11:29:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:29:49.267901 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0be9ba-3522-4310-9dfb-814131f43ca9 service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:49.271774 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-7a0be9ba-3522-4310-9dfb-814131f43ca9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:49.361350 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0be9ba-3522-4310-9dfb-814131f43ca9 service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:49.367361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169e9c4-a0e6-4bd5-a65e-ff7c1b5a2d89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736f6d4d1dbb47ff98bc67e53614d49c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:49.368104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169e9c4-a0e6-4bd5-a65e-ff7c1b5a2d89 service swift] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:49.368460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169e9c4-a0e6-4bd5-a65e-ff7c1b5a2d89 service swift] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:49.368802 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169e9c4-a0e6-4bd5-a65e-ff7c1b5a2d89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:49.378988 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169e9c4-a0e6-4bd5-a65e-ff7c1b5a2d89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:49.380591 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169e9c4-a0e6-4bd5-a65e-ff7c1b5a2d89 service swift] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:49.389751 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1194/2370] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jul 11 11:29:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 11:29:51.758308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aad2f3-0f53-466b-911e-274b4042ae20 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:51.760478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f6aad2f3-0f53-466b-911e-274b4042ae20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:51.830772 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aad2f3-0f53-466b-911e-274b4042ae20 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:51.835222 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2df3e-2911-4ec0-998e-baf523c6ca00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:51.836205 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2df3e-2911-4ec0-998e-baf523c6ca00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:51.836484 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2df3e-2911-4ec0-998e-baf523c6ca00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:51.836763 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2df3e-2911-4ec0-998e-baf523c6ca00 admin admin] PATH_INFO: `/v3/users/f580d1decb134d8b8a3218a7f7f089c8` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:51.838676 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2df3e-2911-4ec0-998e-baf523c6ca00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f580d1decb134d8b8a3218a7f7f089c8)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:51.840678 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2df3e-2911-4ec0-998e-baf523c6ca00 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:52.064246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-e3b2df3e-2911-4ec0-998e-baf523c6ca00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f580d1decb134d8b8a3218a7f7f089c8'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:52.065027 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-e3b2df3e-2911-4ec0-998e-baf523c6ca00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f580d1decb134d8b8a3218a7f7f089c8'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:52.074266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-e3b2df3e-2911-4ec0-998e-baf523c6ca00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f580d1decb134d8b8a3218a7f7f089c8'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:52.174288 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-e3b2df3e-2911-4ec0-998e-baf523c6ca00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f580d1decb134d8b8a3218a7f7f089c8'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:52.190768 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-e3b2df3e-2911-4ec0-998e-baf523c6ca00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f580d1decb134d8b8a3218a7f7f089c8'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:52.200290 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1177/2371] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:29:51 2022] DELETE /identity/v3/users/f580d1decb134d8b8a3218a7f7f089c8 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:29:52.205284 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80365d-0df8-453a-9dc9-05c65cf28aee None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:52.205826 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80365d-0df8-453a-9dc9-05c65cf28aee None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:52.206009 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80365d-0df8-453a-9dc9-05c65cf28aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:52.225060 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-4a80365d-0df8-453a-9dc9-05c65cf28aee None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:29:52.226441 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-4a80365d-0df8-453a-9dc9-05c65cf28aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:52.232370 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:29:52.306006 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1195/2372] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:29:52.314477 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2df3e-2911-4ec0-998e-baf523c6ca00 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:52.316261 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e3b2df3e-2911-4ec0-998e-baf523c6ca00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:52.405186 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2df3e-2911-4ec0-998e-baf523c6ca00 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:52.409342 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c323f59-ff80-4bec-a4c8-f709aa9c4116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:52.410109 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c323f59-ff80-4bec-a4c8-f709aa9c4116 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:52.410454 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c323f59-ff80-4bec-a4c8-f709aa9c4116 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:52.410797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c323f59-ff80-4bec-a4c8-f709aa9c4116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:52.420423 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c323f59-ff80-4bec-a4c8-f709aa9c4116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:52.421901 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c323f59-ff80-4bec-a4c8-f709aa9c4116 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:52.431236 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1178/2373] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:29:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:29:52.841472 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80365d-0df8-453a-9dc9-05c65cf28aee None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:52.842947 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-4a80365d-0df8-453a-9dc9-05c65cf28aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:52.855676 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80365d-0df8-453a-9dc9-05c65cf28aee None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:52.860294 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de05f6-142b-434b-ad3c-dbba8cfeb1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:52.861162 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de05f6-142b-434b-ad3c-dbba8cfeb1d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:52.861479 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de05f6-142b-434b-ad3c-dbba8cfeb1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:52.861771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de05f6-142b-434b-ad3c-dbba8cfeb1d3 admin admin] PATH_INFO: `/v3/projects/51e0307c0ebc4180a9902e2aaf057039` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:52.862987 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de05f6-142b-434b-ad3c-dbba8cfeb1d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51e0307c0ebc4180a9902e2aaf057039)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:52.864902 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de05f6-142b-434b-ad3c-dbba8cfeb1d3 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:52.974117 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-90de05f6-142b-434b-ad3c-dbba8cfeb1d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51e0307c0ebc4180a9902e2aaf057039', 'request_id': 'req-90de05f6-142b-434b-ad3c-dbba8cfeb1d3'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:53.037526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-90de05f6-142b-434b-ad3c-dbba8cfeb1d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51e0307c0ebc4180a9902e2aaf057039', 'request_id': 'req-90de05f6-142b-434b-ad3c-dbba8cfeb1d3'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:53.044556 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-90de05f6-142b-434b-ad3c-dbba8cfeb1d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51e0307c0ebc4180a9902e2aaf057039', 'request_id': 'req-90de05f6-142b-434b-ad3c-dbba8cfeb1d3'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:53.055217 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-90de05f6-142b-434b-ad3c-dbba8cfeb1d3 admin admin] The token cache is being invalidate because project 51e0307c0ebc4180a9902e2aaf057039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:29:53.055508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-90de05f6-142b-434b-ad3c-dbba8cfeb1d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:53.056140 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-90de05f6-142b-434b-ad3c-dbba8cfeb1d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:29:53.058761 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1196/2374] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:29:52 2022] DELETE /identity/v3/projects/51e0307c0ebc4180a9902e2aaf057039 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:29:53.063722 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850c4d4-9c33-4c90-ab1f-2ad4849dc0f0 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:53.064222 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850c4d4-9c33-4c90-ab1f-2ad4849dc0f0 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:53.064314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850c4d4-9c33-4c90-ab1f-2ad4849dc0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:53.070544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:29:53.083403 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-e850c4d4-9c33-4c90-ab1f-2ad4849dc0f0 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:29:53.084605 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e850c4d4-9c33-4c90-ab1f-2ad4849dc0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:53.147481 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1179/2375] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:29:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:29:53.155518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fb6fd-6cd0-450f-831e-6dbed5d85059 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:53.155812 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fb6fd-6cd0-450f-831e-6dbed5d85059 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:53.156099 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fb6fd-6cd0-450f-831e-6dbed5d85059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:53.174306 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-049fb6fd-6cd0-450f-831e-6dbed5d85059 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:29:53.175559 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-049fb6fd-6cd0-450f-831e-6dbed5d85059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:53.185007 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1197/2376] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:29:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:29:53.189121 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850c4d4-9c33-4c90-ab1f-2ad4849dc0f0 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:53.204775 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850c4d4-9c33-4c90-ab1f-2ad4849dc0f0 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:53.211351 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e9d53-46f9-45f5-bfed-670c6c39a9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:53.212381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e9d53-46f9-45f5-bfed-670c6c39a9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:53.212921 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e9d53-46f9-45f5-bfed-670c6c39a9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:53.213414 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e9d53-46f9-45f5-bfed-670c6c39a9c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:53.214997 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e9d53-46f9-45f5-bfed-670c6c39a9c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:29:53.215558 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e9d53-46f9-45f5-bfed-670c6c39a9c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:53.217909 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e9d53-46f9-45f5-bfed-670c6c39a9c8 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:53.233047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1180/2377] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:29:53.235530 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fb6fd-6cd0-450f-831e-6dbed5d85059 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:53.245266 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fb6fd-6cd0-450f-831e-6dbed5d85059 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:53.249933 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54051cb-8a05-4fd0-8af4-de72208b4ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:53.250579 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54051cb-8a05-4fd0-8af4-de72208b4ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:53.250863 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54051cb-8a05-4fd0-8af4-de72208b4ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:53.251140 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54051cb-8a05-4fd0-8af4-de72208b4ed3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:53.251958 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54051cb-8a05-4fd0-8af4-de72208b4ed3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:53.253868 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54051cb-8a05-4fd0-8af4-de72208b4ed3 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:53.346558 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1198/2378] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:29:53 2022] POST /identity/v3/projects => generated 399 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:29:53.353190 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e9d53-46f9-45f5-bfed-670c6c39a9c8 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:53.365027 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e9d53-46f9-45f5-bfed-670c6c39a9c8 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:53.427125 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0116f2-869e-4043-b80e-180b271d6a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:53.427711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0116f2-869e-4043-b80e-180b271d6a97 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:53.427995 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0116f2-869e-4043-b80e-180b271d6a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:53.428272 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0116f2-869e-4043-b80e-180b271d6a97 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:53.428985 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0116f2-869e-4043-b80e-180b271d6a97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:53.430928 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0116f2-869e-4043-b80e-180b271d6a97 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:53.515614 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1181/2379] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:29:53 2022] POST /identity/v3/users => generated 300 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:29:53.520145 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54051cb-8a05-4fd0-8af4-de72208b4ed3 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:53.531559 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54051cb-8a05-4fd0-8af4-de72208b4ed3 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:53.536702 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1891c0e-0a57-47ee-8ac5-2499a619066e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:53.537383 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1891c0e-0a57-47ee-8ac5-2499a619066e admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:53.537719 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1891c0e-0a57-47ee-8ac5-2499a619066e admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:53.538051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1891c0e-0a57-47ee-8ac5-2499a619066e admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:53.538834 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1891c0e-0a57-47ee-8ac5-2499a619066e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:53.540582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1891c0e-0a57-47ee-8ac5-2499a619066e admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:53.559608 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1199/2380] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:29:53.563629 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0116f2-869e-4043-b80e-180b271d6a97 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:53.574380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0116f2-869e-4043-b80e-180b271d6a97 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:53.580199 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e905d-3061-47ac-a999-b3ae79c50920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:53.580913 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e905d-3061-47ac-a999-b3ae79c50920 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:53.581216 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e905d-3061-47ac-a999-b3ae79c50920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:53.581499 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e905d-3061-47ac-a999-b3ae79c50920 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:53.582283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e905d-3061-47ac-a999-b3ae79c50920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:53.583906 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e905d-3061-47ac-a999-b3ae79c50920 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:53.594950 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1182/2381] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:29:53.598886 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1891c0e-0a57-47ee-8ac5-2499a619066e admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:53.609089 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1891c0e-0a57-47ee-8ac5-2499a619066e admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:53.614126 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5d870-0d89-4aa0-aa40-675563bb94c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:53.615043 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5d870-0d89-4aa0-aa40-675563bb94c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:53.615328 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5d870-0d89-4aa0-aa40-675563bb94c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:53.615635 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5d870-0d89-4aa0-aa40-675563bb94c2 admin admin] PATH_INFO: `/v3/projects/8334908977484e92b439634fb3616d96/users/481222c9d8244539974b405b108e93d6/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:53.636777 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5d870-0d89-4aa0-aa40-675563bb94c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8334908977484e92b439634fb3616d96, user_id=481222c9d8244539974b405b108e93d6, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:53.639744 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5d870-0d89-4aa0-aa40-675563bb94c2 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:53.720967 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1200/2382] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:29:53 2022] PUT /identity/v3/projects/8334908977484e92b439634fb3616d96/users/481222c9d8244539974b405b108e93d6/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:29:53.731840 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463aa745-e53f-4599-99a3-9cafccfc28b6 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:53.732131 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463aa745-e53f-4599-99a3-9cafccfc28b6 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:53.732412 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463aa745-e53f-4599-99a3-9cafccfc28b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:53.778000 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-463aa745-e53f-4599-99a3-9cafccfc28b6 None None] MFA Rules not processed for user `481222c9d8244539974b405b108e93d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:29:53.779347 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-463aa745-e53f-4599-99a3-9cafccfc28b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:53.848230 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:29:53.853843 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1183/2383] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:29:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:29:53.865266 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5d870-0d89-4aa0-aa40-675563bb94c2 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:29:53.867002 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-6bc5d870-0d89-4aa0-aa40-675563bb94c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:29:53.903815 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:29:53.929071 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5d870-0d89-4aa0-aa40-675563bb94c2 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:29:53.933881 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f0476-3890-4bac-a6ec-68ddef06d9ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:29:53.934544 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f0476-3890-4bac-a6ec-68ddef06d9ce service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:29:53.934832 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f0476-3890-4bac-a6ec-68ddef06d9ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:29:53.935138 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f0476-3890-4bac-a6ec-68ddef06d9ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:29:53.944142 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f0476-3890-4bac-a6ec-68ddef06d9ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:29:53.945582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f0476-3890-4bac-a6ec-68ddef06d9ce service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:29:53.957191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1201/2384] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:29:53 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:30:02.989807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463aa745-e53f-4599-99a3-9cafccfc28b6 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:30:03.053237 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463aa745-e53f-4599-99a3-9cafccfc28b6 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:30:03.058526 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b97314-ca25-4b3a-ab0c-d0b452836d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:30:03.059406 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b97314-ca25-4b3a-ab0c-d0b452836d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:30:03.059693 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b97314-ca25-4b3a-ab0c-d0b452836d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:30:03.059970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b97314-ca25-4b3a-ab0c-d0b452836d87 admin admin] PATH_INFO: `/v3/users/481222c9d8244539974b405b108e93d6` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:30:03.061174 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b97314-ca25-4b3a-ab0c-d0b452836d87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=481222c9d8244539974b405b108e93d6)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:30:03.063124 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b97314-ca25-4b3a-ab0c-d0b452836d87 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:30:03.236202 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-06b97314-ca25-4b3a-ab0c-d0b452836d87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '481222c9d8244539974b405b108e93d6'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:30:03.236871 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-06b97314-ca25-4b3a-ab0c-d0b452836d87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '481222c9d8244539974b405b108e93d6'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:30:03.243878 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-06b97314-ca25-4b3a-ab0c-d0b452836d87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '481222c9d8244539974b405b108e93d6'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:30:03.319433 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-06b97314-ca25-4b3a-ab0c-d0b452836d87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '481222c9d8244539974b405b108e93d6'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:30:03.332155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-06b97314-ca25-4b3a-ab0c-d0b452836d87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '481222c9d8244539974b405b108e93d6'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:30:03.338165 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1184/2385] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:30:02 2022] DELETE /identity/v3/users/481222c9d8244539974b405b108e93d6 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:30:03.343007 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a32700-abe7-4191-97ed-c2debb765208 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:30:03.343537 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a32700-abe7-4191-97ed-c2debb765208 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:30:03.343641 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a32700-abe7-4191-97ed-c2debb765208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:30:03.361216 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-79a32700-abe7-4191-97ed-c2debb765208 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:30:03.362452 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-79a32700-abe7-4191-97ed-c2debb765208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:30:03.423932 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1202/2386] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:30:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:30:03.433852 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b97314-ca25-4b3a-ab0c-d0b452836d87 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:30:03.435260 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-06b97314-ca25-4b3a-ab0c-d0b452836d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:30:03.492737 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b97314-ca25-4b3a-ab0c-d0b452836d87 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:30:03.497194 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f100c8e-901c-45f4-bad3-0a42a43133b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:30:03.497912 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f100c8e-901c-45f4-bad3-0a42a43133b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:30:03.498197 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f100c8e-901c-45f4-bad3-0a42a43133b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:30:03.498533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f100c8e-901c-45f4-bad3-0a42a43133b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:30:03.509195 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f100c8e-901c-45f4-bad3-0a42a43133b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:30:03.510892 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f100c8e-901c-45f4-bad3-0a42a43133b7 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:30:03.521663 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1185/2387] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:30:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:30:03.965114 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a32700-abe7-4191-97ed-c2debb765208 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:30:03.966597 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-79a32700-abe7-4191-97ed-c2debb765208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:30:03.980423 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a32700-abe7-4191-97ed-c2debb765208 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:30:03.985165 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b494ff-a99a-48bb-a69e-92536c7f4c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:30:03.986118 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b494ff-a99a-48bb-a69e-92536c7f4c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:30:03.986525 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b494ff-a99a-48bb-a69e-92536c7f4c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:30:03.987237 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b494ff-a99a-48bb-a69e-92536c7f4c6d admin admin] PATH_INFO: `/v3/projects/8334908977484e92b439634fb3616d96` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:30:03.988891 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b494ff-a99a-48bb-a69e-92536c7f4c6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8334908977484e92b439634fb3616d96)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:30:03.990827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b494ff-a99a-48bb-a69e-92536c7f4c6d admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:30:04.100349 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e8b494ff-a99a-48bb-a69e-92536c7f4c6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8334908977484e92b439634fb3616d96', 'request_id': 'req-e8b494ff-a99a-48bb-a69e-92536c7f4c6d'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:30:04.182661 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e8b494ff-a99a-48bb-a69e-92536c7f4c6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8334908977484e92b439634fb3616d96', 'request_id': 'req-e8b494ff-a99a-48bb-a69e-92536c7f4c6d'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:30:04.189569 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e8b494ff-a99a-48bb-a69e-92536c7f4c6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8334908977484e92b439634fb3616d96', 'request_id': 'req-e8b494ff-a99a-48bb-a69e-92536c7f4c6d'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:30:04.201506 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e8b494ff-a99a-48bb-a69e-92536c7f4c6d admin admin] The token cache is being invalidate because project 8334908977484e92b439634fb3616d96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:30:04.201819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e8b494ff-a99a-48bb-a69e-92536c7f4c6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:30:04.202492 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e8b494ff-a99a-48bb-a69e-92536c7f4c6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:30:04.204040 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1203/2388] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:30:03 2022] DELETE /identity/v3/projects/8334908977484e92b439634fb3616d96 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:30:11.881862 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ebb75-a1e7-43e0-9f0e-e3bb1a04280f None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:30:11.882428 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ebb75-a1e7-43e0-9f0e-e3bb1a04280f None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:30:11.882428 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ebb75-a1e7-43e0-9f0e-e3bb1a04280f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:30:11.901007 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-855ebb75-a1e7-43e0-9f0e-e3bb1a04280f None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:30:11.903054 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-855ebb75-a1e7-43e0-9f0e-e3bb1a04280f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:30:11.916853 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:30:11.965695 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1186/2389] 10.222.0.47 () {58 vars in 1016 bytes} [Mon Jul 11 11:30:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:30:11.985187 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b494ff-a99a-48bb-a69e-92536c7f4c6d admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:30:11.986610 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-e8b494ff-a99a-48bb-a69e-92536c7f4c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:30:12.046766 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:30:12.065745 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b494ff-a99a-48bb-a69e-92536c7f4c6d admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:30:12.071288 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6559b9-587a-4076-b3bd-e70b33c360a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:30:12.072053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6559b9-587a-4076-b3bd-e70b33c360a6 service nova] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:30:12.072341 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6559b9-587a-4076-b3bd-e70b33c360a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:30:12.072617 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6559b9-587a-4076-b3bd-e70b33c360a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:30:12.081379 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6559b9-587a-4076-b3bd-e70b33c360a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:30:12.083201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6559b9-587a-4076-b3bd-e70b33c360a6 service nova] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:30:12.094389 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1204/2390] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:30:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:30:14.857627 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027409f-fcdf-42ff-ae59-729fd8c1902c None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:30:14.858283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027409f-fcdf-42ff-ae59-729fd8c1902c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:30:14.858465 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027409f-fcdf-42ff-ae59-729fd8c1902c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:30:14.877379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-a027409f-fcdf-42ff-ae59-729fd8c1902c None None] MFA Rules not processed for user `cdfa8f4012c2471b81f8749b013d3117`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:30:14.879166 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a027409f-fcdf-42ff-ae59-729fd8c1902c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:30:14.935386 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1187/2391] 10.222.0.23 () {58 vars in 967 bytes} [Mon Jul 11 11:30:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:30:14.947354 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6559b9-587a-4076-b3bd-e70b33c360a6 service nova] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:30:14.948818 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-0a6559b9-587a-4076-b3bd-e70b33c360a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:30:15.019703 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6559b9-587a-4076-b3bd-e70b33c360a6 service nova] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:30:15.024797 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6f1b1-90e4-4aaf-adb6-64eeb0126db4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736f6d4d1dbb47ff98bc67e53614d49c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:30:15.025447 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6f1b1-90e4-4aaf-adb6-64eeb0126db4 service swift] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:30:15.025739 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6f1b1-90e4-4aaf-adb6-64eeb0126db4 service swift] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:30:15.026056 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6f1b1-90e4-4aaf-adb6-64eeb0126db4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:30:15.034878 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6f1b1-90e4-4aaf-adb6-64eeb0126db4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:30:15.036451 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6f1b1-90e4-4aaf-adb6-64eeb0126db4 service swift] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:30:15.045067 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1205/2392] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jul 11 11:30:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 11:30:17.287045 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd20da-3ae8-4f5e-b167-5e9a9e570920 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:30:17.287558 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd20da-3ae8-4f5e-b167-5e9a9e570920 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:30:17.287652 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd20da-3ae8-4f5e-b167-5e9a9e570920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:30:17.305835 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-0afd20da-3ae8-4f5e-b167-5e9a9e570920 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:30:17.307100 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-0afd20da-3ae8-4f5e-b167-5e9a9e570920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:30:17.315603 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1188/2393] 10.222.0.47 () {58 vars in 1016 bytes} [Mon Jul 11 11:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:30:17.346298 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6f1b1-90e4-4aaf-adb6-64eeb0126db4 service swift] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:30:17.358753 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6f1b1-90e4-4aaf-adb6-64eeb0126db4 service swift] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:30:17.364065 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c90ec8-8579-4130-be39-badcabbb18ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:30:17.364697 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c90ec8-8579-4130-be39-badcabbb18ce service nova] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:30:17.364979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c90ec8-8579-4130-be39-badcabbb18ce service nova] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:30:17.365259 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c90ec8-8579-4130-be39-badcabbb18ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:30:17.374060 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c90ec8-8579-4130-be39-badcabbb18ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:30:17.375676 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c90ec8-8579-4130-be39-badcabbb18ce service nova] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:30:17.385128 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1206/2394] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:30:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:30:21.227593 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729bc2b-a6f3-4d7a-9bb9-bb99db99b8b9 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:30:21.228102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729bc2b-a6f3-4d7a-9bb9-bb99db99b8b9 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:30:21.228198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729bc2b-a6f3-4d7a-9bb9-bb99db99b8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:30:21.246447 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-2729bc2b-a6f3-4d7a-9bb9-bb99db99b8b9 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:30:21.247663 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2729bc2b-a6f3-4d7a-9bb9-bb99db99b8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:30:21.255953 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1189/2395] 10.222.0.47 () {58 vars in 1016 bytes} [Mon Jul 11 11:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:30:21.275331 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c90ec8-8579-4130-be39-badcabbb18ce service nova] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:30:21.292865 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c90ec8-8579-4130-be39-badcabbb18ce service nova] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:30:21.302200 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d63572-503a-4e3b-a200-d36a7b3b3cfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:30:21.302870 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d63572-503a-4e3b-a200-d36a7b3b3cfb service nova] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:30:21.303158 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d63572-503a-4e3b-a200-d36a7b3b3cfb service nova] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:30:21.303442 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d63572-503a-4e3b-a200-d36a7b3b3cfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:30:21.312852 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d63572-503a-4e3b-a200-d36a7b3b3cfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:30:21.314488 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d63572-503a-4e3b-a200-d36a7b3b3cfb service nova] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:30:21.324889 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1207/2396] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:30:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:30:25.501041 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f8d7a-0406-47a6-82dc-8851a7b8fe81 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:30:25.501530 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f8d7a-0406-47a6-82dc-8851a7b8fe81 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:30:25.501655 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f8d7a-0406-47a6-82dc-8851a7b8fe81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:30:25.519733 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-273f8d7a-0406-47a6-82dc-8851a7b8fe81 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:30:25.520920 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-273f8d7a-0406-47a6-82dc-8851a7b8fe81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:30:25.528625 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1190/2397] 10.222.0.47 () {58 vars in 1016 bytes} [Mon Jul 11 11:30:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:30:25.550947 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d63572-503a-4e3b-a200-d36a7b3b3cfb service nova] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:30:25.562541 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d63572-503a-4e3b-a200-d36a7b3b3cfb service nova] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:30:25.567864 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad079bf-e7bb-4441-bb93-a15e1a098ba4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:30:25.568504 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad079bf-e7bb-4441-bb93-a15e1a098ba4 service nova] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:30:25.568786 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad079bf-e7bb-4441-bb93-a15e1a098ba4 service nova] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:30:25.569062 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad079bf-e7bb-4441-bb93-a15e1a098ba4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:30:25.577364 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad079bf-e7bb-4441-bb93-a15e1a098ba4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:30:25.579033 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad079bf-e7bb-4441-bb93-a15e1a098ba4 service nova] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:30:25.588365 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1208/2398] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:30:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:30:29.820433 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4463e-2926-4739-8ee3-4fdc7e1048ab None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:30:29.821133 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4463e-2926-4739-8ee3-4fdc7e1048ab None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:30:29.821421 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4463e-2926-4739-8ee3-4fdc7e1048ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:30:29.841475 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-0be4463e-2926-4739-8ee3-4fdc7e1048ab None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:30:29.842787 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-0be4463e-2926-4739-8ee3-4fdc7e1048ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:30:29.851658 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1191/2399] 10.222.0.47 () {58 vars in 1016 bytes} [Mon Jul 11 11:30:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:30:29.875704 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad079bf-e7bb-4441-bb93-a15e1a098ba4 service nova] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:30:29.886615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad079bf-e7bb-4441-bb93-a15e1a098ba4 service nova] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:30:29.893730 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a532a-9831-496a-b5ae-6a7867b53527 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:30:29.894606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a532a-9831-496a-b5ae-6a7867b53527 service nova] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:30:29.895065 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a532a-9831-496a-b5ae-6a7867b53527 service nova] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:30:29.895348 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a532a-9831-496a-b5ae-6a7867b53527 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:30:29.905135 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a532a-9831-496a-b5ae-6a7867b53527 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:30:29.906880 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a532a-9831-496a-b5ae-6a7867b53527 service nova] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:30:29.917579 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1209/2400] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:30:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:30:39.835955 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=55 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:30:39.912841 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=64 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:30:45.191628 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81632296-129b-4f80-8584-a58c414ffbcc None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:30:45.192346 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81632296-129b-4f80-8584-a58c414ffbcc None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:30:45.192645 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81632296-129b-4f80-8584-a58c414ffbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:30:45.211511 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-81632296-129b-4f80-8584-a58c414ffbcc None None] MFA Rules not processed for user `62bacc0d6a2342deac533c4de67041b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:30:45.212797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-81632296-129b-4f80-8584-a58c414ffbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:30:45.271248 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1192/2401] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:30:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:30:55.263790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=25 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:31:08.720118 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a532a-9831-496a-b5ae-6a7867b53527 service nova] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:31:08.721584 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-bb3a532a-9831-496a-b5ae-6a7867b53527 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:31:08.735395 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a532a-9831-496a-b5ae-6a7867b53527 service nova] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:31:08.739946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997d60f-b050-470c-8754-9b768e3470ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:31:08.740824 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997d60f-b050-470c-8754-9b768e3470ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:08.741087 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997d60f-b050-470c-8754-9b768e3470ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:08.741367 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997d60f-b050-470c-8754-9b768e3470ae admin admin] PATH_INFO: `/v3/users/58581f894dbd470a97bd92580323ac56` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:08.742683 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997d60f-b050-470c-8754-9b768e3470ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=58581f894dbd470a97bd92580323ac56)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:31:08.744662 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997d60f-b050-470c-8754-9b768e3470ae admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:31:08.915187 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e997d60f-b050-470c-8754-9b768e3470ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58581f894dbd470a97bd92580323ac56'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:31:08.981516 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e997d60f-b050-470c-8754-9b768e3470ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58581f894dbd470a97bd92580323ac56'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:31:08.989232 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e997d60f-b050-470c-8754-9b768e3470ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58581f894dbd470a97bd92580323ac56'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:31:08.989908 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e997d60f-b050-470c-8754-9b768e3470ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58581f894dbd470a97bd92580323ac56'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:31:08.990614 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e997d60f-b050-470c-8754-9b768e3470ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58581f894dbd470a97bd92580323ac56'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:31:09.008191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1210/2402] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:31:08 2022] DELETE /identity/v3/users/58581f894dbd470a97bd92580323ac56 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:31:09.277603 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81632296-129b-4f80-8584-a58c414ffbcc None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:31:09.284919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81632296-129b-4f80-8584-a58c414ffbcc None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:31:09.347058 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecb3b9-fc90-4661-aa63-4f39d3b8fd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:31:09.347927 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecb3b9-fc90-4661-aa63-4f39d3b8fd3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:09.348215 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecb3b9-fc90-4661-aa63-4f39d3b8fd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:09.348516 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecb3b9-fc90-4661-aa63-4f39d3b8fd3e admin admin] PATH_INFO: `/v3/projects/312d1dffbc63477f9c3d743d08e19ff9` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:09.349678 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eecb3b9-fc90-4661-aa63-4f39d3b8fd3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=312d1dffbc63477f9c3d743d08e19ff9)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:31:09.351613 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eecb3b9-fc90-4661-aa63-4f39d3b8fd3e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:31:09.478546 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4eecb3b9-fc90-4661-aa63-4f39d3b8fd3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '312d1dffbc63477f9c3d743d08e19ff9', 'request_id': 'req-4eecb3b9-fc90-4661-aa63-4f39d3b8fd3e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:31:09.483932 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4eecb3b9-fc90-4661-aa63-4f39d3b8fd3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '312d1dffbc63477f9c3d743d08e19ff9', 'request_id': 'req-4eecb3b9-fc90-4661-aa63-4f39d3b8fd3e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:31:09.564783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4eecb3b9-fc90-4661-aa63-4f39d3b8fd3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '312d1dffbc63477f9c3d743d08e19ff9', 'request_id': 'req-4eecb3b9-fc90-4661-aa63-4f39d3b8fd3e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:31:09.576099 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4eecb3b9-fc90-4661-aa63-4f39d3b8fd3e admin admin] The token cache is being invalidate because project 312d1dffbc63477f9c3d743d08e19ff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:31:09.581047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4eecb3b9-fc90-4661-aa63-4f39d3b8fd3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:31:09.581047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4eecb3b9-fc90-4661-aa63-4f39d3b8fd3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:31:09.581047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1193/2403] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:31:09 2022] DELETE /identity/v3/projects/312d1dffbc63477f9c3d743d08e19ff9 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:31:09.583933 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f2f2c-15ab-4e51-9b4a-766184f5c9ad None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:09.584230 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f2f2c-15ab-4e51-9b4a-766184f5c9ad None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:09.584511 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f2f2c-15ab-4e51-9b4a-766184f5c9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:09.602609 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-9a9f2f2c-15ab-4e51-9b4a-766184f5c9ad None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:31:09.604439 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-9a9f2f2c-15ab-4e51-9b4a-766184f5c9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:31:09.661486 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1211/2404] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:31:09.669845 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a81ad-2313-4258-b2a8-ef8b6838cfae None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:09.670143 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a81ad-2313-4258-b2a8-ef8b6838cfae None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:09.670429 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a81ad-2313-4258-b2a8-ef8b6838cfae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:09.692626 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-754a81ad-2313-4258-b2a8-ef8b6838cfae None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:31:09.693866 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-754a81ad-2313-4258-b2a8-ef8b6838cfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:31:09.701981 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1194/2405] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:31:09.706274 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f2f2c-15ab-4e51-9b4a-766184f5c9ad None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:31:09.716077 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f2f2c-15ab-4e51-9b4a-766184f5c9ad None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:31:09.720656 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14857ea8-3fcd-4dd5-beaa-3c4a9d83661c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:31:09.721301 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14857ea8-3fcd-4dd5-beaa-3c4a9d83661c admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:09.721582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14857ea8-3fcd-4dd5-beaa-3c4a9d83661c admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:09.721888 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14857ea8-3fcd-4dd5-beaa-3c4a9d83661c admin admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:09.722633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14857ea8-3fcd-4dd5-beaa-3c4a9d83661c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:31:09.722942 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14857ea8-3fcd-4dd5-beaa-3c4a9d83661c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:31:09.724558 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14857ea8-3fcd-4dd5-beaa-3c4a9d83661c admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:31:09.736501 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1212/2406] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:31:09.740624 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a81ad-2313-4258-b2a8-ef8b6838cfae None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:31:09.750565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a81ad-2313-4258-b2a8-ef8b6838cfae None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:31:09.755401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f105d83-29e1-4968-a146-3834eab70cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:31:09.756065 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f105d83-29e1-4968-a146-3834eab70cfb admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:09.756351 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f105d83-29e1-4968-a146-3834eab70cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:09.756632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f105d83-29e1-4968-a146-3834eab70cfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:09.757333 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f105d83-29e1-4968-a146-3834eab70cfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:31:09.759352 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f105d83-29e1-4968-a146-3834eab70cfb admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:31:09.876020 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1195/2407] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:31:09 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:31:09.879867 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14857ea8-3fcd-4dd5-beaa-3c4a9d83661c admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:31:09.889970 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14857ea8-3fcd-4dd5-beaa-3c4a9d83661c admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:31:09.945559 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a3f7a-adbf-471c-b389-1ba6fddbaed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:31:09.948088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a3f7a-adbf-471c-b389-1ba6fddbaed4 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:09.948088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a3f7a-adbf-471c-b389-1ba6fddbaed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:09.948088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a3f7a-adbf-471c-b389-1ba6fddbaed4 admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:09.948088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a3f7a-adbf-471c-b389-1ba6fddbaed4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:31:09.949637 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a3f7a-adbf-471c-b389-1ba6fddbaed4 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:31:09.956396 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:31:10.033069 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1213/2408] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:31:09 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:31:10.037170 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f105d83-29e1-4968-a146-3834eab70cfb admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:31:10.047969 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f105d83-29e1-4968-a146-3834eab70cfb admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:31:10.052570 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140d4f6-82cb-4308-bb30-b48e47d5a023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:31:10.053229 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140d4f6-82cb-4308-bb30-b48e47d5a023 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:10.053623 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140d4f6-82cb-4308-bb30-b48e47d5a023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:10.053848 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140d4f6-82cb-4308-bb30-b48e47d5a023 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:10.054620 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140d4f6-82cb-4308-bb30-b48e47d5a023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:31:10.056111 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140d4f6-82cb-4308-bb30-b48e47d5a023 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:31:10.067533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1196/2409] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:31:10.074750 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a3f7a-adbf-471c-b389-1ba6fddbaed4 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:31:10.085199 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a3f7a-adbf-471c-b389-1ba6fddbaed4 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:31:10.091109 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2903b-8edf-4e2c-b2ad-57d003b042ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:31:10.091793 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2903b-8edf-4e2c-b2ad-57d003b042ec admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:10.092075 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2903b-8edf-4e2c-b2ad-57d003b042ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:10.092353 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2903b-8edf-4e2c-b2ad-57d003b042ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:10.093092 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2903b-8edf-4e2c-b2ad-57d003b042ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:31:10.094709 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2903b-8edf-4e2c-b2ad-57d003b042ec admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:31:10.105229 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1214/2410] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:31:10.109129 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140d4f6-82cb-4308-bb30-b48e47d5a023 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:31:10.118743 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140d4f6-82cb-4308-bb30-b48e47d5a023 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:31:10.123366 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb4502-baa9-45eb-8cca-fac5fddb5d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:31:10.124229 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb4502-baa9-45eb-8cca-fac5fddb5d81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:10.124514 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb4502-baa9-45eb-8cca-fac5fddb5d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:10.124792 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb4502-baa9-45eb-8cca-fac5fddb5d81 admin admin] PATH_INFO: `/v3/projects/9a5c64177ca546e8985cbbfecd408121/users/d5a7b7df457444809d09cd54a948f8cf/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:10.138826 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb4502-baa9-45eb-8cca-fac5fddb5d81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a5c64177ca546e8985cbbfecd408121, user_id=d5a7b7df457444809d09cd54a948f8cf, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:31:10.141386 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb4502-baa9-45eb-8cca-fac5fddb5d81 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:31:10.250787 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1197/2411] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:31:10 2022] PUT /identity/v3/projects/9a5c64177ca546e8985cbbfecd408121/users/d5a7b7df457444809d09cd54a948f8cf/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:31:10.261481 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207edf8-9733-4fcd-93a8-0d9f4883c654 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:10.261794 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207edf8-9733-4fcd-93a8-0d9f4883c654 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:10.262114 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207edf8-9733-4fcd-93a8-0d9f4883c654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:10.282106 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-9207edf8-9733-4fcd-93a8-0d9f4883c654 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:31:10.283295 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-9207edf8-9733-4fcd-93a8-0d9f4883c654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:31:10.342083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1215/2412] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:31:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:31:10.351544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb4502-baa9-45eb-8cca-fac5fddb5d81 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:31:10.353338 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2dbb4502-baa9-45eb-8cca-fac5fddb5d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:31:10.383575 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:31:10.409878 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb4502-baa9-45eb-8cca-fac5fddb5d81 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:31:10.413339 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619e131-48b5-40d9-bb8c-5741695f36c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:31:10.414014 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619e131-48b5-40d9-bb8c-5741695f36c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:10.414301 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619e131-48b5-40d9-bb8c-5741695f36c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:10.414579 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619e131-48b5-40d9-bb8c-5741695f36c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:10.423560 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9619e131-48b5-40d9-bb8c-5741695f36c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:31:10.424966 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9619e131-48b5-40d9-bb8c-5741695f36c9 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:31:10.434808 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1198/2413] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:31:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:31:15.661675 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc81fbb-331d-4cbd-ad0e-c6b95aac2c16 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:15.662173 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc81fbb-331d-4cbd-ad0e-c6b95aac2c16 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:15.662286 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc81fbb-331d-4cbd-ad0e-c6b95aac2c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:15.698032 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-acc81fbb-331d-4cbd-ad0e-c6b95aac2c16 None None] MFA Rules not processed for user `d5a7b7df457444809d09cd54a948f8cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:31:15.699382 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-acc81fbb-331d-4cbd-ad0e-c6b95aac2c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:31:15.769712 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1216/2414] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:31:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:31:15.773830 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619e131-48b5-40d9-bb8c-5741695f36c9 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:31:15.785010 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619e131-48b5-40d9-bb8c-5741695f36c9 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:31:15.789819 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8583c3-67d6-4d2d-a33c-b493d39e5e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:31:15.790550 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8583c3-67d6-4d2d-a33c-b493d39e5e9f admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:15.790897 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8583c3-67d6-4d2d-a33c-b493d39e5e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:15.791387 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8583c3-67d6-4d2d-a33c-b493d39e5e9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:15.792223 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8583c3-67d6-4d2d-a33c-b493d39e5e9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:31:15.794189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8583c3-67d6-4d2d-a33c-b493d39e5e9f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:31:15.879744 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1199/2415] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:31:15 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:31:15.883942 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc81fbb-331d-4cbd-ad0e-c6b95aac2c16 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:31:15.896254 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc81fbb-331d-4cbd-ad0e-c6b95aac2c16 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:31:15.959965 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8583c3-67d6-4d2d-a33c-b493d39e5e9f admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:31:15.961914 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-0a8583c3-67d6-4d2d-a33c-b493d39e5e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:31:15.965278 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd82ba-74f0-491d-bac6-53dcb6417c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:31:15.966007 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd82ba-74f0-491d-bac6-53dcb6417c69 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:15.966299 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd82ba-74f0-491d-bac6-53dcb6417c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:15.966572 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd82ba-74f0-491d-bac6-53dcb6417c69 admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:15.967589 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd82ba-74f0-491d-bac6-53dcb6417c69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:31:15.977783 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd82ba-74f0-491d-bac6-53dcb6417c69 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:31:16.041269 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8583c3-67d6-4d2d-a33c-b493d39e5e9f admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:31:16.047207 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddde86f-7854-4e86-a6e1-d4b2ccc2ca5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:31:16.047873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddde86f-7854-4e86-a6e1-d4b2ccc2ca5d service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:16.048159 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddde86f-7854-4e86-a6e1-d4b2ccc2ca5d service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:16.048497 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddde86f-7854-4e86-a6e1-d4b2ccc2ca5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:16.050661 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-cddde86f-7854-4e86-a6e1-d4b2ccc2ca5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:31:16.108606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:31:16.113452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddde86f-7854-4e86-a6e1-d4b2ccc2ca5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:31:16.118706 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1217/2416] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:31:15 2022] POST /identity/v3/users => generated 298 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:31:16.119364 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddde86f-7854-4e86-a6e1-d4b2ccc2ca5d service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:31:16.120756 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd82ba-74f0-491d-bac6-53dcb6417c69 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:31:16.129959 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1200/2417] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:31:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:31:16.131505 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd82ba-74f0-491d-bac6-53dcb6417c69 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:31:16.137524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc80aa-7be6-4702-8165-2ae60426c69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:31:16.138271 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc80aa-7be6-4702-8165-2ae60426c69b admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:16.138560 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc80aa-7be6-4702-8165-2ae60426c69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:16.138846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc80aa-7be6-4702-8165-2ae60426c69b admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:16.139593 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc80aa-7be6-4702-8165-2ae60426c69b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:31:16.141222 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc80aa-7be6-4702-8165-2ae60426c69b admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:31:16.153810 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1218/2418] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:31:16.156658 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddde86f-7854-4e86-a6e1-d4b2ccc2ca5d service nova] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:31:16.167793 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddde86f-7854-4e86-a6e1-d4b2ccc2ca5d service nova] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:31:16.172791 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac4762-e0a0-4695-84d6-f217f3560223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:31:16.173841 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac4762-e0a0-4695-84d6-f217f3560223 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:16.174198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac4762-e0a0-4695-84d6-f217f3560223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:16.174546 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac4762-e0a0-4695-84d6-f217f3560223 admin admin] PATH_INFO: `/v3/projects/12695cadc77d40fe9cdff67d46aa9ffa/users/1eea092731e043ceb1468a89409ca3fd/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:16.191406 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac4762-e0a0-4695-84d6-f217f3560223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12695cadc77d40fe9cdff67d46aa9ffa, user_id=1eea092731e043ceb1468a89409ca3fd, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:31:16.194174 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac4762-e0a0-4695-84d6-f217f3560223 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:31:16.293084 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc80aa-7be6-4702-8165-2ae60426c69b admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:31:16.294986 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-5fcc80aa-7be6-4702-8165-2ae60426c69b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:31:16.301880 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1201/2419] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:31:16 2022] PUT /identity/v3/projects/12695cadc77d40fe9cdff67d46aa9ffa/users/1eea092731e043ceb1468a89409ca3fd/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:31:16.303004 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac4762-e0a0-4695-84d6-f217f3560223 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:31:16.334875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:31:16.367867 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc80aa-7be6-4702-8165-2ae60426c69b admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:31:16.380029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac4762-e0a0-4695-84d6-f217f3560223 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:31:16.384887 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649d95a-237a-4181-b720-27120bdc7adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:31:16.385783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649d95a-237a-4181-b720-27120bdc7adf admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:16.386090 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649d95a-237a-4181-b720-27120bdc7adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:16.386373 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649d95a-237a-4181-b720-27120bdc7adf admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:16.387112 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7649d95a-237a-4181-b720-27120bdc7adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:31:16.388719 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7649d95a-237a-4181-b720-27120bdc7adf admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:31:16.401859 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1202/2420] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:31:16.403762 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649d95a-237a-4181-b720-27120bdc7adf admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:31:16.414597 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649d95a-237a-4181-b720-27120bdc7adf admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:31:16.420081 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba098ac-e559-4551-be02-b35c553e662a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:31:16.420746 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322da1eb-3157-4cf0-8cc7-6765142f257f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:31:16.420915 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba098ac-e559-4551-be02-b35c553e662a service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:16.421017 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba098ac-e559-4551-be02-b35c553e662a service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:16.421295 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba098ac-e559-4551-be02-b35c553e662a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:16.421920 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322da1eb-3157-4cf0-8cc7-6765142f257f admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:16.422290 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322da1eb-3157-4cf0-8cc7-6765142f257f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:16.422624 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322da1eb-3157-4cf0-8cc7-6765142f257f admin admin] PATH_INFO: `/v3/projects/12695cadc77d40fe9cdff67d46aa9ffa/users/1eea092731e043ceb1468a89409ca3fd/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:16.423201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-bba098ac-e559-4551-be02-b35c553e662a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:31:16.424954 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322da1eb-3157-4cf0-8cc7-6765142f257f admin admin] RBAC: Authorizing `identity:create_grant(project_id=12695cadc77d40fe9cdff67d46aa9ffa, user_id=1eea092731e043ceb1468a89409ca3fd, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:31:16.427810 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322da1eb-3157-4cf0-8cc7-6765142f257f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:31:16.439198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1203/2421] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:31:16 2022] PUT /identity/v3/projects/12695cadc77d40fe9cdff67d46aa9ffa/users/1eea092731e043ceb1468a89409ca3fd/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:31:16.499145 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba098ac-e559-4551-be02-b35c553e662a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:31:16.500587 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba098ac-e559-4551-be02-b35c553e662a service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:31:16.511753 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1219/2422] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:31:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:31:19.639901 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322da1eb-3157-4cf0-8cc7-6765142f257f admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:31:19.727964 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322da1eb-3157-4cf0-8cc7-6765142f257f admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:31:19.736954 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f99096-a973-4266-a309-85fa271bfdc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:31:19.737642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f99096-a973-4266-a309-85fa271bfdc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:19.737986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f99096-a973-4266-a309-85fa271bfdc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:19.738273 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f99096-a973-4266-a309-85fa271bfdc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:19.740225 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-75f99096-a973-4266-a309-85fa271bfdc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:31:19.839352 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f99096-a973-4266-a309-85fa271bfdc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:31:19.839352 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f99096-a973-4266-a309-85fa271bfdc4 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:31:19.847144 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1204/2423] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:31:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:31:22.638695 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1683a44-a4f9-4f76-85a3-630c06cb3b7e None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:22.639252 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1683a44-a4f9-4f76-85a3-630c06cb3b7e None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:22.639252 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1683a44-a4f9-4f76-85a3-630c06cb3b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:22.676221 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-d1683a44-a4f9-4f76-85a3-630c06cb3b7e None None] MFA Rules not processed for user `1eea092731e043ceb1468a89409ca3fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:31:22.677734 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-d1683a44-a4f9-4f76-85a3-630c06cb3b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:31:22.741333 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:31:22.812490 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1220/2424] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:31:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:31:22.820224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f99096-a973-4266-a309-85fa271bfdc4 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:31:22.821801 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-75f99096-a973-4266-a309-85fa271bfdc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:31:22.883595 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:31:22.895897 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f99096-a973-4266-a309-85fa271bfdc4 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:31:22.901409 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c272d-eb47-4fa6-b26f-3d64d01e8f2c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a2d8d24562459493a3bcd399665a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:31:22.902227 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c272d-eb47-4fa6-b26f-3d64d01e8f2c service glance] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:22.902513 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c272d-eb47-4fa6-b26f-3d64d01e8f2c service glance] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:22.902794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c272d-eb47-4fa6-b26f-3d64d01e8f2c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:22.973186 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c272d-eb47-4fa6-b26f-3d64d01e8f2c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:31:22.974827 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c272d-eb47-4fa6-b26f-3d64d01e8f2c service glance] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:31:22.989129 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1205/2425] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:31:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:31:23.294389 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00492ef8-b54b-415e-a85c-0e822a2f1d2c None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:23.294994 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00492ef8-b54b-415e-a85c-0e822a2f1d2c None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:23.295290 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00492ef8-b54b-415e-a85c-0e822a2f1d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:23.315046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-00492ef8-b54b-415e-a85c-0e822a2f1d2c None None] MFA Rules not processed for user `cdfa8f4012c2471b81f8749b013d3117`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:31:23.316664 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-00492ef8-b54b-415e-a85c-0e822a2f1d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:31:23.378104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1221/2426] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Jul 11 11:31:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:31:23.584085 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c272d-eb47-4fa6-b26f-3d64d01e8f2c service glance] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:31:23.585565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3c0c272d-eb47-4fa6-b26f-3d64d01e8f2c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:31:23.682529 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c272d-eb47-4fa6-b26f-3d64d01e8f2c service glance] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:31:23.688760 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3c123-1548-4741-99aa-46a8abe4ebe7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736f6d4d1dbb47ff98bc67e53614d49c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:31:23.689373 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3c123-1548-4741-99aa-46a8abe4ebe7 service swift] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:23.689711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3c123-1548-4741-99aa-46a8abe4ebe7 service swift] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:23.690040 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3c123-1548-4741-99aa-46a8abe4ebe7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:23.701543 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3c123-1548-4741-99aa-46a8abe4ebe7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:31:23.705902 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3c123-1548-4741-99aa-46a8abe4ebe7 service swift] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:31:23.726751 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1206/2427] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jul 11 11:31:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 11:31:29.361611 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a61033-459f-452d-b16a-891287e7a52e None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:29.362161 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a61033-459f-452d-b16a-891287e7a52e None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:29.362797 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a61033-459f-452d-b16a-891287e7a52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:29.384178 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-70a61033-459f-452d-b16a-891287e7a52e None None] MFA Rules not processed for user `0cbaec8b28f9449dab0d5175c8034f50`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:31:29.385470 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-70a61033-459f-452d-b16a-891287e7a52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:31:29.453247 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1222/2428] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:31:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:31:29.803869 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3c123-1548-4741-99aa-46a8abe4ebe7 service swift] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:31:29.814391 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3c123-1548-4741-99aa-46a8abe4ebe7 service swift] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:31:29.819245 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba420f-b2f2-4aab-b5dc-1e2c63996f4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:31:29.819913 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba420f-b2f2-4aab-b5dc-1e2c63996f4d service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:29.820243 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba420f-b2f2-4aab-b5dc-1e2c63996f4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:29.820571 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba420f-b2f2-4aab-b5dc-1e2c63996f4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:29.822807 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-44ba420f-b2f2-4aab-b5dc-1e2c63996f4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:31:29.833396 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba420f-b2f2-4aab-b5dc-1e2c63996f4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:31:29.836890 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba420f-b2f2-4aab-b5dc-1e2c63996f4d service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:31:29.845795 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1207/2429] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:31:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:31:30.310762 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a61033-459f-452d-b16a-891287e7a52e None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:31:30.312283 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-70a61033-459f-452d-b16a-891287e7a52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:31:30.400550 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a61033-459f-452d-b16a-891287e7a52e None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:31:30.405809 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683cba3a-eadf-4865-a966-af426f050957 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b7c9264495433985185332778dbc8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:31:30.406468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cba3a-eadf-4865-a966-af426f050957 service placement] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:30.406762 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cba3a-eadf-4865-a966-af426f050957 service placement] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:30.407150 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cba3a-eadf-4865-a966-af426f050957 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:30.408821 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-683cba3a-eadf-4865-a966-af426f050957 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:31:30.421571 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683cba3a-eadf-4865-a966-af426f050957 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:31:30.423197 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683cba3a-eadf-4865-a966-af426f050957 service placement] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:31:30.434387 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1223/2430] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:31:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:31:34.364496 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba420f-b2f2-4aab-b5dc-1e2c63996f4d service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:31:34.374559 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba420f-b2f2-4aab-b5dc-1e2c63996f4d service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:31:34.378601 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de4f59-ef8b-416b-9b38-9e631f85fde9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:31:34.379590 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de4f59-ef8b-416b-9b38-9e631f85fde9 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:34.379886 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de4f59-ef8b-416b-9b38-9e631f85fde9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:34.380232 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de4f59-ef8b-416b-9b38-9e631f85fde9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:34.382216 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-99de4f59-ef8b-416b-9b38-9e631f85fde9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:31:34.394566 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de4f59-ef8b-416b-9b38-9e631f85fde9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:31:34.396079 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de4f59-ef8b-416b-9b38-9e631f85fde9 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:31:34.408002 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1208/2431] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:31:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:31:35.282298 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61d655-c3f3-447a-a4be-908daa33f473 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:35.282738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61d655-c3f3-447a-a4be-908daa33f473 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:35.282826 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61d655-c3f3-447a-a4be-908daa33f473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:35.296339 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de4f59-ef8b-416b-9b38-9e631f85fde9 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:31:35.298579 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-99de4f59-ef8b-416b-9b38-9e631f85fde9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:31:35.309547 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-7e61d655-c3f3-447a-a4be-908daa33f473 None None] MFA Rules not processed for user `d5a7b7df457444809d09cd54a948f8cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:31:35.310831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-7e61d655-c3f3-447a-a4be-908daa33f473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:31:35.319916 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1224/2432] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:31:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:31:35.325198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de4f59-ef8b-416b-9b38-9e631f85fde9 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:31:35.331264 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c96a88-1827-4404-bb1a-eb2666277ddb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:31:35.331996 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c96a88-1827-4404-bb1a-eb2666277ddb service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:35.332286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c96a88-1827-4404-bb1a-eb2666277ddb service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:35.332568 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c96a88-1827-4404-bb1a-eb2666277ddb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:35.334471 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e5c96a88-1827-4404-bb1a-eb2666277ddb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:31:35.348293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c96a88-1827-4404-bb1a-eb2666277ddb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:31:35.350047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c96a88-1827-4404-bb1a-eb2666277ddb service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:31:35.362901 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1209/2433] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:31:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:31:40.215255 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8bce7-d0e7-49dc-86b0-044aa575cdec None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:40.215749 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8bce7-d0e7-49dc-86b0-044aa575cdec None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:40.215863 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8bce7-d0e7-49dc-86b0-044aa575cdec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:40.221862 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:31:40.233889 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-8fb8bce7-d0e7-49dc-86b0-044aa575cdec None None] MFA Rules not processed for user `cdfa8f4012c2471b81f8749b013d3117`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:31:40.235105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-8fb8bce7-d0e7-49dc-86b0-044aa575cdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:31:40.242423 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1225/2434] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Jul 11 11:31:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:31:40.255191 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c96a88-1827-4404-bb1a-eb2666277ddb service nova] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:31:40.267690 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c96a88-1827-4404-bb1a-eb2666277ddb service nova] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:31:40.278894 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247f9cd-802f-4c21-b927-bf5d15e36a72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736f6d4d1dbb47ff98bc67e53614d49c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:31:40.279584 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247f9cd-802f-4c21-b927-bf5d15e36a72 service swift] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:40.279871 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247f9cd-802f-4c21-b927-bf5d15e36a72 service swift] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:40.280154 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247f9cd-802f-4c21-b927-bf5d15e36a72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:40.289165 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247f9cd-802f-4c21-b927-bf5d15e36a72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:31:40.292388 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247f9cd-802f-4c21-b927-bf5d15e36a72 service swift] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:31:40.299809 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1210/2435] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jul 11 11:31:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 11:31:50.283083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=2 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:31:50.296206 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=84 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:31:55.919327 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8bce7-d0e7-49dc-86b0-044aa575cdec None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:31:55.975613 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8bce7-d0e7-49dc-86b0-044aa575cdec None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:31:55.980725 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7b7dc-9579-4d39-b3c0-cddb9e5ba31e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:31:55.980725 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7b7dc-9579-4d39-b3c0-cddb9e5ba31e service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:55.980725 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7b7dc-9579-4d39-b3c0-cddb9e5ba31e service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:55.981041 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7b7dc-9579-4d39-b3c0-cddb9e5ba31e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:55.982578 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-ace7b7dc-9579-4d39-b3c0-cddb9e5ba31e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:31:56.042889 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7b7dc-9579-4d39-b3c0-cddb9e5ba31e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:31:56.044336 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7b7dc-9579-4d39-b3c0-cddb9e5ba31e service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:31:56.053541 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1226/2436] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:31:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:31:56.178627 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247f9cd-802f-4c21-b927-bf5d15e36a72 service swift] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:31:56.200202 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247f9cd-802f-4c21-b927-bf5d15e36a72 service swift] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:31:56.200202 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf41db4-7544-495b-b875-edded1723ee8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:31:56.200202 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf41db4-7544-495b-b875-edded1723ee8 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:31:56.200202 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf41db4-7544-495b-b875-edded1723ee8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:31:56.200716 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf41db4-7544-495b-b875-edded1723ee8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:31:56.205420 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3bf41db4-7544-495b-b875-edded1723ee8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:31:56.285119 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf41db4-7544-495b-b875-edded1723ee8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:31:56.287015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf41db4-7544-495b-b875-edded1723ee8 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:31:56.297452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1211/2437] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:31:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:32:01.916269 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7b7dc-9579-4d39-b3c0-cddb9e5ba31e service cinder] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:32:01.930621 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7b7dc-9579-4d39-b3c0-cddb9e5ba31e service cinder] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:32:01.937438 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80503e3-b7b9-479e-a2a1-bad8b9e5075a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:32:01.938392 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80503e3-b7b9-479e-a2a1-bad8b9e5075a service nova] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:32:01.938687 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80503e3-b7b9-479e-a2a1-bad8b9e5075a service nova] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:32:01.938966 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80503e3-b7b9-479e-a2a1-bad8b9e5075a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:32:01.940800 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-e80503e3-b7b9-479e-a2a1-bad8b9e5075a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:32:01.954468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80503e3-b7b9-479e-a2a1-bad8b9e5075a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:32:01.956072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80503e3-b7b9-479e-a2a1-bad8b9e5075a service nova] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:32:01.968203 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1227/2438] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:32:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:32:06.293600 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=28 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:32:09.351621 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68531f46-5a24-43ba-b95a-245bf8d8be87 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:32:09.352206 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68531f46-5a24-43ba-b95a-245bf8d8be87 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:32:09.352206 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68531f46-5a24-43ba-b95a-245bf8d8be87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:32:09.380325 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-68531f46-5a24-43ba-b95a-245bf8d8be87 None None] MFA Rules not processed for user `1d322f9350b7475b94493d4bbcd61349`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:32:09.381578 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-68531f46-5a24-43ba-b95a-245bf8d8be87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:32:09.389647 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1212/2439] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:32:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:32:09.702789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80503e3-b7b9-479e-a2a1-bad8b9e5075a service nova] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:32:09.704704 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-e80503e3-b7b9-479e-a2a1-bad8b9e5075a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:32:09.717259 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80503e3-b7b9-479e-a2a1-bad8b9e5075a service nova] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:32:09.720924 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd54ee-6abf-4640-be43-378196bec72c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:32:09.721598 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd54ee-6abf-4640-be43-378196bec72c service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:32:09.721917 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd54ee-6abf-4640-be43-378196bec72c service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:32:09.722197 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd54ee-6abf-4640-be43-378196bec72c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:32:09.724597 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-e7bd54ee-6abf-4640-be43-378196bec72c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:32:09.735258 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd54ee-6abf-4640-be43-378196bec72c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:32:09.736726 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd54ee-6abf-4640-be43-378196bec72c service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:32:09.745049 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1228/2440] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:32:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:32:16.221069 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68531f46-5a24-43ba-b95a-245bf8d8be87 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:32:16.230697 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68531f46-5a24-43ba-b95a-245bf8d8be87 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:32:16.234316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef39a3f-a843-4d89-9692-a6548693cddf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:32:16.234962 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef39a3f-a843-4d89-9692-a6548693cddf service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:32:16.235252 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef39a3f-a843-4d89-9692-a6548693cddf service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:32:16.235535 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef39a3f-a843-4d89-9692-a6548693cddf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:32:16.244948 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef39a3f-a843-4d89-9692-a6548693cddf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:32:16.246445 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef39a3f-a843-4d89-9692-a6548693cddf service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:32:16.255902 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1213/2441] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:32:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:32:19.750761 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=60 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:32:22.582267 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd54ee-6abf-4640-be43-378196bec72c service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:32:22.597736 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd54ee-6abf-4640-be43-378196bec72c service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:32:22.606774 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09919e-9975-4d87-9095-917c7ece86f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:32:22.607828 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09919e-9975-4d87-9095-917c7ece86f2 service nova] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:32:22.608471 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09919e-9975-4d87-9095-917c7ece86f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:32:22.608952 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09919e-9975-4d87-9095-917c7ece86f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:32:22.611121 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-dd09919e-9975-4d87-9095-917c7ece86f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:32:22.627201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09919e-9975-4d87-9095-917c7ece86f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:32:22.630189 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09919e-9975-4d87-9095-917c7ece86f2 service nova] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:32:22.646724 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1229/2442] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:32:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:32:24.724535 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef39a3f-a843-4d89-9692-a6548693cddf service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:32:24.733826 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef39a3f-a843-4d89-9692-a6548693cddf service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:32:24.737310 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85999d-9eb7-43e6-b71c-a541e13f6585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:32:24.737975 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85999d-9eb7-43e6-b71c-a541e13f6585 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:32:24.738260 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85999d-9eb7-43e6-b71c-a541e13f6585 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:32:24.738538 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85999d-9eb7-43e6-b71c-a541e13f6585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:32:24.740295 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7c85999d-9eb7-43e6-b71c-a541e13f6585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:32:24.804264 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85999d-9eb7-43e6-b71c-a541e13f6585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:32:24.805734 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85999d-9eb7-43e6-b71c-a541e13f6585 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:32:24.815943 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1214/2443] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:32:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:32:28.513097 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09919e-9975-4d87-9095-917c7ece86f2 service nova] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:32:28.514725 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-dd09919e-9975-4d87-9095-917c7ece86f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:32:28.532622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09919e-9975-4d87-9095-917c7ece86f2 service nova] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:32:28.537385 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc44b6-f11a-44b8-9901-6365ec6c21c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:32:28.538299 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc44b6-f11a-44b8-9901-6365ec6c21c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:32:28.538585 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc44b6-f11a-44b8-9901-6365ec6c21c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:32:28.538866 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc44b6-f11a-44b8-9901-6365ec6c21c3 admin admin] PATH_INFO: `/v3/users/62bacc0d6a2342deac533c4de67041b1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:32:28.540192 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc44b6-f11a-44b8-9901-6365ec6c21c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62bacc0d6a2342deac533c4de67041b1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:32:28.543008 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc44b6-f11a-44b8-9901-6365ec6c21c3 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:32:28.696429 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6fbc44b6-f11a-44b8-9901-6365ec6c21c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62bacc0d6a2342deac533c4de67041b1'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:32:28.758520 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6fbc44b6-f11a-44b8-9901-6365ec6c21c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62bacc0d6a2342deac533c4de67041b1'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:32:28.767518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6fbc44b6-f11a-44b8-9901-6365ec6c21c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62bacc0d6a2342deac533c4de67041b1'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:32:28.768459 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6fbc44b6-f11a-44b8-9901-6365ec6c21c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62bacc0d6a2342deac533c4de67041b1'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:32:28.769903 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6fbc44b6-f11a-44b8-9901-6365ec6c21c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62bacc0d6a2342deac533c4de67041b1'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:32:28.788391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1230/2444] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:32:28 2022] DELETE /identity/v3/users/62bacc0d6a2342deac533c4de67041b1 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:32:28.999499 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85999d-9eb7-43e6-b71c-a541e13f6585 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:32:29.009890 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85999d-9eb7-43e6-b71c-a541e13f6585 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:32:29.069146 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf540428-c49f-46df-a57f-47541d5b806e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:32:29.070289 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf540428-c49f-46df-a57f-47541d5b806e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:32:29.070703 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf540428-c49f-46df-a57f-47541d5b806e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:32:29.071048 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf540428-c49f-46df-a57f-47541d5b806e admin admin] PATH_INFO: `/v3/projects/39e9f9b4531b4105be4cbe2452973b16` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:32:29.072327 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf540428-c49f-46df-a57f-47541d5b806e admin admin] RBAC: Authorizing `identity:delete_project(project_id=39e9f9b4531b4105be4cbe2452973b16)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:32:29.075152 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf540428-c49f-46df-a57f-47541d5b806e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:32:29.158292 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-cf540428-c49f-46df-a57f-47541d5b806e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39e9f9b4531b4105be4cbe2452973b16', 'request_id': 'req-cf540428-c49f-46df-a57f-47541d5b806e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:32:29.163793 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-cf540428-c49f-46df-a57f-47541d5b806e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39e9f9b4531b4105be4cbe2452973b16', 'request_id': 'req-cf540428-c49f-46df-a57f-47541d5b806e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:32:29.209410 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-cf540428-c49f-46df-a57f-47541d5b806e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39e9f9b4531b4105be4cbe2452973b16', 'request_id': 'req-cf540428-c49f-46df-a57f-47541d5b806e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:32:29.221087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-cf540428-c49f-46df-a57f-47541d5b806e admin admin] The token cache is being invalidate because project 39e9f9b4531b4105be4cbe2452973b16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:32:29.221377 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-cf540428-c49f-46df-a57f-47541d5b806e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:32:29.222041 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-cf540428-c49f-46df-a57f-47541d5b806e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:32:29.223578 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1215/2445] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:32:28 2022] DELETE /identity/v3/projects/39e9f9b4531b4105be4cbe2452973b16 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:32:29.228594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1f9bf-e968-4a56-afa4-95b29e55e89b None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:32:29.228912 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1f9bf-e968-4a56-afa4-95b29e55e89b None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:32:29.229194 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1f9bf-e968-4a56-afa4-95b29e55e89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:32:29.248244 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-a1b1f9bf-e968-4a56-afa4-95b29e55e89b None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:32:29.249384 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-a1b1f9bf-e968-4a56-afa4-95b29e55e89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:32:29.309036 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1231/2446] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:32:29.316545 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640db7f-db5b-42ca-a090-8c5b1d59d43a None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:32:29.316849 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640db7f-db5b-42ca-a090-8c5b1d59d43a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:32:29.317137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640db7f-db5b-42ca-a090-8c5b1d59d43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:32:29.324663 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:32:29.335904 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-a640db7f-db5b-42ca-a090-8c5b1d59d43a None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:32:29.337137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a640db7f-db5b-42ca-a090-8c5b1d59d43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:32:29.345963 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1216/2447] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:32:29.349870 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1f9bf-e968-4a56-afa4-95b29e55e89b None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:32:29.361014 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1f9bf-e968-4a56-afa4-95b29e55e89b None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:32:29.365724 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4949f1-b80e-4301-94d2-c6462631ee53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:32:29.366469 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4949f1-b80e-4301-94d2-c6462631ee53 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:32:29.366753 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4949f1-b80e-4301-94d2-c6462631ee53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:32:29.367031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4949f1-b80e-4301-94d2-c6462631ee53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:32:29.367789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4949f1-b80e-4301-94d2-c6462631ee53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:32:29.368199 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4949f1-b80e-4301-94d2-c6462631ee53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:32:29.369706 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4949f1-b80e-4301-94d2-c6462631ee53 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:32:29.382566 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1232/2448] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:32:29.387782 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a640db7f-db5b-42ca-a090-8c5b1d59d43a None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:32:29.397236 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a640db7f-db5b-42ca-a090-8c5b1d59d43a None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:32:29.402259 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d1a2c-0231-4bd0-8e3a-d859da5d84a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:32:29.402929 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d1a2c-0231-4bd0-8e3a-d859da5d84a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:32:29.403248 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d1a2c-0231-4bd0-8e3a-d859da5d84a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:32:29.403532 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d1a2c-0231-4bd0-8e3a-d859da5d84a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:32:29.404297 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d1a2c-0231-4bd0-8e3a-d859da5d84a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:32:29.406210 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d1a2c-0231-4bd0-8e3a-d859da5d84a3 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:32:29.491531 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1217/2449] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:32:29 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:32:29.496471 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4949f1-b80e-4301-94d2-c6462631ee53 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:32:29.508310 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4949f1-b80e-4301-94d2-c6462631ee53 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:32:29.553978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:32:29.567164 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d0809-37f8-46eb-8a51-d0c4008b05a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:32:29.567832 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d0809-37f8-46eb-8a51-d0c4008b05a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:32:29.568118 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d0809-37f8-46eb-8a51-d0c4008b05a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:32:29.568399 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d0809-37f8-46eb-8a51-d0c4008b05a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:32:29.569084 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d0809-37f8-46eb-8a51-d0c4008b05a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:32:29.571062 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d0809-37f8-46eb-8a51-d0c4008b05a5 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:32:29.649412 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1233/2450] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:32:29 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:32:29.654172 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d1a2c-0231-4bd0-8e3a-d859da5d84a3 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:32:29.664935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d1a2c-0231-4bd0-8e3a-d859da5d84a3 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:32:29.670109 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d33313-841a-426e-81ab-ad3ff319fae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:32:29.670864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d33313-841a-426e-81ab-ad3ff319fae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:32:29.671150 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d33313-841a-426e-81ab-ad3ff319fae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:32:29.671427 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d33313-841a-426e-81ab-ad3ff319fae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:32:29.672159 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d33313-841a-426e-81ab-ad3ff319fae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:32:29.673756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d33313-841a-426e-81ab-ad3ff319fae7 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:32:29.685211 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1218/2451] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:32:29.689632 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d0809-37f8-46eb-8a51-d0c4008b05a5 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:32:29.700086 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d0809-37f8-46eb-8a51-d0c4008b05a5 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:32:29.705733 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2e9bd-0649-4e2b-9f3a-f967374c4ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:32:29.706604 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2e9bd-0649-4e2b-9f3a-f967374c4ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:32:29.706887 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2e9bd-0649-4e2b-9f3a-f967374c4ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:32:29.707164 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2e9bd-0649-4e2b-9f3a-f967374c4ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:32:29.711768 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2e9bd-0649-4e2b-9f3a-f967374c4ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:32:29.711768 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2e9bd-0649-4e2b-9f3a-f967374c4ee5 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:32:29.721013 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1234/2452] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:32:29.725275 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d33313-841a-426e-81ab-ad3ff319fae7 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:32:29.736705 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d33313-841a-426e-81ab-ad3ff319fae7 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:32:29.741619 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72350f-c058-4bb1-b7a5-51eaf23fc185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:32:29.742550 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72350f-c058-4bb1-b7a5-51eaf23fc185 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:32:29.742868 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72350f-c058-4bb1-b7a5-51eaf23fc185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:32:29.743148 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72350f-c058-4bb1-b7a5-51eaf23fc185 admin admin] PATH_INFO: `/v3/projects/0f607b6f4faa4d1db8f5d153a4ef13a6/users/b25d1df6e9a643ad8482e3632a99917e/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:32:29.760440 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72350f-c058-4bb1-b7a5-51eaf23fc185 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f607b6f4faa4d1db8f5d153a4ef13a6, user_id=b25d1df6e9a643ad8482e3632a99917e, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:32:29.765944 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72350f-c058-4bb1-b7a5-51eaf23fc185 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:32:29.850327 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1219/2453] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:32:29 2022] PUT /identity/v3/projects/0f607b6f4faa4d1db8f5d153a4ef13a6/users/b25d1df6e9a643ad8482e3632a99917e/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:32:29.856390 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36930974-e8b0-407e-b6f6-ce6477272a47 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:32:29.856683 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36930974-e8b0-407e-b6f6-ce6477272a47 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:32:29.857222 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36930974-e8b0-407e-b6f6-ce6477272a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:32:29.875839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-36930974-e8b0-407e-b6f6-ce6477272a47 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:32:29.877040 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-36930974-e8b0-407e-b6f6-ce6477272a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:32:30.064986 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1235/2454] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:32:30.077148 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72350f-c058-4bb1-b7a5-51eaf23fc185 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:32:30.078966 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-af72350f-c058-4bb1-b7a5-51eaf23fc185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:32:30.138218 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72350f-c058-4bb1-b7a5-51eaf23fc185 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:32:30.141860 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50dd1e2-6818-4842-a519-26ecece33112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:32:30.142498 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50dd1e2-6818-4842-a519-26ecece33112 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:32:30.142786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50dd1e2-6818-4842-a519-26ecece33112 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:32:30.143069 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50dd1e2-6818-4842-a519-26ecece33112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:32:30.152449 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50dd1e2-6818-4842-a519-26ecece33112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:32:30.153893 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50dd1e2-6818-4842-a519-26ecece33112 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:32:30.163670 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1220/2455] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:32:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:32:35.507059 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b4d2d-73e3-4b55-abbc-6cc6e783e89c None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:32:35.507573 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b4d2d-73e3-4b55-abbc-6cc6e783e89c None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:32:35.507669 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b4d2d-73e3-4b55-abbc-6cc6e783e89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:32:35.536087 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-fc7b4d2d-73e3-4b55-abbc-6cc6e783e89c None None] MFA Rules not processed for user `b25d1df6e9a643ad8482e3632a99917e`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:32:35.537274 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-fc7b4d2d-73e3-4b55-abbc-6cc6e783e89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:32:35.616833 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1236/2456] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:32:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:32:35.625011 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50dd1e2-6818-4842-a519-26ecece33112 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:32:35.626700 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e50dd1e2-6818-4842-a519-26ecece33112 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:32:35.726980 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50dd1e2-6818-4842-a519-26ecece33112 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:32:35.732726 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e093ee9-cb34-435c-8efa-3b54a23d763a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:32:35.738014 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e093ee9-cb34-435c-8efa-3b54a23d763a service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:32:35.738014 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e093ee9-cb34-435c-8efa-3b54a23d763a service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:32:35.738014 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e093ee9-cb34-435c-8efa-3b54a23d763a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:32:35.742809 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e093ee9-cb34-435c-8efa-3b54a23d763a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:32:35.744420 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e093ee9-cb34-435c-8efa-3b54a23d763a service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:32:35.755230 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1221/2457] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:32:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:32:38.070329 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc425f57-4d6e-4234-9951-28b89f06d0b9 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:32:38.070871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc425f57-4d6e-4234-9951-28b89f06d0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:32:38.071186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc425f57-4d6e-4234-9951-28b89f06d0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:32:38.092664 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-cc425f57-4d6e-4234-9951-28b89f06d0b9 None None] MFA Rules not processed for user `b25d1df6e9a643ad8482e3632a99917e`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:32:38.094432 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-cc425f57-4d6e-4234-9951-28b89f06d0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:32:38.109533 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1237/2458] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:32:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:32:45.750666 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=85,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:32:48.086152 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=75,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:33:39.000667 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fec038-f2e6-49d1-82b7-86f9e4d896ae None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:33:39.001164 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fec038-f2e6-49d1-82b7-86f9e4d896ae None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:33:39.001317 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fec038-f2e6-49d1-82b7-86f9e4d896ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:33:39.018834 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-e1fec038-f2e6-49d1-82b7-86f9e4d896ae None None] MFA Rules not processed for user `cdfa8f4012c2471b81f8749b013d3117`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:33:39.020038 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e1fec038-f2e6-49d1-82b7-86f9e4d896ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:33:39.076741 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1222/2459] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Jul 11 11:33:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:33:39.125897 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc425f57-4d6e-4234-9951-28b89f06d0b9 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:33:39.128049 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-cc425f57-4d6e-4234-9951-28b89f06d0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:33:39.210636 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc425f57-4d6e-4234-9951-28b89f06d0b9 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:33:39.215609 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882396c9-b5fb-4bbf-8804-9e8f5327192b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736f6d4d1dbb47ff98bc67e53614d49c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:33:39.216258 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882396c9-b5fb-4bbf-8804-9e8f5327192b service swift] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:33:39.217026 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882396c9-b5fb-4bbf-8804-9e8f5327192b service swift] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:33:39.217026 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882396c9-b5fb-4bbf-8804-9e8f5327192b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:33:39.225801 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882396c9-b5fb-4bbf-8804-9e8f5327192b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:33:39.227418 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882396c9-b5fb-4bbf-8804-9e8f5327192b service swift] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:33:39.237657 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1238/2460] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jul 11 11:33:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 11:33:49.070413 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=25 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:33:49.234566 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=32 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:33:52.966976 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fec038-f2e6-49d1-82b7-86f9e4d896ae None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:33:52.968383 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e1fec038-f2e6-49d1-82b7-86f9e4d896ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:33:53.107518 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fec038-f2e6-49d1-82b7-86f9e4d896ae None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:33:53.113532 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23622e-5dcc-40a4-a6fc-ccfb51c1b120 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b7c9264495433985185332778dbc8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:33:53.114244 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23622e-5dcc-40a4-a6fc-ccfb51c1b120 service placement] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:33:53.114532 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23622e-5dcc-40a4-a6fc-ccfb51c1b120 service placement] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:33:53.114814 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23622e-5dcc-40a4-a6fc-ccfb51c1b120 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:33:53.116665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8c23622e-5dcc-40a4-a6fc-ccfb51c1b120 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:33:53.128106 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23622e-5dcc-40a4-a6fc-ccfb51c1b120 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:33:53.129729 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23622e-5dcc-40a4-a6fc-ccfb51c1b120 service placement] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:33:53.139443 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1223/2461] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:33:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:33:56.377094 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02662b4-269f-481d-a892-4982135b39a8 None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:33:56.377736 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02662b4-269f-481d-a892-4982135b39a8 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:33:56.377736 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02662b4-269f-481d-a892-4982135b39a8 None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:33:56.379113 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1239/2462] 10.222.0.23 () {54 vars in 921 bytes} [Mon Jul 11 11:33:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:33:56.385395 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f016fc3-25f3-489e-a38f-3eba3520df07 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:33:56.385906 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f016fc3-25f3-489e-a38f-3eba3520df07 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:33:56.386214 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f016fc3-25f3-489e-a38f-3eba3520df07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:33:56.437839 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-4f016fc3-25f3-489e-a38f-3eba3520df07 None None] MFA Rules not processed for user `5b9e7594afc346e593ef3e6c579e237b`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:33:56.439810 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4f016fc3-25f3-489e-a38f-3eba3520df07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:33:56.466698 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1224/2463] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Jul 11 11:33:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:33:56.481074 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02662b4-269f-481d-a892-4982135b39a8 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:33:56.482810 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-b02662b4-269f-481d-a892-4982135b39a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:33:56.541575 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02662b4-269f-481d-a892-4982135b39a8 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:33:56.545134 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fd11d-adf1-448b-8433-37bcbda32440 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a2d8d24562459493a3bcd399665a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:33:56.545826 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fd11d-adf1-448b-8433-37bcbda32440 service glance] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:33:56.546115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fd11d-adf1-448b-8433-37bcbda32440 service glance] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:33:56.546394 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fd11d-adf1-448b-8433-37bcbda32440 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:33:56.557650 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fd11d-adf1-448b-8433-37bcbda32440 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:33:56.559045 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fd11d-adf1-448b-8433-37bcbda32440 service glance] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:33:56.570786 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1240/2464] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:33:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:33:56.736499 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fde7ba-8646-402c-9704-4af017ef26c4 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:33:56.736826 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fde7ba-8646-402c-9704-4af017ef26c4 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:33:56.737112 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fde7ba-8646-402c-9704-4af017ef26c4 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:33:56.738550 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1225/2465] 10.222.0.23 () {54 vars in 921 bytes} [Mon Jul 11 11:33:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:33:56.743632 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d2c09-f07e-4869-8709-133ef1f203e8 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:33:56.743922 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d2c09-f07e-4869-8709-133ef1f203e8 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:33:56.744204 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d2c09-f07e-4869-8709-133ef1f203e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:33:56.762438 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-8e3d2c09-f07e-4869-8709-133ef1f203e8 None None] MFA Rules not processed for user `79b8c08920b0417097bebd23344ffe64`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:33:56.763626 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-8e3d2c09-f07e-4869-8709-133ef1f203e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:33:56.770243 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1241/2466] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Jul 11 11:33:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:33:56.782107 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fde7ba-8646-402c-9704-4af017ef26c4 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:33:56.784390 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b3fde7ba-8646-402c-9704-4af017ef26c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:33:56.797930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fde7ba-8646-402c-9704-4af017ef26c4 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:33:56.803494 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782855df-fdd3-4542-a39d-4fee08a119e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:33:56.803494 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782855df-fdd3-4542-a39d-4fee08a119e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:33:56.803494 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782855df-fdd3-4542-a39d-4fee08a119e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:33:56.803494 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782855df-fdd3-4542-a39d-4fee08a119e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:33:56.810496 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782855df-fdd3-4542-a39d-4fee08a119e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:33:56.811850 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782855df-fdd3-4542-a39d-4fee08a119e0 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:33:56.819523 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1226/2467] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:33:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:33:56.899531 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0136aaf-aeca-4801-8ad1-018238c6a54b None None] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:33:56.899820 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0136aaf-aeca-4801-8ad1-018238c6a54b None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:33:56.900097 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0136aaf-aeca-4801-8ad1-018238c6a54b None None] PATH_INFO: `/` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:33:56.901467 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1242/2468] 10.222.0.23 () {54 vars in 921 bytes} [Mon Jul 11 11:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:33:56.906207 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78d64a-7113-4358-aee2-8e6369b65209 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:33:56.906495 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78d64a-7113-4358-aee2-8e6369b65209 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:33:56.906771 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78d64a-7113-4358-aee2-8e6369b65209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:33:56.925468 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-3e78d64a-7113-4358-aee2-8e6369b65209 None None] MFA Rules not processed for user `5b9e7594afc346e593ef3e6c579e237b`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:33:56.926696 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3e78d64a-7113-4358-aee2-8e6369b65209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:33:56.935818 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1227/2469] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Jul 11 11:33:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:33:56.946387 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0136aaf-aeca-4801-8ad1-018238c6a54b None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:33:56.957728 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0136aaf-aeca-4801-8ad1-018238c6a54b None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:33:56.961207 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64be5b9-9673-4853-a384-5bc1020b7e23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:33:56.961863 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64be5b9-9673-4853-a384-5bc1020b7e23 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:33:56.962147 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64be5b9-9673-4853-a384-5bc1020b7e23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:33:56.962420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64be5b9-9673-4853-a384-5bc1020b7e23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:33:56.972866 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64be5b9-9673-4853-a384-5bc1020b7e23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:33:56.974371 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64be5b9-9673-4853-a384-5bc1020b7e23 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:33:56.985075 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1243/2470] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:33:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:33:59.759453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdca1f4-ffc3-4c0b-88be-ee80e435e643 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:33:59.759453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdca1f4-ffc3-4c0b-88be-ee80e435e643 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:33:59.759453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdca1f4-ffc3-4c0b-88be-ee80e435e643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:33:59.788793 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-8bdca1f4-ffc3-4c0b-88be-ee80e435e643 None None] MFA Rules not processed for user `cdfa8f4012c2471b81f8749b013d3117`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:33:59.790325 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8bdca1f4-ffc3-4c0b-88be-ee80e435e643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:33:59.799523 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1228/2471] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Jul 11 11:33:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:33:59.814555 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64be5b9-9673-4853-a384-5bc1020b7e23 service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:33:59.825874 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64be5b9-9673-4853-a384-5bc1020b7e23 service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:33:59.830931 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bf24a-8dda-4b8f-b60a-972009307a07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736f6d4d1dbb47ff98bc67e53614d49c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:33:59.831973 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bf24a-8dda-4b8f-b60a-972009307a07 service swift] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:33:59.832242 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bf24a-8dda-4b8f-b60a-972009307a07 service swift] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:33:59.832522 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bf24a-8dda-4b8f-b60a-972009307a07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:33:59.841207 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bf24a-8dda-4b8f-b60a-972009307a07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:33:59.844447 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bf24a-8dda-4b8f-b60a-972009307a07 service swift] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:33:59.851907 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1244/2472] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jul 11 11:33:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 11:34:09.781293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=98 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:34:09.848598 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=41 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:34:25.577727 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412352b-9141-446a-9cd0-d67a7c2b5470 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:34:25.578261 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412352b-9141-446a-9cd0-d67a7c2b5470 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:34:25.578479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412352b-9141-446a-9cd0-d67a7c2b5470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:34:25.596422 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-2412352b-9141-446a-9cd0-d67a7c2b5470 None None] MFA Rules not processed for user `cdfa8f4012c2471b81f8749b013d3117`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:34:25.597621 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2412352b-9141-446a-9cd0-d67a7c2b5470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:34:25.613781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1229/2473] 10.222.0.23 () {58 vars in 967 bytes} [Mon Jul 11 11:34:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:34:25.619602 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bf24a-8dda-4b8f-b60a-972009307a07 service swift] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:34:25.630581 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bf24a-8dda-4b8f-b60a-972009307a07 service swift] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:34:25.635711 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e9bcf-95eb-4008-ba44-5eaa86a571dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736f6d4d1dbb47ff98bc67e53614d49c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:34:25.636344 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e9bcf-95eb-4008-ba44-5eaa86a571dc service swift] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:34:25.636653 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e9bcf-95eb-4008-ba44-5eaa86a571dc service swift] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:34:25.636933 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e9bcf-95eb-4008-ba44-5eaa86a571dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:34:25.645578 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e9bcf-95eb-4008-ba44-5eaa86a571dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:34:25.647488 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e9bcf-95eb-4008-ba44-5eaa86a571dc service swift] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:34:25.655783 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1245/2474] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jul 11 11:34:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 11:34:26.822350 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66213b4-fc50-4955-9cb7-918b7d6f4f05 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:34:26.822874 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66213b4-fc50-4955-9cb7-918b7d6f4f05 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:34:26.822974 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66213b4-fc50-4955-9cb7-918b7d6f4f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:34:26.841580 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-c66213b4-fc50-4955-9cb7-918b7d6f4f05 None None] MFA Rules not processed for user `b25d1df6e9a643ad8482e3632a99917e`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:34:26.842825 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c66213b4-fc50-4955-9cb7-918b7d6f4f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:34:26.849964 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1230/2475] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:34:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:34:35.652420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=6 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:34:36.836249 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=6 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:34:44.349050 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e9bcf-95eb-4008-ba44-5eaa86a571dc service swift] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:34:44.369288 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e9bcf-95eb-4008-ba44-5eaa86a571dc service swift] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:34:44.372875 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48ffe0-0e71-4d1d-b5da-19b57742c6df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:34:44.373516 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48ffe0-0e71-4d1d-b5da-19b57742c6df service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:34:44.373822 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48ffe0-0e71-4d1d-b5da-19b57742c6df service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:34:44.374106 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48ffe0-0e71-4d1d-b5da-19b57742c6df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:34:44.375874 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-fb48ffe0-0e71-4d1d-b5da-19b57742c6df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:34:44.411078 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48ffe0-0e71-4d1d-b5da-19b57742c6df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:34:44.412642 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48ffe0-0e71-4d1d-b5da-19b57742c6df service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:34:44.432595 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1246/2476] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:34:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:34:48.150018 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66213b4-fc50-4955-9cb7-918b7d6f4f05 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:34:48.151529 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c66213b4-fc50-4955-9cb7-918b7d6f4f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:34:48.169225 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66213b4-fc50-4955-9cb7-918b7d6f4f05 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:34:48.176803 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22debd-c11c-4904-bf8b-fe474f5c6179 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b7c9264495433985185332778dbc8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:34:48.177640 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22debd-c11c-4904-bf8b-fe474f5c6179 service placement] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:34:48.177975 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22debd-c11c-4904-bf8b-fe474f5c6179 service placement] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:34:48.178398 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22debd-c11c-4904-bf8b-fe474f5c6179 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:34:48.180294 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9e22debd-c11c-4904-bf8b-fe474f5c6179 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:34:48.200619 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22debd-c11c-4904-bf8b-fe474f5c6179 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:34:48.202282 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22debd-c11c-4904-bf8b-fe474f5c6179 service placement] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:34:48.214989 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1231/2477] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:34:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:34:48.302542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48ffe0-0e71-4d1d-b5da-19b57742c6df service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:34:48.304047 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-fb48ffe0-0e71-4d1d-b5da-19b57742c6df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:34:48.316893 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48ffe0-0e71-4d1d-b5da-19b57742c6df service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:34:48.321460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf44ae-2b6d-4757-abbf-550e832c777a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:34:48.322401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf44ae-2b6d-4757-abbf-550e832c777a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:34:48.322720 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf44ae-2b6d-4757-abbf-550e832c777a admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:34:48.328049 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf44ae-2b6d-4757-abbf-550e832c777a admin admin] PATH_INFO: `/v3/users/1d322f9350b7475b94493d4bbcd61349` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:34:48.328049 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf44ae-2b6d-4757-abbf-550e832c777a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d322f9350b7475b94493d4bbcd61349)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:34:48.328049 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf44ae-2b6d-4757-abbf-550e832c777a admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:34:48.501122 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-9bdf44ae-2b6d-4757-abbf-550e832c777a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d322f9350b7475b94493d4bbcd61349'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:34:48.573945 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-9bdf44ae-2b6d-4757-abbf-550e832c777a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d322f9350b7475b94493d4bbcd61349'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:34:48.582389 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-9bdf44ae-2b6d-4757-abbf-550e832c777a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d322f9350b7475b94493d4bbcd61349'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:34:48.583063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-9bdf44ae-2b6d-4757-abbf-550e832c777a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d322f9350b7475b94493d4bbcd61349'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:34:48.583751 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-9bdf44ae-2b6d-4757-abbf-550e832c777a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d322f9350b7475b94493d4bbcd61349'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:34:48.600720 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1247/2478] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:34:48 2022] DELETE /identity/v3/users/1d322f9350b7475b94493d4bbcd61349 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:34:48.884950 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22debd-c11c-4904-bf8b-fe474f5c6179 service placement] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:34:48.895660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22debd-c11c-4904-bf8b-fe474f5c6179 service placement] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:34:48.960841 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cfb24-dccc-41a3-8062-a57fc06eaf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:34:48.961712 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cfb24-dccc-41a3-8062-a57fc06eaf37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:34:48.962033 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cfb24-dccc-41a3-8062-a57fc06eaf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:34:48.962316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cfb24-dccc-41a3-8062-a57fc06eaf37 admin admin] PATH_INFO: `/v3/projects/d895c01442c94d6fb92e188a25c883e4` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:34:48.963539 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cfb24-dccc-41a3-8062-a57fc06eaf37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d895c01442c94d6fb92e188a25c883e4)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:34:48.965541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cfb24-dccc-41a3-8062-a57fc06eaf37 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:34:49.114480 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-879cfb24-dccc-41a3-8062-a57fc06eaf37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd895c01442c94d6fb92e188a25c883e4', 'request_id': 'req-879cfb24-dccc-41a3-8062-a57fc06eaf37'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:34:49.121050 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-879cfb24-dccc-41a3-8062-a57fc06eaf37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd895c01442c94d6fb92e188a25c883e4', 'request_id': 'req-879cfb24-dccc-41a3-8062-a57fc06eaf37'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:34:49.174498 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-879cfb24-dccc-41a3-8062-a57fc06eaf37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd895c01442c94d6fb92e188a25c883e4', 'request_id': 'req-879cfb24-dccc-41a3-8062-a57fc06eaf37'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:34:49.186648 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-879cfb24-dccc-41a3-8062-a57fc06eaf37 admin admin] The token cache is being invalidate because project d895c01442c94d6fb92e188a25c883e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:34:49.186937 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-879cfb24-dccc-41a3-8062-a57fc06eaf37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:34:49.187580 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-879cfb24-dccc-41a3-8062-a57fc06eaf37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:34:49.189296 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1232/2479] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:34:48 2022] DELETE /identity/v3/projects/d895c01442c94d6fb92e188a25c883e4 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:34:49.194336 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3c51e-56f6-47b2-995f-5cea72ab0110 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:34:49.194697 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3c51e-56f6-47b2-995f-5cea72ab0110 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:34:49.195042 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3c51e-56f6-47b2-995f-5cea72ab0110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:34:49.245099 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-87d3c51e-56f6-47b2-995f-5cea72ab0110 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:34:49.246337 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-87d3c51e-56f6-47b2-995f-5cea72ab0110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:34:49.299206 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:34:49.307784 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1248/2480] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:34:49.315984 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa9b24-d3bc-405e-aabd-0bcb74c17a69 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:34:49.316283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa9b24-d3bc-405e-aabd-0bcb74c17a69 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:34:49.316564 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa9b24-d3bc-405e-aabd-0bcb74c17a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:34:49.336338 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-e9aa9b24-d3bc-405e-aabd-0bcb74c17a69 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:34:49.337547 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e9aa9b24-d3bc-405e-aabd-0bcb74c17a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:34:49.346291 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1233/2481] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:34:49.351147 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3c51e-56f6-47b2-995f-5cea72ab0110 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:34:49.364228 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3c51e-56f6-47b2-995f-5cea72ab0110 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:34:49.371303 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71854eeb-a069-469e-bfdf-66bdbd506d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:34:49.372139 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71854eeb-a069-469e-bfdf-66bdbd506d7e admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:34:49.372398 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71854eeb-a069-469e-bfdf-66bdbd506d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:34:49.372787 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71854eeb-a069-469e-bfdf-66bdbd506d7e admin admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:34:49.373988 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71854eeb-a069-469e-bfdf-66bdbd506d7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:34:49.374484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71854eeb-a069-469e-bfdf-66bdbd506d7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:34:49.376506 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71854eeb-a069-469e-bfdf-66bdbd506d7e admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:34:49.394989 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1249/2482] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:34:49.400014 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa9b24-d3bc-405e-aabd-0bcb74c17a69 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:34:49.412144 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa9b24-d3bc-405e-aabd-0bcb74c17a69 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:34:49.419842 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041cd5f-23c9-4b0b-9f22-4bca19e06a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:34:49.420751 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041cd5f-23c9-4b0b-9f22-4bca19e06a56 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:34:49.422026 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041cd5f-23c9-4b0b-9f22-4bca19e06a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:34:49.422026 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041cd5f-23c9-4b0b-9f22-4bca19e06a56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:34:49.422744 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041cd5f-23c9-4b0b-9f22-4bca19e06a56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:34:49.426875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041cd5f-23c9-4b0b-9f22-4bca19e06a56 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:34:49.534178 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1234/2483] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:34:49 2022] POST /identity/v3/projects => generated 357 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:34:49.537413 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71854eeb-a069-469e-bfdf-66bdbd506d7e admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:34:49.553322 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71854eeb-a069-469e-bfdf-66bdbd506d7e admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:34:49.639182 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409b538-a510-4f94-a00d-b3223c3f0f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:34:49.640835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409b538-a510-4f94-a00d-b3223c3f0f9f admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:34:49.641279 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409b538-a510-4f94-a00d-b3223c3f0f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:34:49.642902 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409b538-a510-4f94-a00d-b3223c3f0f9f admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:34:49.643789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409b538-a510-4f94-a00d-b3223c3f0f9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:34:49.646728 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409b538-a510-4f94-a00d-b3223c3f0f9f admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:34:49.734670 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1250/2484] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:34:49 2022] POST /identity/v3/users => generated 279 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:34:49.738752 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041cd5f-23c9-4b0b-9f22-4bca19e06a56 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:34:49.749075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041cd5f-23c9-4b0b-9f22-4bca19e06a56 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:34:49.753908 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceec197-d2aa-4e72-a425-1ce4be3bdff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:34:49.754585 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceec197-d2aa-4e72-a425-1ce4be3bdff6 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:34:49.754876 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceec197-d2aa-4e72-a425-1ce4be3bdff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:34:49.755224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceec197-d2aa-4e72-a425-1ce4be3bdff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:34:49.755976 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceec197-d2aa-4e72-a425-1ce4be3bdff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:34:49.757794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceec197-d2aa-4e72-a425-1ce4be3bdff6 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:34:49.785450 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1235/2485] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:34:49.786731 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409b538-a510-4f94-a00d-b3223c3f0f9f admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:34:49.798012 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409b538-a510-4f94-a00d-b3223c3f0f9f admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:34:49.803823 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595efa8e-8614-46e0-8411-7533c0b355bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:34:49.804269 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595efa8e-8614-46e0-8411-7533c0b355bb admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:34:49.804560 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595efa8e-8614-46e0-8411-7533c0b355bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:34:49.804843 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595efa8e-8614-46e0-8411-7533c0b355bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:34:49.805615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595efa8e-8614-46e0-8411-7533c0b355bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:34:49.807251 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595efa8e-8614-46e0-8411-7533c0b355bb admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:34:49.819340 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1251/2486] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:34:49.824343 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceec197-d2aa-4e72-a425-1ce4be3bdff6 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:34:49.837991 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceec197-d2aa-4e72-a425-1ce4be3bdff6 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:34:49.855179 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e76c2-f5c1-4a27-bfef-4bfeca15cdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:34:49.857374 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e76c2-f5c1-4a27-bfef-4bfeca15cdb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:34:49.858094 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e76c2-f5c1-4a27-bfef-4bfeca15cdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:34:49.859755 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e76c2-f5c1-4a27-bfef-4bfeca15cdb1 admin admin] PATH_INFO: `/v3/projects/f7f9943a2c0c4381b18c34a5fffdfdd2/users/c0ce8296465c4ae6847632e035ebff16/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:34:49.883844 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e76c2-f5c1-4a27-bfef-4bfeca15cdb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7f9943a2c0c4381b18c34a5fffdfdd2, user_id=c0ce8296465c4ae6847632e035ebff16, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:34:49.886869 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e76c2-f5c1-4a27-bfef-4bfeca15cdb1 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:34:49.993489 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1236/2487] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:34:49 2022] PUT /identity/v3/projects/f7f9943a2c0c4381b18c34a5fffdfdd2/users/c0ce8296465c4ae6847632e035ebff16/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:34:50.004548 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a24e79-43a6-427e-ba9a-51b827ead679 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:34:50.008956 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a24e79-43a6-427e-ba9a-51b827ead679 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:34:50.008956 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a24e79-43a6-427e-ba9a-51b827ead679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:34:50.035722 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-c2a24e79-43a6-427e-ba9a-51b827ead679 None None] MFA Rules not processed for user `c0ce8296465c4ae6847632e035ebff16`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:34:50.036984 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-c2a24e79-43a6-427e-ba9a-51b827ead679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:34:50.115482 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1252/2488] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:34:50 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:34:50.116722 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e76c2-f5c1-4a27-bfef-4bfeca15cdb1 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:34:50.132451 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:34:50.182461 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e76c2-f5c1-4a27-bfef-4bfeca15cdb1 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:34:50.187599 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ebe0f-35a4-4631-8935-2a261653d9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:34:50.188267 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ebe0f-35a4-4631-8935-2a261653d9fc admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:34:50.188550 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ebe0f-35a4-4631-8935-2a261653d9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:34:50.189380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ebe0f-35a4-4631-8935-2a261653d9fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:34:50.190115 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ebe0f-35a4-4631-8935-2a261653d9fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:34:50.192005 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ebe0f-35a4-4631-8935-2a261653d9fc admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:34:50.319284 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1237/2489] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:34:50 2022] POST /identity/v3/projects => generated 357 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:34:50.323388 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a24e79-43a6-427e-ba9a-51b827ead679 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:34:50.334376 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a24e79-43a6-427e-ba9a-51b827ead679 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:34:50.386531 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:34:50.393467 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc7eec-4514-4f9e-b8e1-8b7a3704420b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:34:50.394181 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc7eec-4514-4f9e-b8e1-8b7a3704420b admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:34:50.394465 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc7eec-4514-4f9e-b8e1-8b7a3704420b admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:34:50.394738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc7eec-4514-4f9e-b8e1-8b7a3704420b admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:34:50.395468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc7eec-4514-4f9e-b8e1-8b7a3704420b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:34:50.397373 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc7eec-4514-4f9e-b8e1-8b7a3704420b admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:34:50.492003 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1253/2490] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:34:50 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:34:50.493364 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ebe0f-35a4-4631-8935-2a261653d9fc admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:34:50.507225 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ebe0f-35a4-4631-8935-2a261653d9fc admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:34:50.512391 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2086da-51a7-454e-85f7-08d6ec7434e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:34:50.513077 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2086da-51a7-454e-85f7-08d6ec7434e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:34:50.513359 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2086da-51a7-454e-85f7-08d6ec7434e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:34:50.513638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2086da-51a7-454e-85f7-08d6ec7434e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:34:50.514409 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2086da-51a7-454e-85f7-08d6ec7434e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:34:50.516022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2086da-51a7-454e-85f7-08d6ec7434e8 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:34:50.526898 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1238/2491] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:34:50.531100 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc7eec-4514-4f9e-b8e1-8b7a3704420b admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:34:50.542013 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc7eec-4514-4f9e-b8e1-8b7a3704420b admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:34:50.547100 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18d466-8d83-40bf-814b-5b2aab797cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:34:50.548558 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18d466-8d83-40bf-814b-5b2aab797cb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:34:50.548846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18d466-8d83-40bf-814b-5b2aab797cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:34:50.549125 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18d466-8d83-40bf-814b-5b2aab797cb5 admin admin] PATH_INFO: `/v3/projects/cca778f8ce614c1ab88387bb9aa9de56/users/1c2e85ff8e6742ec9d12addb39e141c5/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:34:50.566994 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18d466-8d83-40bf-814b-5b2aab797cb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cca778f8ce614c1ab88387bb9aa9de56, user_id=1c2e85ff8e6742ec9d12addb39e141c5, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:34:50.569658 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18d466-8d83-40bf-814b-5b2aab797cb5 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:34:50.678542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1254/2492] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:34:50 2022] PUT /identity/v3/projects/cca778f8ce614c1ab88387bb9aa9de56/users/1c2e85ff8e6742ec9d12addb39e141c5/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:34:50.682658 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2086da-51a7-454e-85f7-08d6ec7434e8 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:34:50.693576 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2086da-51a7-454e-85f7-08d6ec7434e8 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:34:50.756850 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d0f59-fe9c-40db-aab9-af5dddcd7d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:34:50.757798 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d0f59-fe9c-40db-aab9-af5dddcd7d5d admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:34:50.758004 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d0f59-fe9c-40db-aab9-af5dddcd7d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:34:50.758289 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d0f59-fe9c-40db-aab9-af5dddcd7d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:34:50.762340 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d0f59-fe9c-40db-aab9-af5dddcd7d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:34:50.762340 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d0f59-fe9c-40db-aab9-af5dddcd7d5d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:34:50.772611 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1239/2493] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:34:50.776455 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18d466-8d83-40bf-814b-5b2aab797cb5 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:34:50.791621 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18d466-8d83-40bf-814b-5b2aab797cb5 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:34:50.796749 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc10c75-8fbc-40ab-9c10-0689d2f8c115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:34:50.797701 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc10c75-8fbc-40ab-9c10-0689d2f8c115 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:34:50.798208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc10c75-8fbc-40ab-9c10-0689d2f8c115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:34:50.799060 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc10c75-8fbc-40ab-9c10-0689d2f8c115 admin admin] PATH_INFO: `/v3/projects/cca778f8ce614c1ab88387bb9aa9de56/users/1c2e85ff8e6742ec9d12addb39e141c5/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:34:50.801132 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc10c75-8fbc-40ab-9c10-0689d2f8c115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cca778f8ce614c1ab88387bb9aa9de56, user_id=1c2e85ff8e6742ec9d12addb39e141c5, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:34:50.804038 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc10c75-8fbc-40ab-9c10-0689d2f8c115 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:34:50.825829 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1255/2494] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:34:50 2022] PUT /identity/v3/projects/cca778f8ce614c1ab88387bb9aa9de56/users/1c2e85ff8e6742ec9d12addb39e141c5/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:34:50.828362 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caab242-05d6-47b3-9d4b-5df77b1f2c96 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:34:50.829753 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caab242-05d6-47b3-9d4b-5df77b1f2c96 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:34:50.829753 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caab242-05d6-47b3-9d4b-5df77b1f2c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:34:50.858977 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-7caab242-05d6-47b3-9d4b-5df77b1f2c96 None None] MFA Rules not processed for user `1c2e85ff8e6742ec9d12addb39e141c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:34:50.860226 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7caab242-05d6-47b3-9d4b-5df77b1f2c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:34:50.948390 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1240/2495] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:34:50 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:34:50.962691 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc10c75-8fbc-40ab-9c10-0689d2f8c115 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:34:50.964638 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-fbc10c75-8fbc-40ab-9c10-0689d2f8c115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:34:51.049582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc10c75-8fbc-40ab-9c10-0689d2f8c115 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:34:51.053480 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc04659-7f8f-4e91-8cdf-1163a7c2ad9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:34:51.054180 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc04659-7f8f-4e91-8cdf-1163a7c2ad9e service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:34:51.054471 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc04659-7f8f-4e91-8cdf-1163a7c2ad9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:34:51.054755 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc04659-7f8f-4e91-8cdf-1163a7c2ad9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:34:51.064021 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc04659-7f8f-4e91-8cdf-1163a7c2ad9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:34:51.065452 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc04659-7f8f-4e91-8cdf-1163a7c2ad9e service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:34:51.075454 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1256/2496] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:34:50 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:34:51.274936 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caab242-05d6-47b3-9d4b-5df77b1f2c96 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:34:51.276617 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7caab242-05d6-47b3-9d4b-5df77b1f2c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:34:51.292588 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caab242-05d6-47b3-9d4b-5df77b1f2c96 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:34:51.296266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12bcab-5d21-4088-bbba-2801855af13c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:34:51.296953 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12bcab-5d21-4088-bbba-2801855af13c service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:34:51.297242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12bcab-5d21-4088-bbba-2801855af13c service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:34:51.297531 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12bcab-5d21-4088-bbba-2801855af13c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:34:51.303110 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:34:51.359099 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee12bcab-5d21-4088-bbba-2801855af13c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:34:51.360629 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee12bcab-5d21-4088-bbba-2801855af13c service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:34:51.370251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1241/2497] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:34:51 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:34:58.663568 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba1baf-7770-4ee6-8b7c-7ee30f7ec173 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:34:58.664018 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba1baf-7770-4ee6-8b7c-7ee30f7ec173 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:34:58.664132 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba1baf-7770-4ee6-8b7c-7ee30f7ec173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:34:58.681888 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-83ba1baf-7770-4ee6-8b7c-7ee30f7ec173 None None] MFA Rules not processed for user `cdfa8f4012c2471b81f8749b013d3117`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:34:58.683107 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-83ba1baf-7770-4ee6-8b7c-7ee30f7ec173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:34:58.737103 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1257/2498] 10.222.0.23 () {58 vars in 967 bytes} [Mon Jul 11 11:34:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:34:58.759541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12bcab-5d21-4088-bbba-2801855af13c service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:34:58.761078 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ee12bcab-5d21-4088-bbba-2801855af13c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:34:58.830685 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12bcab-5d21-4088-bbba-2801855af13c service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:34:58.836776 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621193ba-eec3-4e35-8107-8022baa27d3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736f6d4d1dbb47ff98bc67e53614d49c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:34:58.837429 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621193ba-eec3-4e35-8107-8022baa27d3a service swift] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:34:58.837716 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621193ba-eec3-4e35-8107-8022baa27d3a service swift] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:34:58.838041 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621193ba-eec3-4e35-8107-8022baa27d3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:34:58.845999 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621193ba-eec3-4e35-8107-8022baa27d3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:34:58.847660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621193ba-eec3-4e35-8107-8022baa27d3a service swift] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:34:58.855739 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1242/2499] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jul 11 11:34:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 11:35:03.689799 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba1baf-7770-4ee6-8b7c-7ee30f7ec173 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:03.691981 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-83ba1baf-7770-4ee6-8b7c-7ee30f7ec173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:03.730677 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:03.760593 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba1baf-7770-4ee6-8b7c-7ee30f7ec173 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:03.765737 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6bb09-d496-47d1-8620-98fb91202ae9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b7c9264495433985185332778dbc8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:03.766439 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6bb09-d496-47d1-8620-98fb91202ae9 service placement] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:03.766780 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6bb09-d496-47d1-8620-98fb91202ae9 service placement] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:03.767058 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6bb09-d496-47d1-8620-98fb91202ae9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:03.768961 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-75d6bb09-d496-47d1-8620-98fb91202ae9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:03.781001 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6bb09-d496-47d1-8620-98fb91202ae9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:03.782677 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6bb09-d496-47d1-8620-98fb91202ae9 service placement] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:03.797313 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1258/2500] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:35:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:35:07.521031 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621193ba-eec3-4e35-8107-8022baa27d3a service swift] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:07.522590 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-621193ba-eec3-4e35-8107-8022baa27d3a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:07.592119 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621193ba-eec3-4e35-8107-8022baa27d3a service swift] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:07.596815 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ec1b0-199c-4c31-bc4e-e477ee49bcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:07.597725 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ec1b0-199c-4c31-bc4e-e477ee49bcdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:07.598041 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ec1b0-199c-4c31-bc4e-e477ee49bcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:07.598318 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ec1b0-199c-4c31-bc4e-e477ee49bcdf admin admin] PATH_INFO: `/v3/users/d5a7b7df457444809d09cd54a948f8cf` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:07.599550 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ec1b0-199c-4c31-bc4e-e477ee49bcdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5a7b7df457444809d09cd54a948f8cf)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:07.601542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ec1b0-199c-4c31-bc4e-e477ee49bcdf admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:07.815454 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:07.822507 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1f3ec1b0-199c-4c31-bc4e-e477ee49bcdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5a7b7df457444809d09cd54a948f8cf'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:07.823171 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1f3ec1b0-199c-4c31-bc4e-e477ee49bcdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5a7b7df457444809d09cd54a948f8cf'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:07.830072 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1f3ec1b0-199c-4c31-bc4e-e477ee49bcdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5a7b7df457444809d09cd54a948f8cf'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:07.899132 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1f3ec1b0-199c-4c31-bc4e-e477ee49bcdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5a7b7df457444809d09cd54a948f8cf'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:07.911944 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1f3ec1b0-199c-4c31-bc4e-e477ee49bcdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5a7b7df457444809d09cd54a948f8cf'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:07.918163 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1243/2501] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:35:07 2022] DELETE /identity/v3/users/d5a7b7df457444809d09cd54a948f8cf => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:08.165167 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6bb09-d496-47d1-8620-98fb91202ae9 service placement] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:08.179847 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6bb09-d496-47d1-8620-98fb91202ae9 service placement] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:08.238818 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac60ce8-f1ea-47e6-9229-72a283c8bfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:08.239684 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac60ce8-f1ea-47e6-9229-72a283c8bfe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:08.239973 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac60ce8-f1ea-47e6-9229-72a283c8bfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:08.240250 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac60ce8-f1ea-47e6-9229-72a283c8bfe1 admin admin] PATH_INFO: `/v3/projects/9a5c64177ca546e8985cbbfecd408121` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:08.241429 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac60ce8-f1ea-47e6-9229-72a283c8bfe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a5c64177ca546e8985cbbfecd408121)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:08.243369 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac60ce8-f1ea-47e6-9229-72a283c8bfe1 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:08.362239 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-cac60ce8-f1ea-47e6-9229-72a283c8bfe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a5c64177ca546e8985cbbfecd408121', 'request_id': 'req-cac60ce8-f1ea-47e6-9229-72a283c8bfe1'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:08.453714 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-cac60ce8-f1ea-47e6-9229-72a283c8bfe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a5c64177ca546e8985cbbfecd408121', 'request_id': 'req-cac60ce8-f1ea-47e6-9229-72a283c8bfe1'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:08.461356 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-cac60ce8-f1ea-47e6-9229-72a283c8bfe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a5c64177ca546e8985cbbfecd408121', 'request_id': 'req-cac60ce8-f1ea-47e6-9229-72a283c8bfe1'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:08.471572 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-cac60ce8-f1ea-47e6-9229-72a283c8bfe1 admin admin] The token cache is being invalidate because project 9a5c64177ca546e8985cbbfecd408121 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:35:08.471863 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-cac60ce8-f1ea-47e6-9229-72a283c8bfe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:08.472670 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-cac60ce8-f1ea-47e6-9229-72a283c8bfe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:08.474241 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1259/2502] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:35:08 2022] DELETE /identity/v3/projects/9a5c64177ca546e8985cbbfecd408121 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:08.478203 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ec1b0-199c-4c31-bc4e-e477ee49bcdf admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:08.479619 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1f3ec1b0-199c-4c31-bc4e-e477ee49bcdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:08.492447 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ec1b0-199c-4c31-bc4e-e477ee49bcdf admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:08.553729 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfbbc4-2189-4ad6-aa26-6f52c7848e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:08.557665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfbbc4-2189-4ad6-aa26-6f52c7848e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:08.557665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfbbc4-2189-4ad6-aa26-6f52c7848e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:08.557665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfbbc4-2189-4ad6-aa26-6f52c7848e9e admin admin] PATH_INFO: `/v3/users/1eea092731e043ceb1468a89409ca3fd` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:08.557665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfbbc4-2189-4ad6-aa26-6f52c7848e9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eea092731e043ceb1468a89409ca3fd)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:08.558378 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfbbc4-2189-4ad6-aa26-6f52c7848e9e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:08.690203 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-93cfbbc4-2189-4ad6-aa26-6f52c7848e9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eea092731e043ceb1468a89409ca3fd'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:08.690791 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-93cfbbc4-2189-4ad6-aa26-6f52c7848e9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eea092731e043ceb1468a89409ca3fd'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:08.698409 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-93cfbbc4-2189-4ad6-aa26-6f52c7848e9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eea092731e043ceb1468a89409ca3fd'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:08.745242 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-93cfbbc4-2189-4ad6-aa26-6f52c7848e9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eea092731e043ceb1468a89409ca3fd'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:08.758497 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-93cfbbc4-2189-4ad6-aa26-6f52c7848e9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eea092731e043ceb1468a89409ca3fd'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:08.764914 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1244/2503] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:35:08 2022] DELETE /identity/v3/users/1eea092731e043ceb1468a89409ca3fd => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:08.987502 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac60ce8-f1ea-47e6-9229-72a283c8bfe1 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:08.988167 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-cac60ce8-f1ea-47e6-9229-72a283c8bfe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:09.001418 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac60ce8-f1ea-47e6-9229-72a283c8bfe1 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:09.054274 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:09.060892 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99ee7e-9a23-45a1-8ab6-308543e703a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:09.061755 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99ee7e-9a23-45a1-8ab6-308543e703a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:09.062116 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99ee7e-9a23-45a1-8ab6-308543e703a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:09.062395 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99ee7e-9a23-45a1-8ab6-308543e703a0 admin admin] PATH_INFO: `/v3/projects/12695cadc77d40fe9cdff67d46aa9ffa` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:09.063577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99ee7e-9a23-45a1-8ab6-308543e703a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12695cadc77d40fe9cdff67d46aa9ffa)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:09.065494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99ee7e-9a23-45a1-8ab6-308543e703a0 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:09.162952 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-4c99ee7e-9a23-45a1-8ab6-308543e703a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12695cadc77d40fe9cdff67d46aa9ffa', 'request_id': 'req-4c99ee7e-9a23-45a1-8ab6-308543e703a0'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:09.242441 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-4c99ee7e-9a23-45a1-8ab6-308543e703a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12695cadc77d40fe9cdff67d46aa9ffa', 'request_id': 'req-4c99ee7e-9a23-45a1-8ab6-308543e703a0'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:09.249310 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-4c99ee7e-9a23-45a1-8ab6-308543e703a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12695cadc77d40fe9cdff67d46aa9ffa', 'request_id': 'req-4c99ee7e-9a23-45a1-8ab6-308543e703a0'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:09.260849 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-4c99ee7e-9a23-45a1-8ab6-308543e703a0 admin admin] The token cache is being invalidate because project 12695cadc77d40fe9cdff67d46aa9ffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:35:09.261137 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-4c99ee7e-9a23-45a1-8ab6-308543e703a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:09.261861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-4c99ee7e-9a23-45a1-8ab6-308543e703a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:09.263531 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1260/2504] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:35:08 2022] DELETE /identity/v3/projects/12695cadc77d40fe9cdff67d46aa9ffa => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:09.268599 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf940a-ccd8-4260-a7f7-1a77fd052482 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:09.273068 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf940a-ccd8-4260-a7f7-1a77fd052482 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:09.273068 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf940a-ccd8-4260-a7f7-1a77fd052482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:09.289294 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-4bcf940a-ccd8-4260-a7f7-1a77fd052482 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:09.290612 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4bcf940a-ccd8-4260-a7f7-1a77fd052482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:09.320730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:09.351416 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1245/2505] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:35:09.359424 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efdec4-b57c-41a7-93fa-48854e348554 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:09.359719 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efdec4-b57c-41a7-93fa-48854e348554 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:09.360032 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efdec4-b57c-41a7-93fa-48854e348554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:09.379787 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-92efdec4-b57c-41a7-93fa-48854e348554 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:09.381002 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-92efdec4-b57c-41a7-93fa-48854e348554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:09.389181 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1261/2506] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:35:09.393328 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf940a-ccd8-4260-a7f7-1a77fd052482 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:09.403541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf940a-ccd8-4260-a7f7-1a77fd052482 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:09.408656 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45f060-c49c-4043-8680-3cbc20e822cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:09.409315 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45f060-c49c-4043-8680-3cbc20e822cd admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:09.409645 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45f060-c49c-4043-8680-3cbc20e822cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:09.410504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45f060-c49c-4043-8680-3cbc20e822cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:09.411236 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45f060-c49c-4043-8680-3cbc20e822cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:35:09.411554 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45f060-c49c-4043-8680-3cbc20e822cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:09.413144 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45f060-c49c-4043-8680-3cbc20e822cd admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:09.424731 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1246/2507] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:35:09.430047 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efdec4-b57c-41a7-93fa-48854e348554 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:09.439255 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efdec4-b57c-41a7-93fa-48854e348554 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:09.444605 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bbbcb-2eb3-4770-a832-a93676fe7489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:09.445254 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bbbcb-2eb3-4770-a832-a93676fe7489 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:09.445542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bbbcb-2eb3-4770-a832-a93676fe7489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:09.445866 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bbbcb-2eb3-4770-a832-a93676fe7489 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:09.446569 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426bbbcb-2eb3-4770-a832-a93676fe7489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:09.448466 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426bbbcb-2eb3-4770-a832-a93676fe7489 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:09.534661 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1262/2508] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:35:09 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:35:09.538794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45f060-c49c-4043-8680-3cbc20e822cd admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:09.548790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45f060-c49c-4043-8680-3cbc20e822cd admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:09.604970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef2d69-b7a8-4a4b-a099-d4baeaa12c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:09.605656 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef2d69-b7a8-4a4b-a099-d4baeaa12c3a admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:09.605974 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef2d69-b7a8-4a4b-a099-d4baeaa12c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:09.606255 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef2d69-b7a8-4a4b-a099-d4baeaa12c3a admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:09.606959 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef2d69-b7a8-4a4b-a099-d4baeaa12c3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:09.608861 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef2d69-b7a8-4a4b-a099-d4baeaa12c3a admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:09.700166 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1247/2509] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:35:09 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:35:09.704240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bbbcb-2eb3-4770-a832-a93676fe7489 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:09.715116 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bbbcb-2eb3-4770-a832-a93676fe7489 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:09.719629 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6ce67-9670-44b6-b109-363a094f84dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:09.720278 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6ce67-9670-44b6-b109-363a094f84dd admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:09.720562 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6ce67-9670-44b6-b109-363a094f84dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:09.720839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6ce67-9670-44b6-b109-363a094f84dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:09.721650 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6ce67-9670-44b6-b109-363a094f84dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:09.723859 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6ce67-9670-44b6-b109-363a094f84dd admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:09.735198 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1263/2510] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:35:09.739803 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef2d69-b7a8-4a4b-a099-d4baeaa12c3a admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:09.749861 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef2d69-b7a8-4a4b-a099-d4baeaa12c3a admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:09.754856 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d3400-f61c-4721-8b9c-c4ee4c4c5e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:09.759486 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d3400-f61c-4721-8b9c-c4ee4c4c5e97 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:09.759486 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d3400-f61c-4721-8b9c-c4ee4c4c5e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:09.759486 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d3400-f61c-4721-8b9c-c4ee4c4c5e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:09.759486 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d3400-f61c-4721-8b9c-c4ee4c4c5e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:09.759486 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d3400-f61c-4721-8b9c-c4ee4c4c5e97 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:09.770563 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1248/2511] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:35:09.774541 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6ce67-9670-44b6-b109-363a094f84dd admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:09.785268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6ce67-9670-44b6-b109-363a094f84dd admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:09.790081 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddef7b-6fc0-487a-8dfc-456a5f088535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:09.790973 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddef7b-6fc0-487a-8dfc-456a5f088535 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:09.791262 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddef7b-6fc0-487a-8dfc-456a5f088535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:09.791540 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddef7b-6fc0-487a-8dfc-456a5f088535 admin admin] PATH_INFO: `/v3/projects/199db26c275d489699bb2c2afee9a50f/users/9450c339800248feb9f487804473a59b/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:09.808134 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ddef7b-6fc0-487a-8dfc-456a5f088535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=199db26c275d489699bb2c2afee9a50f, user_id=9450c339800248feb9f487804473a59b, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:09.810850 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ddef7b-6fc0-487a-8dfc-456a5f088535 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:09.934141 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1264/2512] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:35:09 2022] PUT /identity/v3/projects/199db26c275d489699bb2c2afee9a50f/users/9450c339800248feb9f487804473a59b/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:09.939381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32d72b-d1aa-4ba1-aa1a-8730b4999d90 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:09.939678 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32d72b-d1aa-4ba1-aa1a-8730b4999d90 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:09.939988 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32d72b-d1aa-4ba1-aa1a-8730b4999d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:09.961745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-1a32d72b-d1aa-4ba1-aa1a-8730b4999d90 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:09.961745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1a32d72b-d1aa-4ba1-aa1a-8730b4999d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:10.023793 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1249/2513] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:35:10.033468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddef7b-6fc0-487a-8dfc-456a5f088535 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:10.035997 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-a5ddef7b-6fc0-487a-8dfc-456a5f088535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:10.105390 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddef7b-6fc0-487a-8dfc-456a5f088535 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:10.109052 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186c145-7365-48a5-a1eb-ee83048ca794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:10.109695 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186c145-7365-48a5-a1eb-ee83048ca794 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:10.110011 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186c145-7365-48a5-a1eb-ee83048ca794 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:10.110289 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186c145-7365-48a5-a1eb-ee83048ca794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:10.119298 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186c145-7365-48a5-a1eb-ee83048ca794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:10.120723 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186c145-7365-48a5-a1eb-ee83048ca794 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:10.130590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1265/2514] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:35:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:35:10.154804 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32d72b-d1aa-4ba1-aa1a-8730b4999d90 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:10.156218 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1a32d72b-d1aa-4ba1-aa1a-8730b4999d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:10.168900 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32d72b-d1aa-4ba1-aa1a-8730b4999d90 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:10.173596 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6997f17-e541-45cf-aeda-f7342e82b0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:10.174535 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6997f17-e541-45cf-aeda-f7342e82b0c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:10.174842 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6997f17-e541-45cf-aeda-f7342e82b0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:10.175127 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6997f17-e541-45cf-aeda-f7342e82b0c2 admin admin] PATH_INFO: `/v3/users/c0ce8296465c4ae6847632e035ebff16` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:10.176356 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6997f17-e541-45cf-aeda-f7342e82b0c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0ce8296465c4ae6847632e035ebff16)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:10.178336 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6997f17-e541-45cf-aeda-f7342e82b0c2 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:10.351953 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:10.360069 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f6997f17-e541-45cf-aeda-f7342e82b0c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0ce8296465c4ae6847632e035ebff16'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:10.360749 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f6997f17-e541-45cf-aeda-f7342e82b0c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0ce8296465c4ae6847632e035ebff16'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:10.367348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f6997f17-e541-45cf-aeda-f7342e82b0c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0ce8296465c4ae6847632e035ebff16'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:10.459630 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f6997f17-e541-45cf-aeda-f7342e82b0c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0ce8296465c4ae6847632e035ebff16'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:10.472640 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f6997f17-e541-45cf-aeda-f7342e82b0c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0ce8296465c4ae6847632e035ebff16'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:10.478805 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1250/2515] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:35:10 2022] DELETE /identity/v3/users/c0ce8296465c4ae6847632e035ebff16 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:10.483319 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2ff11-03c5-4c64-9883-9a795cb5301e None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:10.483801 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2ff11-03c5-4c64-9883-9a795cb5301e None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:10.483900 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2ff11-03c5-4c64-9883-9a795cb5301e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:10.501469 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-b7e2ff11-03c5-4c64-9883-9a795cb5301e None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:10.502705 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-b7e2ff11-03c5-4c64-9883-9a795cb5301e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:10.512009 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:10.564002 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1266/2516] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:35:10.581415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6997f17-e541-45cf-aeda-f7342e82b0c2 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:10.584086 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f6997f17-e541-45cf-aeda-f7342e82b0c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:10.647234 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6997f17-e541-45cf-aeda-f7342e82b0c2 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:10.651012 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d89e8e-81f8-4ed7-a18f-2e7959f1e6c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:10.654537 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d89e8e-81f8-4ed7-a18f-2e7959f1e6c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:10.654537 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d89e8e-81f8-4ed7-a18f-2e7959f1e6c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:10.654537 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d89e8e-81f8-4ed7-a18f-2e7959f1e6c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:10.663832 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d89e8e-81f8-4ed7-a18f-2e7959f1e6c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:10.665282 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d89e8e-81f8-4ed7-a18f-2e7959f1e6c4 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:10.675893 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1251/2517] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:35:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:35:11.051223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2ff11-03c5-4c64-9883-9a795cb5301e None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:11.052754 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-b7e2ff11-03c5-4c64-9883-9a795cb5301e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:11.064805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2ff11-03c5-4c64-9883-9a795cb5301e None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:11.071760 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a77c41-0d5a-414c-9f9d-b8cf19ebfa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:11.072618 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a77c41-0d5a-414c-9f9d-b8cf19ebfa67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:11.072902 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a77c41-0d5a-414c-9f9d-b8cf19ebfa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:11.073177 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a77c41-0d5a-414c-9f9d-b8cf19ebfa67 admin admin] PATH_INFO: `/v3/projects/f7f9943a2c0c4381b18c34a5fffdfdd2` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:11.074405 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a77c41-0d5a-414c-9f9d-b8cf19ebfa67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7f9943a2c0c4381b18c34a5fffdfdd2)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:11.076358 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a77c41-0d5a-414c-9f9d-b8cf19ebfa67 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:11.156896 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e1a77c41-0d5a-414c-9f9d-b8cf19ebfa67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7f9943a2c0c4381b18c34a5fffdfdd2', 'request_id': 'req-e1a77c41-0d5a-414c-9f9d-b8cf19ebfa67'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:11.208281 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e1a77c41-0d5a-414c-9f9d-b8cf19ebfa67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7f9943a2c0c4381b18c34a5fffdfdd2', 'request_id': 'req-e1a77c41-0d5a-414c-9f9d-b8cf19ebfa67'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:11.215563 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e1a77c41-0d5a-414c-9f9d-b8cf19ebfa67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7f9943a2c0c4381b18c34a5fffdfdd2', 'request_id': 'req-e1a77c41-0d5a-414c-9f9d-b8cf19ebfa67'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:11.228182 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e1a77c41-0d5a-414c-9f9d-b8cf19ebfa67 admin admin] The token cache is being invalidate because project f7f9943a2c0c4381b18c34a5fffdfdd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:35:11.228479 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e1a77c41-0d5a-414c-9f9d-b8cf19ebfa67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:11.229146 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e1a77c41-0d5a-414c-9f9d-b8cf19ebfa67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:11.230793 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1267/2518] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:35:11 2022] DELETE /identity/v3/projects/f7f9943a2c0c4381b18c34a5fffdfdd2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:11.236339 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d89e8e-81f8-4ed7-a18f-2e7959f1e6c4 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:11.245207 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d89e8e-81f8-4ed7-a18f-2e7959f1e6c4 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:11.304565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37386ee0-56f7-4ccf-817f-b14a003ef8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:11.305642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37386ee0-56f7-4ccf-817f-b14a003ef8bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:11.306165 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37386ee0-56f7-4ccf-817f-b14a003ef8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:11.306560 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37386ee0-56f7-4ccf-817f-b14a003ef8bc admin admin] PATH_INFO: `/v3/users/1c2e85ff8e6742ec9d12addb39e141c5` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:11.307898 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37386ee0-56f7-4ccf-817f-b14a003ef8bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c2e85ff8e6742ec9d12addb39e141c5)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:11.310021 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37386ee0-56f7-4ccf-817f-b14a003ef8bc admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:11.476108 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-37386ee0-56f7-4ccf-817f-b14a003ef8bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c2e85ff8e6742ec9d12addb39e141c5'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:11.477250 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-37386ee0-56f7-4ccf-817f-b14a003ef8bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c2e85ff8e6742ec9d12addb39e141c5'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:11.486777 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-37386ee0-56f7-4ccf-817f-b14a003ef8bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c2e85ff8e6742ec9d12addb39e141c5'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:11.490978 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:11.534089 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-37386ee0-56f7-4ccf-817f-b14a003ef8bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c2e85ff8e6742ec9d12addb39e141c5'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:11.548618 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-37386ee0-56f7-4ccf-817f-b14a003ef8bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c2e85ff8e6742ec9d12addb39e141c5'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:11.556006 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1252/2519] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:35:11 2022] DELETE /identity/v3/users/1c2e85ff8e6742ec9d12addb39e141c5 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:12.190490 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a77c41-0d5a-414c-9f9d-b8cf19ebfa67 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:12.193070 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-e1a77c41-0d5a-414c-9f9d-b8cf19ebfa67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:12.210220 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a77c41-0d5a-414c-9f9d-b8cf19ebfa67 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:12.278533 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b74dc-d288-48e8-8193-a373141e8f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:12.279539 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b74dc-d288-48e8-8193-a373141e8f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:12.280066 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b74dc-d288-48e8-8193-a373141e8f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:12.280443 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b74dc-d288-48e8-8193-a373141e8f22 admin admin] PATH_INFO: `/v3/projects/cca778f8ce614c1ab88387bb9aa9de56` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:12.282218 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b74dc-d288-48e8-8193-a373141e8f22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cca778f8ce614c1ab88387bb9aa9de56)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:12.284600 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b74dc-d288-48e8-8193-a373141e8f22 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:12.391794 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:12.398884 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ae7b74dc-d288-48e8-8193-a373141e8f22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cca778f8ce614c1ab88387bb9aa9de56', 'request_id': 'req-ae7b74dc-d288-48e8-8193-a373141e8f22'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:12.465290 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ae7b74dc-d288-48e8-8193-a373141e8f22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cca778f8ce614c1ab88387bb9aa9de56', 'request_id': 'req-ae7b74dc-d288-48e8-8193-a373141e8f22'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:12.472363 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ae7b74dc-d288-48e8-8193-a373141e8f22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cca778f8ce614c1ab88387bb9aa9de56', 'request_id': 'req-ae7b74dc-d288-48e8-8193-a373141e8f22'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:12.483145 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ae7b74dc-d288-48e8-8193-a373141e8f22 admin admin] The token cache is being invalidate because project cca778f8ce614c1ab88387bb9aa9de56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:35:12.483433 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ae7b74dc-d288-48e8-8193-a373141e8f22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:12.484080 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ae7b74dc-d288-48e8-8193-a373141e8f22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:12.485631 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1268/2520] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:35:12 2022] DELETE /identity/v3/projects/cca778f8ce614c1ab88387bb9aa9de56 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:12.491425 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057275ca-631b-4ba6-8fbd-95c55d6bac42 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:12.491894 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057275ca-631b-4ba6-8fbd-95c55d6bac42 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:12.493026 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057275ca-631b-4ba6-8fbd-95c55d6bac42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:12.511303 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-057275ca-631b-4ba6-8fbd-95c55d6bac42 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:12.512518 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-057275ca-631b-4ba6-8fbd-95c55d6bac42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:12.578428 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1253/2521] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:35:12.580156 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981fb63-e0da-4b29-8ba8-778e049b517b None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:12.580452 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981fb63-e0da-4b29-8ba8-778e049b517b None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:12.580736 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981fb63-e0da-4b29-8ba8-778e049b517b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:12.602104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-5981fb63-e0da-4b29-8ba8-778e049b517b None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:12.603316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-5981fb63-e0da-4b29-8ba8-778e049b517b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:12.611518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1269/2522] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:35:12.617367 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057275ca-631b-4ba6-8fbd-95c55d6bac42 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:12.628768 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057275ca-631b-4ba6-8fbd-95c55d6bac42 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:12.633686 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095ccef-dbd8-40ec-a302-082f953b04a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:12.634842 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095ccef-dbd8-40ec-a302-082f953b04a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:12.635131 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095ccef-dbd8-40ec-a302-082f953b04a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:12.635419 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095ccef-dbd8-40ec-a302-082f953b04a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:12.636157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095ccef-dbd8-40ec-a302-082f953b04a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:35:12.636469 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095ccef-dbd8-40ec-a302-082f953b04a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:12.638107 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095ccef-dbd8-40ec-a302-082f953b04a0 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:12.652397 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1254/2523] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:35:12.656654 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981fb63-e0da-4b29-8ba8-778e049b517b None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:12.667434 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981fb63-e0da-4b29-8ba8-778e049b517b None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:12.672223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fcfb3-a460-4743-9d1b-527d8b92fdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:12.672882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fcfb3-a460-4743-9d1b-527d8b92fdcf admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:12.673165 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fcfb3-a460-4743-9d1b-527d8b92fdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:12.673438 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fcfb3-a460-4743-9d1b-527d8b92fdcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:12.674291 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4fcfb3-a460-4743-9d1b-527d8b92fdcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:12.676586 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4fcfb3-a460-4743-9d1b-527d8b92fdcf admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:12.759808 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1270/2524] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:35:12 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:35:12.763844 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095ccef-dbd8-40ec-a302-082f953b04a0 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:12.776411 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095ccef-dbd8-40ec-a302-082f953b04a0 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:12.850576 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87439dfe-eb57-47e0-b943-e397d3af2995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:12.851048 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87439dfe-eb57-47e0-b943-e397d3af2995 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:12.851346 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87439dfe-eb57-47e0-b943-e397d3af2995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:12.851628 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87439dfe-eb57-47e0-b943-e397d3af2995 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:12.852340 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87439dfe-eb57-47e0-b943-e397d3af2995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:12.854330 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87439dfe-eb57-47e0-b943-e397d3af2995 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:12.953024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1255/2525] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:35:12 2022] POST /identity/v3/users => generated 283 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:35:12.956721 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fcfb3-a460-4743-9d1b-527d8b92fdcf admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:12.969123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fcfb3-a460-4743-9d1b-527d8b92fdcf admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:12.975105 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d661f9-a8be-4b6c-8f44-000da41ee44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:12.975876 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d661f9-a8be-4b6c-8f44-000da41ee44e admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:12.976234 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d661f9-a8be-4b6c-8f44-000da41ee44e admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:12.976585 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d661f9-a8be-4b6c-8f44-000da41ee44e admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:12.977467 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d661f9-a8be-4b6c-8f44-000da41ee44e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:12.979198 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d661f9-a8be-4b6c-8f44-000da41ee44e admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:12.990972 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1271/2526] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:35:12.995052 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87439dfe-eb57-47e0-b943-e397d3af2995 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:13.005538 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87439dfe-eb57-47e0-b943-e397d3af2995 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:13.010246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c443b-ac73-4795-a850-9044b7aeb041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:13.010916 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c443b-ac73-4795-a850-9044b7aeb041 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:13.011205 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c443b-ac73-4795-a850-9044b7aeb041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:13.011484 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c443b-ac73-4795-a850-9044b7aeb041 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:13.012224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c443b-ac73-4795-a850-9044b7aeb041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:13.013850 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c443b-ac73-4795-a850-9044b7aeb041 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:13.027883 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1256/2527] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:35:13.029042 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d661f9-a8be-4b6c-8f44-000da41ee44e admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:13.039711 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d661f9-a8be-4b6c-8f44-000da41ee44e admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:13.045460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcd2af-7a07-499b-9964-8600f6c4db20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:13.046443 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcd2af-7a07-499b-9964-8600f6c4db20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:13.056459 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcd2af-7a07-499b-9964-8600f6c4db20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:13.056459 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcd2af-7a07-499b-9964-8600f6c4db20 admin admin] PATH_INFO: `/v3/projects/cef343212d7c4112b859318e688c6cf1/users/6c24113ec44b4e72b149c3c2f9860542/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:13.063129 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcd2af-7a07-499b-9964-8600f6c4db20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cef343212d7c4112b859318e688c6cf1, user_id=6c24113ec44b4e72b149c3c2f9860542, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:13.066718 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcd2af-7a07-499b-9964-8600f6c4db20 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:13.168424 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1272/2528] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:35:13 2022] PUT /identity/v3/projects/cef343212d7c4112b859318e688c6cf1/users/6c24113ec44b4e72b149c3c2f9860542/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:35:13.177440 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489de8c-9dbf-44ed-b050-e5f13b01603c None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:13.177998 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489de8c-9dbf-44ed-b050-e5f13b01603c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:13.178337 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489de8c-9dbf-44ed-b050-e5f13b01603c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:13.236775 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-9489de8c-9dbf-44ed-b050-e5f13b01603c None None] MFA Rules not processed for user `6c24113ec44b4e72b149c3c2f9860542`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:13.238943 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9489de8c-9dbf-44ed-b050-e5f13b01603c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:13.276978 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:13.338013 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1257/2529] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:35:13.346900 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcd2af-7a07-499b-9964-8600f6c4db20 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:13.448300 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcd2af-7a07-499b-9964-8600f6c4db20 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:13.455114 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4516317-24c0-4448-8c8f-ede8dc0d972b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:13.455809 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4516317-24c0-4448-8c8f-ede8dc0d972b admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:13.456780 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4516317-24c0-4448-8c8f-ede8dc0d972b admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:13.457697 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4516317-24c0-4448-8c8f-ede8dc0d972b admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:13.458694 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4516317-24c0-4448-8c8f-ede8dc0d972b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:13.461246 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4516317-24c0-4448-8c8f-ede8dc0d972b admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:13.546965 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1273/2530] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:35:13 2022] POST /identity/v3/projects => generated 365 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:35:13.550950 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489de8c-9dbf-44ed-b050-e5f13b01603c None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:13.562656 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489de8c-9dbf-44ed-b050-e5f13b01603c None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:13.637154 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c1df1-c29e-4791-9bb3-42f5425f99e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:13.637881 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c1df1-c29e-4791-9bb3-42f5425f99e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:13.638173 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c1df1-c29e-4791-9bb3-42f5425f99e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:13.638455 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c1df1-c29e-4791-9bb3-42f5425f99e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:13.639159 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c1df1-c29e-4791-9bb3-42f5425f99e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:13.641279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c1df1-c29e-4791-9bb3-42f5425f99e3 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:13.753138 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1258/2531] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:35:13 2022] POST /identity/v3/users => generated 289 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:35:13.757603 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4516317-24c0-4448-8c8f-ede8dc0d972b admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:13.773680 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4516317-24c0-4448-8c8f-ede8dc0d972b admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:13.778698 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d8e77-d19b-40a3-aaf6-905fd682ff8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:13.779524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d8e77-d19b-40a3-aaf6-905fd682ff8d admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:13.779813 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d8e77-d19b-40a3-aaf6-905fd682ff8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:13.780216 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d8e77-d19b-40a3-aaf6-905fd682ff8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:13.780954 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d8e77-d19b-40a3-aaf6-905fd682ff8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:13.782618 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d8e77-d19b-40a3-aaf6-905fd682ff8d admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:13.797734 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1274/2532] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:35:13.798954 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c1df1-c29e-4791-9bb3-42f5425f99e3 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:13.810770 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c1df1-c29e-4791-9bb3-42f5425f99e3 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:13.816843 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd294a-637c-4fc1-91c8-3377b1102805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:13.817741 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd294a-637c-4fc1-91c8-3377b1102805 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:13.818058 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd294a-637c-4fc1-91c8-3377b1102805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:13.818341 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd294a-637c-4fc1-91c8-3377b1102805 admin admin] PATH_INFO: `/v3/projects/996498cfee464aeca010e73d60f0607b/users/1946396106934a6b9a111d1c6249100f/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:13.834959 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd294a-637c-4fc1-91c8-3377b1102805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=996498cfee464aeca010e73d60f0607b, user_id=1946396106934a6b9a111d1c6249100f, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:13.837841 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd294a-637c-4fc1-91c8-3377b1102805 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:13.898750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1259/2533] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:35:13 2022] PUT /identity/v3/projects/996498cfee464aeca010e73d60f0607b/users/1946396106934a6b9a111d1c6249100f/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:35:13.900062 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d8e77-d19b-40a3-aaf6-905fd682ff8d admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:13.911429 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d8e77-d19b-40a3-aaf6-905fd682ff8d admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:13.947516 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:13.973823 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20c621-b467-4149-b139-fcd3aa9d16d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:13.974494 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20c621-b467-4149-b139-fcd3aa9d16d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:13.974778 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20c621-b467-4149-b139-fcd3aa9d16d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:13.975055 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20c621-b467-4149-b139-fcd3aa9d16d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:13.975781 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20c621-b467-4149-b139-fcd3aa9d16d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:13.977448 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20c621-b467-4149-b139-fcd3aa9d16d9 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:13.988302 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1275/2534] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:35:13.992238 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd294a-637c-4fc1-91c8-3377b1102805 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:14.002940 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd294a-637c-4fc1-91c8-3377b1102805 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:14.007946 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137ff0c-64c4-4818-b823-71fff8fe155e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:14.008576 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137ff0c-64c4-4818-b823-71fff8fe155e admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:14.008862 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137ff0c-64c4-4818-b823-71fff8fe155e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:14.009141 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137ff0c-64c4-4818-b823-71fff8fe155e admin admin] PATH_INFO: `/v3/projects/996498cfee464aeca010e73d60f0607b/users/1946396106934a6b9a111d1c6249100f/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:14.016059 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137ff0c-64c4-4818-b823-71fff8fe155e admin admin] RBAC: Authorizing `identity:create_grant(project_id=996498cfee464aeca010e73d60f0607b, user_id=1946396106934a6b9a111d1c6249100f, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:14.016059 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137ff0c-64c4-4818-b823-71fff8fe155e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:14.025720 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1260/2535] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:35:13 2022] PUT /identity/v3/projects/996498cfee464aeca010e73d60f0607b/users/1946396106934a6b9a111d1c6249100f/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:14.037486 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d2273-01bf-4d27-acbe-f3c05b2086bb None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:14.037805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d2273-01bf-4d27-acbe-f3c05b2086bb None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:14.038096 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d2273-01bf-4d27-acbe-f3c05b2086bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:14.069167 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-e44d2273-01bf-4d27-acbe-f3c05b2086bb None None] MFA Rules not processed for user `1946396106934a6b9a111d1c6249100f`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:14.071820 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-e44d2273-01bf-4d27-acbe-f3c05b2086bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:14.157944 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1276/2536] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:14 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:35:14.171100 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137ff0c-64c4-4818-b823-71fff8fe155e admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:14.174474 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9137ff0c-64c4-4818-b823-71fff8fe155e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:14.271728 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137ff0c-64c4-4818-b823-71fff8fe155e admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:14.277176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b1029-3e97-4e36-aa4e-f9d35325354e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:14.277812 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b1029-3e97-4e36-aa4e-f9d35325354e service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:14.278105 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b1029-3e97-4e36-aa4e-f9d35325354e service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:14.278388 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b1029-3e97-4e36-aa4e-f9d35325354e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:14.289842 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b1029-3e97-4e36-aa4e-f9d35325354e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:14.291557 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b1029-3e97-4e36-aa4e-f9d35325354e service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:14.304804 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1261/2537] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:35:14 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:35:14.562405 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d2273-01bf-4d27-acbe-f3c05b2086bb None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:14.584063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d2273-01bf-4d27-acbe-f3c05b2086bb None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:14.594717 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65cb39-e9d4-4e63-97cf-730ae035e49f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:14.595937 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65cb39-e9d4-4e63-97cf-730ae035e49f service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:14.595937 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65cb39-e9d4-4e63-97cf-730ae035e49f service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:14.595937 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65cb39-e9d4-4e63-97cf-730ae035e49f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:14.681577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65cb39-e9d4-4e63-97cf-730ae035e49f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:14.683131 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65cb39-e9d4-4e63-97cf-730ae035e49f service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:14.696319 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1277/2538] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:35:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:35:15.494893 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac999c-3e88-4148-a422-5d5e9dbc5a5e None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:15.495390 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac999c-3e88-4148-a422-5d5e9dbc5a5e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:15.500773 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac999c-3e88-4148-a422-5d5e9dbc5a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:15.538149 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-89ac999c-3e88-4148-a422-5d5e9dbc5a5e None None] MFA Rules not processed for user `9450c339800248feb9f487804473a59b`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:15.539331 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-89ac999c-3e88-4148-a422-5d5e9dbc5a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:15.556043 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:15.609557 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1262/2539] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:35:15.614036 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65cb39-e9d4-4e63-97cf-730ae035e49f service cinder] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:15.615478 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-2e65cb39-e9d4-4e63-97cf-730ae035e49f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:15.675268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:15.679580 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65cb39-e9d4-4e63-97cf-730ae035e49f service cinder] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:15.684241 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4de02-cd5f-448e-b158-19bffc446a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:15.684893 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4de02-cd5f-448e-b158-19bffc446a3f admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:15.686551 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4de02-cd5f-448e-b158-19bffc446a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:15.686551 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4de02-cd5f-448e-b158-19bffc446a3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:15.686551 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4de02-cd5f-448e-b158-19bffc446a3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:15.688068 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4de02-cd5f-448e-b158-19bffc446a3f admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:15.764068 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1278/2540] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:35:15 2022] POST /identity/v3/projects => generated 371 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:35:15.768214 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac999c-3e88-4148-a422-5d5e9dbc5a5e None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:15.780107 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac999c-3e88-4148-a422-5d5e9dbc5a5e None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:15.837261 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8497e-0ba4-4629-822d-9c5087a5ebd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:15.838114 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8497e-0ba4-4629-822d-9c5087a5ebd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:15.838405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8497e-0ba4-4629-822d-9c5087a5ebd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:15.838690 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8497e-0ba4-4629-822d-9c5087a5ebd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:15.839385 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8497e-0ba4-4629-822d-9c5087a5ebd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:15.841352 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8497e-0ba4-4629-822d-9c5087a5ebd4 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:15.964251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1263/2541] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:35:15 2022] POST /identity/v3/users => generated 292 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:35:15.968329 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4de02-cd5f-448e-b158-19bffc446a3f admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:15.978970 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4de02-cd5f-448e-b158-19bffc446a3f admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:15.985192 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c3d8a-c2b6-459a-a683-2a32086499c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:15.985192 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c3d8a-c2b6-459a-a683-2a32086499c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:15.985192 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c3d8a-c2b6-459a-a683-2a32086499c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:15.985192 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c3d8a-c2b6-459a-a683-2a32086499c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:15.985665 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c3d8a-c2b6-459a-a683-2a32086499c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:15.987057 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c3d8a-c2b6-459a-a683-2a32086499c6 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:15.997945 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1279/2542] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:35:16.001925 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8497e-0ba4-4629-822d-9c5087a5ebd4 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:16.012875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8497e-0ba4-4629-822d-9c5087a5ebd4 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:16.018043 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c339bb-501c-422d-9b0a-1ffc58b9a467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:16.019632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c339bb-501c-422d-9b0a-1ffc58b9a467 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:16.019982 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c339bb-501c-422d-9b0a-1ffc58b9a467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:16.020296 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c339bb-501c-422d-9b0a-1ffc58b9a467 admin admin] PATH_INFO: `/v3/projects/567f027f33374edb9c8bb4f5501e65bc/users/2733d9f38efb4e848ea47a40d080ddf1/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:16.035700 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c339bb-501c-422d-9b0a-1ffc58b9a467 admin admin] RBAC: Authorizing `identity:create_grant(project_id=567f027f33374edb9c8bb4f5501e65bc, user_id=2733d9f38efb4e848ea47a40d080ddf1, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:16.038362 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c339bb-501c-422d-9b0a-1ffc58b9a467 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:16.106951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1264/2543] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:35:16 2022] PUT /identity/v3/projects/567f027f33374edb9c8bb4f5501e65bc/users/2733d9f38efb4e848ea47a40d080ddf1/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:16.114712 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c3d8a-c2b6-459a-a683-2a32086499c6 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:16.135846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c3d8a-c2b6-459a-a683-2a32086499c6 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:16.200293 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac558f-8ac8-4c39-9171-c87efe8c0843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:16.200971 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac558f-8ac8-4c39-9171-c87efe8c0843 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:16.201257 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac558f-8ac8-4c39-9171-c87efe8c0843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:16.201538 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac558f-8ac8-4c39-9171-c87efe8c0843 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:16.202345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac558f-8ac8-4c39-9171-c87efe8c0843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:16.203946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac558f-8ac8-4c39-9171-c87efe8c0843 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:16.218647 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1280/2544] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:35:16.219827 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c339bb-501c-422d-9b0a-1ffc58b9a467 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:16.231340 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c339bb-501c-422d-9b0a-1ffc58b9a467 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:16.236772 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad36b5f-dbb8-4f49-8a49-148f4dd2461e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:16.238602 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad36b5f-dbb8-4f49-8a49-148f4dd2461e admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:16.238804 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad36b5f-dbb8-4f49-8a49-148f4dd2461e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:16.238998 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad36b5f-dbb8-4f49-8a49-148f4dd2461e admin admin] PATH_INFO: `/v3/projects/567f027f33374edb9c8bb4f5501e65bc/users/2733d9f38efb4e848ea47a40d080ddf1/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:16.243365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad36b5f-dbb8-4f49-8a49-148f4dd2461e admin admin] RBAC: Authorizing `identity:create_grant(project_id=567f027f33374edb9c8bb4f5501e65bc, user_id=2733d9f38efb4e848ea47a40d080ddf1, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:16.243699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad36b5f-dbb8-4f49-8a49-148f4dd2461e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:16.267552 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1265/2545] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:35:16 2022] PUT /identity/v3/projects/567f027f33374edb9c8bb4f5501e65bc/users/2733d9f38efb4e848ea47a40d080ddf1/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:18.342005 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac558f-8ac8-4c39-9171-c87efe8c0843 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:18.357999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac558f-8ac8-4c39-9171-c87efe8c0843 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:18.433799 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e159f0-fefa-49b1-a64c-76fdb0813924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:18.434790 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e159f0-fefa-49b1-a64c-76fdb0813924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:18.435180 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e159f0-fefa-49b1-a64c-76fdb0813924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:18.435496 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e159f0-fefa-49b1-a64c-76fdb0813924 admin admin] PATH_INFO: `/v3/users/6c24113ec44b4e72b149c3c2f9860542` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:18.436801 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e159f0-fefa-49b1-a64c-76fdb0813924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c24113ec44b4e72b149c3c2f9860542)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:18.438887 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e159f0-fefa-49b1-a64c-76fdb0813924 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:18.666223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-94e159f0-fefa-49b1-a64c-76fdb0813924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c24113ec44b4e72b149c3c2f9860542'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:18.809432 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-94e159f0-fefa-49b1-a64c-76fdb0813924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c24113ec44b4e72b149c3c2f9860542'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:18.831123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-94e159f0-fefa-49b1-a64c-76fdb0813924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c24113ec44b4e72b149c3c2f9860542'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:18.833198 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-94e159f0-fefa-49b1-a64c-76fdb0813924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c24113ec44b4e72b149c3c2f9860542'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:18.842499 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-94e159f0-fefa-49b1-a64c-76fdb0813924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c24113ec44b4e72b149c3c2f9860542'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:18.850648 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:18.868367 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1281/2546] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:35:18 2022] DELETE /identity/v3/users/6c24113ec44b4e72b149c3c2f9860542 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:18.873988 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e242840-2e2f-46f4-a6ba-977f8d7f755a None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:18.874815 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e242840-2e2f-46f4-a6ba-977f8d7f755a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:18.875277 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e242840-2e2f-46f4-a6ba-977f8d7f755a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:18.900322 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-8e242840-2e2f-46f4-a6ba-977f8d7f755a None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:18.901841 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8e242840-2e2f-46f4-a6ba-977f8d7f755a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:18.975443 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1266/2547] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:35:18.987294 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e159f0-fefa-49b1-a64c-76fdb0813924 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:18.989309 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-94e159f0-fefa-49b1-a64c-76fdb0813924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:19.064392 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e159f0-fefa-49b1-a64c-76fdb0813924 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:19.068588 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe57ee-9c1c-4a2b-9067-3af8a8a01e61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:19.069280 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe57ee-9c1c-4a2b-9067-3af8a8a01e61 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:19.069569 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe57ee-9c1c-4a2b-9067-3af8a8a01e61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:19.069918 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe57ee-9c1c-4a2b-9067-3af8a8a01e61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:19.080524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe57ee-9c1c-4a2b-9067-3af8a8a01e61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:19.082052 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe57ee-9c1c-4a2b-9067-3af8a8a01e61 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:19.092697 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1282/2548] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:35:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:35:19.667661 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e242840-2e2f-46f4-a6ba-977f8d7f755a None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:19.669179 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8e242840-2e2f-46f4-a6ba-977f8d7f755a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:19.697052 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e242840-2e2f-46f4-a6ba-977f8d7f755a None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:19.706710 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266edf7d-bdf7-458f-b397-c84788e98f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:19.706710 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266edf7d-bdf7-458f-b397-c84788e98f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:19.706710 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266edf7d-bdf7-458f-b397-c84788e98f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:19.706710 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266edf7d-bdf7-458f-b397-c84788e98f96 admin admin] PATH_INFO: `/v3/projects/cef343212d7c4112b859318e688c6cf1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:19.707656 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266edf7d-bdf7-458f-b397-c84788e98f96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cef343212d7c4112b859318e688c6cf1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:19.710198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266edf7d-bdf7-458f-b397-c84788e98f96 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:19.715004 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:19.830439 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-266edf7d-bdf7-458f-b397-c84788e98f96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cef343212d7c4112b859318e688c6cf1', 'request_id': 'req-266edf7d-bdf7-458f-b397-c84788e98f96'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:19.838195 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-266edf7d-bdf7-458f-b397-c84788e98f96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cef343212d7c4112b859318e688c6cf1', 'request_id': 'req-266edf7d-bdf7-458f-b397-c84788e98f96'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:19.946097 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-266edf7d-bdf7-458f-b397-c84788e98f96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cef343212d7c4112b859318e688c6cf1', 'request_id': 'req-266edf7d-bdf7-458f-b397-c84788e98f96'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:19.961212 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-266edf7d-bdf7-458f-b397-c84788e98f96 admin admin] The token cache is being invalidate because project cef343212d7c4112b859318e688c6cf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:35:19.961506 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-266edf7d-bdf7-458f-b397-c84788e98f96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:19.962203 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-266edf7d-bdf7-458f-b397-c84788e98f96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:19.963839 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1267/2549] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:35:19 2022] DELETE /identity/v3/projects/cef343212d7c4112b859318e688c6cf1 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:19.967849 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe57ee-9c1c-4a2b-9067-3af8a8a01e61 service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:19.978472 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe57ee-9c1c-4a2b-9067-3af8a8a01e61 service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:20.033938 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d66502-3894-4e6c-9825-e7f632bd609c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:20.034859 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d66502-3894-4e6c-9825-e7f632bd609c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:20.035141 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d66502-3894-4e6c-9825-e7f632bd609c admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:20.035413 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d66502-3894-4e6c-9825-e7f632bd609c admin admin] PATH_INFO: `/v3/users/1946396106934a6b9a111d1c6249100f` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:20.036603 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d66502-3894-4e6c-9825-e7f632bd609c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1946396106934a6b9a111d1c6249100f)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:20.038555 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d66502-3894-4e6c-9825-e7f632bd609c admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:20.275244 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-b7d66502-3894-4e6c-9825-e7f632bd609c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1946396106934a6b9a111d1c6249100f'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:20.340386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-b7d66502-3894-4e6c-9825-e7f632bd609c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1946396106934a6b9a111d1c6249100f'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:20.351937 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-b7d66502-3894-4e6c-9825-e7f632bd609c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1946396106934a6b9a111d1c6249100f'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:20.353117 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-b7d66502-3894-4e6c-9825-e7f632bd609c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1946396106934a6b9a111d1c6249100f'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:20.353600 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-b7d66502-3894-4e6c-9825-e7f632bd609c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1946396106934a6b9a111d1c6249100f'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:20.400444 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1283/2550] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:35:19 2022] DELETE /identity/v3/users/1946396106934a6b9a111d1c6249100f => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:20.977823 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266edf7d-bdf7-458f-b397-c84788e98f96 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:20.979335 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-266edf7d-bdf7-458f-b397-c84788e98f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:21.002888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266edf7d-bdf7-458f-b397-c84788e98f96 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:21.082108 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfee7d3-d260-49af-98ae-a6a74f6b9197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:21.083400 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfee7d3-d260-49af-98ae-a6a74f6b9197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:21.083765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfee7d3-d260-49af-98ae-a6a74f6b9197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:21.084121 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfee7d3-d260-49af-98ae-a6a74f6b9197 admin admin] PATH_INFO: `/v3/projects/996498cfee464aeca010e73d60f0607b` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:21.085423 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfee7d3-d260-49af-98ae-a6a74f6b9197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=996498cfee464aeca010e73d60f0607b)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:21.087524 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfee7d3-d260-49af-98ae-a6a74f6b9197 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:21.271785 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3dfee7d3-d260-49af-98ae-a6a74f6b9197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '996498cfee464aeca010e73d60f0607b', 'request_id': 'req-3dfee7d3-d260-49af-98ae-a6a74f6b9197'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:21.277334 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3dfee7d3-d260-49af-98ae-a6a74f6b9197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '996498cfee464aeca010e73d60f0607b', 'request_id': 'req-3dfee7d3-d260-49af-98ae-a6a74f6b9197'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:21.385804 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3dfee7d3-d260-49af-98ae-a6a74f6b9197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '996498cfee464aeca010e73d60f0607b', 'request_id': 'req-3dfee7d3-d260-49af-98ae-a6a74f6b9197'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:21.404630 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3dfee7d3-d260-49af-98ae-a6a74f6b9197 admin admin] The token cache is being invalidate because project 996498cfee464aeca010e73d60f0607b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:35:21.404801 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3dfee7d3-d260-49af-98ae-a6a74f6b9197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:21.405815 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3dfee7d3-d260-49af-98ae-a6a74f6b9197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:21.408047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1268/2551] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:35:20 2022] DELETE /identity/v3/projects/996498cfee464aeca010e73d60f0607b => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:21.413989 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52116a83-4ecb-4fe8-8a0c-b2e7810e7f7d None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:21.415088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52116a83-4ecb-4fe8-8a0c-b2e7810e7f7d None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:21.415526 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52116a83-4ecb-4fe8-8a0c-b2e7810e7f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:21.440885 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-52116a83-4ecb-4fe8-8a0c-b2e7810e7f7d None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:21.442639 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-52116a83-4ecb-4fe8-8a0c-b2e7810e7f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:21.450630 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:21.537221 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1284/2552] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:35:21.538729 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e3584-3139-4d01-96c9-8a3ea9c7478e None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:21.539022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e3584-3139-4d01-96c9-8a3ea9c7478e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:21.539349 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e3584-3139-4d01-96c9-8a3ea9c7478e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:21.565132 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-608e3584-3139-4d01-96c9-8a3ea9c7478e None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:21.566496 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-608e3584-3139-4d01-96c9-8a3ea9c7478e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:21.575373 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1269/2553] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:35:21.579879 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52116a83-4ecb-4fe8-8a0c-b2e7810e7f7d None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:21.592944 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52116a83-4ecb-4fe8-8a0c-b2e7810e7f7d None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:21.599335 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2662a9-ef0b-4d82-81c9-940793817c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:21.600092 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2662a9-ef0b-4d82-81c9-940793817c9d admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:21.600378 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2662a9-ef0b-4d82-81c9-940793817c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:21.600692 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2662a9-ef0b-4d82-81c9-940793817c9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:21.601470 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2662a9-ef0b-4d82-81c9-940793817c9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:35:21.601903 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2662a9-ef0b-4d82-81c9-940793817c9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:21.603623 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2662a9-ef0b-4d82-81c9-940793817c9d admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:21.617080 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1285/2554] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:35:21.622673 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e3584-3139-4d01-96c9-8a3ea9c7478e None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:21.633596 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e3584-3139-4d01-96c9-8a3ea9c7478e None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:21.645101 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85e4e2-59e8-41cf-ba88-142ddc0deda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:21.645963 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85e4e2-59e8-41cf-ba88-142ddc0deda2 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:21.646515 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85e4e2-59e8-41cf-ba88-142ddc0deda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:21.646979 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85e4e2-59e8-41cf-ba88-142ddc0deda2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:21.651717 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85e4e2-59e8-41cf-ba88-142ddc0deda2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:21.651717 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85e4e2-59e8-41cf-ba88-142ddc0deda2 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:21.671783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:21.774772 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1270/2555] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:35:21 2022] POST /identity/v3/projects => generated 379 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:35:21.780544 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2662a9-ef0b-4d82-81c9-940793817c9d admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:21.791216 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2662a9-ef0b-4d82-81c9-940793817c9d admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:21.859097 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202fa853-cc60-44d0-b0c1-15dbf310e2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:21.860186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fa853-cc60-44d0-b0c1-15dbf310e2a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:21.860186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fa853-cc60-44d0-b0c1-15dbf310e2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:21.860416 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fa853-cc60-44d0-b0c1-15dbf310e2a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:21.861021 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202fa853-cc60-44d0-b0c1-15dbf310e2a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:21.863452 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202fa853-cc60-44d0-b0c1-15dbf310e2a9 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:21.976141 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1286/2556] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:35:21 2022] POST /identity/v3/users => generated 290 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:35:21.980343 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85e4e2-59e8-41cf-ba88-142ddc0deda2 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:21.993017 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85e4e2-59e8-41cf-ba88-142ddc0deda2 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:21.998277 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0bd7e-80a8-43e8-934a-9f4d2d444a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:21.999099 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0bd7e-80a8-43e8-934a-9f4d2d444a8b admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:21.999503 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0bd7e-80a8-43e8-934a-9f4d2d444a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:21.999912 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0bd7e-80a8-43e8-934a-9f4d2d444a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:22.000790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0bd7e-80a8-43e8-934a-9f4d2d444a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:22.003023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0bd7e-80a8-43e8-934a-9f4d2d444a8b admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:22.028307 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1271/2557] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:35:22.032470 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202fa853-cc60-44d0-b0c1-15dbf310e2a9 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:22.057537 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202fa853-cc60-44d0-b0c1-15dbf310e2a9 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:22.068000 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04df71-8698-4159-91c3-dec1db9eb632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:22.068851 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04df71-8698-4159-91c3-dec1db9eb632 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:22.069415 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04df71-8698-4159-91c3-dec1db9eb632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:22.069832 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04df71-8698-4159-91c3-dec1db9eb632 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:22.070631 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc04df71-8698-4159-91c3-dec1db9eb632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:22.072309 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc04df71-8698-4159-91c3-dec1db9eb632 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:22.094347 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1287/2558] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:35:22.095633 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0bd7e-80a8-43e8-934a-9f4d2d444a8b admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:22.110930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0bd7e-80a8-43e8-934a-9f4d2d444a8b admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:22.116517 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cd956-6e0b-4a70-9bc5-cfc284cd6748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:22.122799 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cd956-6e0b-4a70-9bc5-cfc284cd6748 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:22.122799 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cd956-6e0b-4a70-9bc5-cfc284cd6748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:22.122799 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cd956-6e0b-4a70-9bc5-cfc284cd6748 admin admin] PATH_INFO: `/v3/projects/9d438d9544564c1cb63bc5653856d7a7/users/97d10e6351a1486baf5f6d7b79a885c3/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:22.136499 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2cd956-6e0b-4a70-9bc5-cfc284cd6748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d438d9544564c1cb63bc5653856d7a7, user_id=97d10e6351a1486baf5f6d7b79a885c3, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:22.140903 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2cd956-6e0b-4a70-9bc5-cfc284cd6748 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:22.227841 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1272/2559] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:35:22 2022] PUT /identity/v3/projects/9d438d9544564c1cb63bc5653856d7a7/users/97d10e6351a1486baf5f6d7b79a885c3/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:22.239297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84209464-60ca-419b-a360-c34498c61ff5 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:22.239601 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84209464-60ca-419b-a360-c34498c61ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:22.239885 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84209464-60ca-419b-a360-c34498c61ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:22.304702 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-84209464-60ca-419b-a360-c34498c61ff5 None None] MFA Rules not processed for user `97d10e6351a1486baf5f6d7b79a885c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:22.306933 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-84209464-60ca-419b-a360-c34498c61ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:22.427806 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1288/2560] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:35:22.429176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cd956-6e0b-4a70-9bc5-cfc284cd6748 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:22.451541 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3ee65-72a0-4de9-b6e9-950d52542252 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:22.451839 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3ee65-72a0-4de9-b6e9-950d52542252 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:22.452293 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3ee65-72a0-4de9-b6e9-950d52542252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:22.464689 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:22.496687 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-e1a3ee65-72a0-4de9-b6e9-950d52542252 None None] MFA Rules not processed for user `2733d9f38efb4e848ea47a40d080ddf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:22.498065 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-e1a3ee65-72a0-4de9-b6e9-950d52542252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:22.542616 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cd956-6e0b-4a70-9bc5-cfc284cd6748 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:22.548077 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620193e5-d303-41f5-89dc-771c92943659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:22.548848 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620193e5-d303-41f5-89dc-771c92943659 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:22.549205 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620193e5-d303-41f5-89dc-771c92943659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:22.549548 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620193e5-d303-41f5-89dc-771c92943659 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:22.551180 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620193e5-d303-41f5-89dc-771c92943659 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:22.553508 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620193e5-d303-41f5-89dc-771c92943659 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:22.591534 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1289/2561] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:22 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:35:22.607709 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3ee65-72a0-4de9-b6e9-950d52542252 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:22.609337 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-e1a3ee65-72a0-4de9-b6e9-950d52542252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:22.669123 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1273/2562] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:35:22 2022] POST /identity/v3/projects => generated 381 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:35:22.673422 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620193e5-d303-41f5-89dc-771c92943659 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:22.696757 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3ee65-72a0-4de9-b6e9-950d52542252 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:22.773935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620193e5-d303-41f5-89dc-771c92943659 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:22.779493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28032fc1-af77-4ebb-83ec-ad19ec41c227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:22.782183 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28032fc1-af77-4ebb-83ec-ad19ec41c227 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:22.782183 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28032fc1-af77-4ebb-83ec-ad19ec41c227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:22.782183 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28032fc1-af77-4ebb-83ec-ad19ec41c227 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:22.782448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28032fc1-af77-4ebb-83ec-ad19ec41c227 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:22.785175 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28032fc1-af77-4ebb-83ec-ad19ec41c227 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:22.794652 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19ebc7-f099-4559-ab91-d7093fec5ca1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:22.795434 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19ebc7-f099-4559-ab91-d7093fec5ca1 service nova] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:22.795913 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19ebc7-f099-4559-ab91-d7093fec5ca1 service nova] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:22.796048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19ebc7-f099-4559-ab91-d7093fec5ca1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:22.799119 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-4e19ebc7-f099-4559-ab91-d7093fec5ca1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:22.827771 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:22.871518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19ebc7-f099-4559-ab91-d7093fec5ca1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:22.873137 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19ebc7-f099-4559-ab91-d7093fec5ca1 service nova] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:22.882913 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1290/2563] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:35:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:35:22.924056 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1274/2564] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:35:22 2022] POST /identity/v3/users => generated 297 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:35:22.928128 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19ebc7-f099-4559-ab91-d7093fec5ca1 service nova] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:22.938586 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19ebc7-f099-4559-ab91-d7093fec5ca1 service nova] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:22.943713 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef1a7b-8132-4365-a188-8bb7b3294ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:22.944375 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef1a7b-8132-4365-a188-8bb7b3294ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:22.944658 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef1a7b-8132-4365-a188-8bb7b3294ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:22.944935 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef1a7b-8132-4365-a188-8bb7b3294ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:22.945693 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef1a7b-8132-4365-a188-8bb7b3294ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:22.947315 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef1a7b-8132-4365-a188-8bb7b3294ae1 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:22.958503 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1291/2565] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:35:22.962718 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28032fc1-af77-4ebb-83ec-ad19ec41c227 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:22.973540 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28032fc1-af77-4ebb-83ec-ad19ec41c227 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:22.978283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743c3dc-04bf-4c63-84cb-aaff3cd1240d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:22.979166 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743c3dc-04bf-4c63-84cb-aaff3cd1240d admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:23.016272 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743c3dc-04bf-4c63-84cb-aaff3cd1240d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:23.016272 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743c3dc-04bf-4c63-84cb-aaff3cd1240d admin admin] PATH_INFO: `/v3/projects/2e9d48d95bba4c3f80a59c724c16a96b/users/69cc416ebf564bf7b9204f596f2efbd8/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:23.016272 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743c3dc-04bf-4c63-84cb-aaff3cd1240d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e9d48d95bba4c3f80a59c724c16a96b, user_id=69cc416ebf564bf7b9204f596f2efbd8, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:23.016272 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743c3dc-04bf-4c63-84cb-aaff3cd1240d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:23.111435 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1275/2566] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:35:22 2022] PUT /identity/v3/projects/2e9d48d95bba4c3f80a59c724c16a96b/users/69cc416ebf564bf7b9204f596f2efbd8/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:23.118671 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef1a7b-8132-4365-a188-8bb7b3294ae1 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:23.128909 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef1a7b-8132-4365-a188-8bb7b3294ae1 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:23.185462 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a46a3-49dc-4c8d-873e-c63d3efec8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:23.186165 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a46a3-49dc-4c8d-873e-c63d3efec8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:23.186458 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a46a3-49dc-4c8d-873e-c63d3efec8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:23.186737 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a46a3-49dc-4c8d-873e-c63d3efec8b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:23.187474 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a46a3-49dc-4c8d-873e-c63d3efec8b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:23.189208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a46a3-49dc-4c8d-873e-c63d3efec8b8 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:23.200895 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1292/2567] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:35:23.204913 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743c3dc-04bf-4c63-84cb-aaff3cd1240d admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:23.216533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743c3dc-04bf-4c63-84cb-aaff3cd1240d admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:23.221422 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232dab3e-2b40-4211-b3d1-8ac827f41cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:23.222418 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dab3e-2b40-4211-b3d1-8ac827f41cd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:23.222706 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dab3e-2b40-4211-b3d1-8ac827f41cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:23.223016 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dab3e-2b40-4211-b3d1-8ac827f41cd5 admin admin] PATH_INFO: `/v3/projects/2e9d48d95bba4c3f80a59c724c16a96b/users/69cc416ebf564bf7b9204f596f2efbd8/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:23.226979 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232dab3e-2b40-4211-b3d1-8ac827f41cd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e9d48d95bba4c3f80a59c724c16a96b, user_id=69cc416ebf564bf7b9204f596f2efbd8, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:23.229882 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232dab3e-2b40-4211-b3d1-8ac827f41cd5 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:23.233627 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:23.253821 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1276/2568] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:35:23 2022] PUT /identity/v3/projects/2e9d48d95bba4c3f80a59c724c16a96b/users/69cc416ebf564bf7b9204f596f2efbd8/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:23.262609 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e26ff-e3d4-4abd-acbb-ba13e5a3cbd9 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:23.262908 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e26ff-e3d4-4abd-acbb-ba13e5a3cbd9 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:23.263188 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e26ff-e3d4-4abd-acbb-ba13e5a3cbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:23.296918 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-b11e26ff-e3d4-4abd-acbb-ba13e5a3cbd9 None None] MFA Rules not processed for user `69cc416ebf564bf7b9204f596f2efbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:23.298251 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-b11e26ff-e3d4-4abd-acbb-ba13e5a3cbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:23.378708 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1293/2569] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:35:23.391955 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232dab3e-2b40-4211-b3d1-8ac827f41cd5 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:23.394730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-232dab3e-2b40-4211-b3d1-8ac827f41cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:23.465590 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232dab3e-2b40-4211-b3d1-8ac827f41cd5 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:23.469588 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43d6f9-b10e-4463-a78f-a48a11a9fafe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:23.470392 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43d6f9-b10e-4463-a78f-a48a11a9fafe service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:23.470736 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43d6f9-b10e-4463-a78f-a48a11a9fafe service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:23.471198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43d6f9-b10e-4463-a78f-a48a11a9fafe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:23.481990 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe43d6f9-b10e-4463-a78f-a48a11a9fafe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:23.486252 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe43d6f9-b10e-4463-a78f-a48a11a9fafe service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:23.497681 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1277/2570] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:35:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:35:24.725428 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e26ff-e3d4-4abd-acbb-ba13e5a3cbd9 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:24.736432 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e26ff-e3d4-4abd-acbb-ba13e5a3cbd9 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:24.742788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2524d0-f637-4f12-bd28-b1392834e946 tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69cc416ebf564bf7b9204f596f2efbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e9d48d95bba4c3f80a59c724c16a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:24.743543 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2524d0-f637-4f12-bd28-b1392834e946 tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:24.743994 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2524d0-f637-4f12-bd28-b1392834e946 tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:24.744116 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2524d0-f637-4f12-bd28-b1392834e946 tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:24.744857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2524d0-f637-4f12-bd28-b1392834e946 tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:35:24.745174 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2524d0-f637-4f12-bd28-b1392834e946 tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:24.746835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2524d0-f637-4f12-bd28-b1392834e946 tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:24.759963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1294/2571] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:35:24.768449 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43d6f9-b10e-4463-a78f-a48a11a9fafe service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:24.780397 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43d6f9-b10e-4463-a78f-a48a11a9fafe service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:24.788910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca24a2-7755-4416-8fde-9bb292bf6afc tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69cc416ebf564bf7b9204f596f2efbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e9d48d95bba4c3f80a59c724c16a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:24.790537 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca24a2-7755-4416-8fde-9bb292bf6afc tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:24.790668 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca24a2-7755-4416-8fde-9bb292bf6afc tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:24.791001 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca24a2-7755-4416-8fde-9bb292bf6afc tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:24.791737 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca24a2-7755-4416-8fde-9bb292bf6afc tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:24.793740 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca24a2-7755-4416-8fde-9bb292bf6afc tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:24.909988 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1278/2572] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:35:24 2022] POST /identity/v3/projects => generated 355 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:35:24.912638 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2524d0-f637-4f12-bd28-b1392834e946 tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:24.922792 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2524d0-f637-4f12-bd28-b1392834e946 tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:24.945341 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=100 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:24.991924 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f718c3-c99a-4de8-b991-b8c295393b85 tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69cc416ebf564bf7b9204f596f2efbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e9d48d95bba4c3f80a59c724c16a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:24.992672 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f718c3-c99a-4de8-b991-b8c295393b85 tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:24.993030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f718c3-c99a-4de8-b991-b8c295393b85 tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:24.993511 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f718c3-c99a-4de8-b991-b8c295393b85 tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:24.994354 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f718c3-c99a-4de8-b991-b8c295393b85 tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:35:24.994674 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f718c3-c99a-4de8-b991-b8c295393b85 tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:24.996981 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f718c3-c99a-4de8-b991-b8c295393b85 tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:25.024709 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1295/2573] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:35:25.073052 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca24a2-7755-4416-8fde-9bb292bf6afc tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:25.086373 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca24a2-7755-4416-8fde-9bb292bf6afc tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:25.093589 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d701ca-c780-4435-a9ad-c703327d1408 tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69cc416ebf564bf7b9204f596f2efbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e9d48d95bba4c3f80a59c724c16a96b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:25.094710 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d701ca-c780-4435-a9ad-c703327d1408 tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:25.095161 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d701ca-c780-4435-a9ad-c703327d1408 tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:25.095616 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d701ca-c780-4435-a9ad-c703327d1408 tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] PATH_INFO: `/v3/projects/d0f8691b67364628a617e0bfaaf0386c` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:25.097850 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d701ca-c780-4435-a9ad-c703327d1408 tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d0f8691b67364628a617e0bfaaf0386c)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:25.099889 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d701ca-c780-4435-a9ad-c703327d1408 tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:25.241650 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-29d701ca-c780-4435-a9ad-c703327d1408 tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0f8691b67364628a617e0bfaaf0386c', 'request_id': 'req-29d701ca-c780-4435-a9ad-c703327d1408'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:25.248381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-29d701ca-c780-4435-a9ad-c703327d1408 tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0f8691b67364628a617e0bfaaf0386c', 'request_id': 'req-29d701ca-c780-4435-a9ad-c703327d1408'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:25.328049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-29d701ca-c780-4435-a9ad-c703327d1408 tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0f8691b67364628a617e0bfaaf0386c', 'request_id': 'req-29d701ca-c780-4435-a9ad-c703327d1408'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:25.342682 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-29d701ca-c780-4435-a9ad-c703327d1408 tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] The token cache is being invalidate because project d0f8691b67364628a617e0bfaaf0386c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:35:25.343098 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-29d701ca-c780-4435-a9ad-c703327d1408 tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:25.343958 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-29d701ca-c780-4435-a9ad-c703327d1408 tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:25.346743 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1279/2574] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:35:25 2022] DELETE /identity/v3/projects/d0f8691b67364628a617e0bfaaf0386c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:35:26.213650 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f718c3-c99a-4de8-b991-b8c295393b85 tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:26.215693 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-b0f718c3-c99a-4de8-b991-b8c295393b85 tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:26.302223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f718c3-c99a-4de8-b991-b8c295393b85 tempest-VolumeQuotaClassesTest-1347809823 tempest-VolumeQuotaClassesTest-1347809823-project-admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:26.394859 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27e96b-2870-494c-a658-0615af74e5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:26.396018 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27e96b-2870-494c-a658-0615af74e5d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:26.396340 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27e96b-2870-494c-a658-0615af74e5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:26.396616 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27e96b-2870-494c-a658-0615af74e5d6 admin admin] PATH_INFO: `/v3/users/97d10e6351a1486baf5f6d7b79a885c3` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:26.398119 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c27e96b-2870-494c-a658-0615af74e5d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97d10e6351a1486baf5f6d7b79a885c3)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:26.401622 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c27e96b-2870-494c-a658-0615af74e5d6 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:26.468075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efb1e7-9fc8-42b4-b56a-be868dfdd5b3 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:26.468670 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efb1e7-9fc8-42b4-b56a-be868dfdd5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:26.468670 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efb1e7-9fc8-42b4-b56a-be868dfdd5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:26.491683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-96efb1e7-9fc8-42b4-b56a-be868dfdd5b3 None None] MFA Rules not processed for user `9450c339800248feb9f487804473a59b`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:26.493248 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-96efb1e7-9fc8-42b4-b56a-be868dfdd5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:26.567976 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1280/2575] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:35:26.601168 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-2c27e96b-2870-494c-a658-0615af74e5d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97d10e6351a1486baf5f6d7b79a885c3'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:26.684624 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-2c27e96b-2870-494c-a658-0615af74e5d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97d10e6351a1486baf5f6d7b79a885c3'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:26.697755 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-2c27e96b-2870-494c-a658-0615af74e5d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97d10e6351a1486baf5f6d7b79a885c3'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:26.699261 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-2c27e96b-2870-494c-a658-0615af74e5d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97d10e6351a1486baf5f6d7b79a885c3'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:26.699938 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-2c27e96b-2870-494c-a658-0615af74e5d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97d10e6351a1486baf5f6d7b79a885c3'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:26.703027 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:26.721582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1296/2576] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:35:26 2022] DELETE /identity/v3/users/97d10e6351a1486baf5f6d7b79a885c3 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:26.726108 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcaf16-bf6b-42f8-8948-e9b34f595028 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:26.726429 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcaf16-bf6b-42f8-8948-e9b34f595028 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:26.726770 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcaf16-bf6b-42f8-8948-e9b34f595028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:26.734798 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:26.751477 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-84dcaf16-bf6b-42f8-8948-e9b34f595028 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:26.752745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-84dcaf16-bf6b-42f8-8948-e9b34f595028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:26.855370 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1281/2577] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:35:26.872679 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27e96b-2870-494c-a658-0615af74e5d6 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:26.874176 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-2c27e96b-2870-494c-a658-0615af74e5d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:26.959910 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27e96b-2870-494c-a658-0615af74e5d6 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:26.966522 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337381c-d37e-438f-8ea3-38f54a343e50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:26.972014 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337381c-d37e-438f-8ea3-38f54a343e50 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:26.972014 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337381c-d37e-438f-8ea3-38f54a343e50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:26.972014 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337381c-d37e-438f-8ea3-38f54a343e50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:26.979426 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337381c-d37e-438f-8ea3-38f54a343e50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:26.980795 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337381c-d37e-438f-8ea3-38f54a343e50 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:26.994944 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1297/2578] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:35:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:35:27.484551 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dcaf16-bf6b-42f8-8948-e9b34f595028 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:27.486314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-84dcaf16-bf6b-42f8-8948-e9b34f595028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:27.505962 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dcaf16-bf6b-42f8-8948-e9b34f595028 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:27.510790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc2077-0427-4d23-b57e-07e2125fd93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:27.516804 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc2077-0427-4d23-b57e-07e2125fd93f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:27.516804 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc2077-0427-4d23-b57e-07e2125fd93f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:27.516804 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc2077-0427-4d23-b57e-07e2125fd93f admin admin] PATH_INFO: `/v3/projects/9d438d9544564c1cb63bc5653856d7a7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:27.516804 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc2077-0427-4d23-b57e-07e2125fd93f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d438d9544564c1cb63bc5653856d7a7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:27.516804 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc2077-0427-4d23-b57e-07e2125fd93f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:27.645382 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c8bc2077-0427-4d23-b57e-07e2125fd93f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d438d9544564c1cb63bc5653856d7a7', 'request_id': 'req-c8bc2077-0427-4d23-b57e-07e2125fd93f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:27.651092 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c8bc2077-0427-4d23-b57e-07e2125fd93f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d438d9544564c1cb63bc5653856d7a7', 'request_id': 'req-c8bc2077-0427-4d23-b57e-07e2125fd93f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:27.750784 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c8bc2077-0427-4d23-b57e-07e2125fd93f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d438d9544564c1cb63bc5653856d7a7', 'request_id': 'req-c8bc2077-0427-4d23-b57e-07e2125fd93f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:27.762586 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c8bc2077-0427-4d23-b57e-07e2125fd93f admin admin] The token cache is being invalidate because project 9d438d9544564c1cb63bc5653856d7a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:35:27.762889 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c8bc2077-0427-4d23-b57e-07e2125fd93f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:27.763699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c8bc2077-0427-4d23-b57e-07e2125fd93f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:27.765252 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1282/2579] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:35:27 2022] DELETE /identity/v3/projects/9d438d9544564c1cb63bc5653856d7a7 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:27.769938 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337381c-d37e-438f-8ea3-38f54a343e50 service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:27.779501 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337381c-d37e-438f-8ea3-38f54a343e50 service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:27.841163 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405dc37-7685-4161-85a6-6c0b84daa520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:27.842064 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405dc37-7685-4161-85a6-6c0b84daa520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:27.842346 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405dc37-7685-4161-85a6-6c0b84daa520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:27.842618 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405dc37-7685-4161-85a6-6c0b84daa520 admin admin] PATH_INFO: `/v3/users/69cc416ebf564bf7b9204f596f2efbd8` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:27.843797 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405dc37-7685-4161-85a6-6c0b84daa520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69cc416ebf564bf7b9204f596f2efbd8)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:27.845716 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405dc37-7685-4161-85a6-6c0b84daa520 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:28.171050 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-d405dc37-7685-4161-85a6-6c0b84daa520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69cc416ebf564bf7b9204f596f2efbd8'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:28.276938 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-d405dc37-7685-4161-85a6-6c0b84daa520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69cc416ebf564bf7b9204f596f2efbd8'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:28.284592 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-d405dc37-7685-4161-85a6-6c0b84daa520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69cc416ebf564bf7b9204f596f2efbd8'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:28.285290 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-d405dc37-7685-4161-85a6-6c0b84daa520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69cc416ebf564bf7b9204f596f2efbd8'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:28.286438 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-d405dc37-7685-4161-85a6-6c0b84daa520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69cc416ebf564bf7b9204f596f2efbd8'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:28.304013 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1298/2580] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:35:27 2022] DELETE /identity/v3/users/69cc416ebf564bf7b9204f596f2efbd8 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:28.817124 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc2077-0427-4d23-b57e-07e2125fd93f admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:28.822965 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c8bc2077-0427-4d23-b57e-07e2125fd93f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:28.845641 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc2077-0427-4d23-b57e-07e2125fd93f admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:28.941252 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c159aa-a6a3-4e93-b5ed-fff942b9c5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:28.943653 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c159aa-a6a3-4e93-b5ed-fff942b9c5fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:28.943943 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c159aa-a6a3-4e93-b5ed-fff942b9c5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:28.944227 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c159aa-a6a3-4e93-b5ed-fff942b9c5fc admin admin] PATH_INFO: `/v3/projects/2e9d48d95bba4c3f80a59c724c16a96b` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:28.945689 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c159aa-a6a3-4e93-b5ed-fff942b9c5fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e9d48d95bba4c3f80a59c724c16a96b)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:28.953393 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c159aa-a6a3-4e93-b5ed-fff942b9c5fc admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:29.095245 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:29.109633 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-68c159aa-a6a3-4e93-b5ed-fff942b9c5fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e9d48d95bba4c3f80a59c724c16a96b', 'request_id': 'req-68c159aa-a6a3-4e93-b5ed-fff942b9c5fc'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:29.119573 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-68c159aa-a6a3-4e93-b5ed-fff942b9c5fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e9d48d95bba4c3f80a59c724c16a96b', 'request_id': 'req-68c159aa-a6a3-4e93-b5ed-fff942b9c5fc'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:29.196380 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-68c159aa-a6a3-4e93-b5ed-fff942b9c5fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e9d48d95bba4c3f80a59c724c16a96b', 'request_id': 'req-68c159aa-a6a3-4e93-b5ed-fff942b9c5fc'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:29.208749 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-68c159aa-a6a3-4e93-b5ed-fff942b9c5fc admin admin] The token cache is being invalidate because project 2e9d48d95bba4c3f80a59c724c16a96b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:35:29.209175 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-68c159aa-a6a3-4e93-b5ed-fff942b9c5fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:29.209938 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-68c159aa-a6a3-4e93-b5ed-fff942b9c5fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:29.211574 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1283/2581] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:35:28 2022] DELETE /identity/v3/projects/2e9d48d95bba4c3f80a59c724c16a96b => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:35:29.216624 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29043a-3b5e-4595-815e-6272f01490cf None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:29.217138 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29043a-3b5e-4595-815e-6272f01490cf None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:29.217227 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29043a-3b5e-4595-815e-6272f01490cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:29.228628 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:29.242019 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-3f29043a-3b5e-4595-815e-6272f01490cf None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:29.243026 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-3f29043a-3b5e-4595-815e-6272f01490cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:29.307283 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1299/2582] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:35:29.314971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c2415-486a-4351-b2e5-cefb24e4bfc6 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:29.315266 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c2415-486a-4351-b2e5-cefb24e4bfc6 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:29.315557 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c2415-486a-4351-b2e5-cefb24e4bfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:29.334596 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-008c2415-486a-4351-b2e5-cefb24e4bfc6 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:29.335816 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-008c2415-486a-4351-b2e5-cefb24e4bfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:29.345800 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1284/2583] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:35:29.350642 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f29043a-3b5e-4595-815e-6272f01490cf None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:29.360849 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f29043a-3b5e-4595-815e-6272f01490cf None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:29.366357 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f7f0d-228f-4e97-82a2-b5790dc14e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:29.367048 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f7f0d-228f-4e97-82a2-b5790dc14e8f admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:29.367361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f7f0d-228f-4e97-82a2-b5790dc14e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:29.367669 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f7f0d-228f-4e97-82a2-b5790dc14e8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:29.368418 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f7f0d-228f-4e97-82a2-b5790dc14e8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:35:29.368710 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f7f0d-228f-4e97-82a2-b5790dc14e8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:29.370406 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f7f0d-228f-4e97-82a2-b5790dc14e8f admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:29.385887 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1300/2584] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:35:29.387523 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c2415-486a-4351-b2e5-cefb24e4bfc6 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:29.397968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c2415-486a-4351-b2e5-cefb24e4bfc6 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:29.403473 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b91d74-ab03-4d0b-b1de-b88c83b9a16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:29.404155 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b91d74-ab03-4d0b-b1de-b88c83b9a16b admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:29.404439 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b91d74-ab03-4d0b-b1de-b88c83b9a16b admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:29.404715 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b91d74-ab03-4d0b-b1de-b88c83b9a16b admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:29.405521 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b91d74-ab03-4d0b-b1de-b88c83b9a16b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:29.407474 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b91d74-ab03-4d0b-b1de-b88c83b9a16b admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:29.513699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1285/2585] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:35:29 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:35:29.517779 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f7f0d-228f-4e97-82a2-b5790dc14e8f admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:29.528441 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f7f0d-228f-4e97-82a2-b5790dc14e8f admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:29.587938 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80310a86-1841-4591-a280-ace1c8ce19d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:29.588615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80310a86-1841-4591-a280-ace1c8ce19d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:29.588900 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80310a86-1841-4591-a280-ace1c8ce19d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:29.589240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80310a86-1841-4591-a280-ace1c8ce19d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:29.589999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80310a86-1841-4591-a280-ace1c8ce19d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:29.592667 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80310a86-1841-4591-a280-ace1c8ce19d9 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:29.698065 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1301/2586] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:35:29 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:35:29.698884 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b91d74-ab03-4d0b-b1de-b88c83b9a16b admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:29.718052 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b91d74-ab03-4d0b-b1de-b88c83b9a16b admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:29.723686 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c1ba6-5abb-43fd-9001-de391d637f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:29.728649 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c1ba6-5abb-43fd-9001-de391d637f2c admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:29.728649 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c1ba6-5abb-43fd-9001-de391d637f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:29.728649 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c1ba6-5abb-43fd-9001-de391d637f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:29.728649 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c1ba6-5abb-43fd-9001-de391d637f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:29.728649 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c1ba6-5abb-43fd-9001-de391d637f2c admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:29.740733 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1286/2587] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:35:29.744915 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80310a86-1841-4591-a280-ace1c8ce19d9 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:29.755336 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80310a86-1841-4591-a280-ace1c8ce19d9 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:29.760073 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334adee-8c96-45c9-8b24-b3af37593786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:29.760760 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334adee-8c96-45c9-8b24-b3af37593786 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:29.761072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334adee-8c96-45c9-8b24-b3af37593786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:29.761351 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334adee-8c96-45c9-8b24-b3af37593786 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:29.762126 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334adee-8c96-45c9-8b24-b3af37593786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:29.763737 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334adee-8c96-45c9-8b24-b3af37593786 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:29.775141 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1302/2588] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:35:29.779882 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c1ba6-5abb-43fd-9001-de391d637f2c admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:29.792238 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c1ba6-5abb-43fd-9001-de391d637f2c admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:29.797035 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f82852-48d2-4e5b-81d6-5be5a12fbb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:29.798002 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f82852-48d2-4e5b-81d6-5be5a12fbb8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:29.798287 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f82852-48d2-4e5b-81d6-5be5a12fbb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:29.798570 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f82852-48d2-4e5b-81d6-5be5a12fbb8a admin admin] PATH_INFO: `/v3/projects/aca58fdd0cb3472ea6a0606801dc3982/users/f795a2e25bdd4b42b2875980f20e8403/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:29.814001 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f82852-48d2-4e5b-81d6-5be5a12fbb8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aca58fdd0cb3472ea6a0606801dc3982, user_id=f795a2e25bdd4b42b2875980f20e8403, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:29.816631 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f82852-48d2-4e5b-81d6-5be5a12fbb8a admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:29.912051 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1287/2589] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:35:29 2022] PUT /identity/v3/projects/aca58fdd0cb3472ea6a0606801dc3982/users/f795a2e25bdd4b42b2875980f20e8403/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:29.923524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b28b5a-d5f8-4169-b2ae-6913b85190bf None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:29.927697 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b28b5a-d5f8-4169-b2ae-6913b85190bf None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:29.927697 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b28b5a-d5f8-4169-b2ae-6913b85190bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:29.956734 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-70b28b5a-d5f8-4169-b2ae-6913b85190bf None None] MFA Rules not processed for user `f795a2e25bdd4b42b2875980f20e8403`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:29.958901 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-70b28b5a-d5f8-4169-b2ae-6913b85190bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:30.020368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:30.024438 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1303/2590] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:35:30.035580 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f82852-48d2-4e5b-81d6-5be5a12fbb8a admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:30.037461 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-90f82852-48d2-4e5b-81d6-5be5a12fbb8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:30.096154 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f82852-48d2-4e5b-81d6-5be5a12fbb8a admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:30.100347 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fec784-bd7a-42e4-bf25-fae5e8a5e5d5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a2d8d24562459493a3bcd399665a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:30.101126 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fec784-bd7a-42e4-bf25-fae5e8a5e5d5 service glance] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:30.101528 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fec784-bd7a-42e4-bf25-fae5e8a5e5d5 service glance] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:30.101939 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fec784-bd7a-42e4-bf25-fae5e8a5e5d5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:30.111398 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fec784-bd7a-42e4-bf25-fae5e8a5e5d5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:30.113240 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fec784-bd7a-42e4-bf25-fae5e8a5e5d5 service glance] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:30.122319 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1288/2591] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:35:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:35:32.406539 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b28b5a-d5f8-4169-b2ae-6913b85190bf None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:32.407935 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-70b28b5a-d5f8-4169-b2ae-6913b85190bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:32.466892 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b28b5a-d5f8-4169-b2ae-6913b85190bf None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:32.470445 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b5465-0364-422a-bc4c-6765e65d3c12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:32.471088 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b5465-0364-422a-bc4c-6765e65d3c12 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:32.471376 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b5465-0364-422a-bc4c-6765e65d3c12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:32.471655 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b5465-0364-422a-bc4c-6765e65d3c12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:32.473429 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-2e0b5465-0364-422a-bc4c-6765e65d3c12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:32.538879 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b5465-0364-422a-bc4c-6765e65d3c12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:32.540361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b5465-0364-422a-bc4c-6765e65d3c12 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:32.550293 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1304/2592] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:35:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:35:35.990486 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fec784-bd7a-42e4-bf25-fae5e8a5e5d5 service glance] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:35.993250 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-30fec784-bd7a-42e4-bf25-fae5e8a5e5d5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:36.011932 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fec784-bd7a-42e4-bf25-fae5e8a5e5d5 service glance] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:36.016818 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a0738-3ed5-4e11-b1a0-58dca1ff0f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:36.017703 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a0738-3ed5-4e11-b1a0-58dca1ff0f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:36.018028 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a0738-3ed5-4e11-b1a0-58dca1ff0f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:36.018314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a0738-3ed5-4e11-b1a0-58dca1ff0f13 admin admin] PATH_INFO: `/v3/users/0cbaec8b28f9449dab0d5175c8034f50` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:36.019527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a0738-3ed5-4e11-b1a0-58dca1ff0f13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cbaec8b28f9449dab0d5175c8034f50)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:36.021608 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a0738-3ed5-4e11-b1a0-58dca1ff0f13 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:36.370402 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6f3a0738-3ed5-4e11-b1a0-58dca1ff0f13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cbaec8b28f9449dab0d5175c8034f50'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:36.370996 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6f3a0738-3ed5-4e11-b1a0-58dca1ff0f13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cbaec8b28f9449dab0d5175c8034f50'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:36.375710 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:36.378572 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6f3a0738-3ed5-4e11-b1a0-58dca1ff0f13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cbaec8b28f9449dab0d5175c8034f50'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:36.482601 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6f3a0738-3ed5-4e11-b1a0-58dca1ff0f13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cbaec8b28f9449dab0d5175c8034f50'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:36.497103 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6f3a0738-3ed5-4e11-b1a0-58dca1ff0f13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cbaec8b28f9449dab0d5175c8034f50'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:36.503257 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1289/2593] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:35:35 2022] DELETE /identity/v3/users/0cbaec8b28f9449dab0d5175c8034f50 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:36.758734 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b5465-0364-422a-bc4c-6765e65d3c12 service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:36.775481 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b5465-0364-422a-bc4c-6765e65d3c12 service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:36.838175 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47fc655-d4b1-4d9d-95cc-f7f117dca3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:36.839042 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fc655-d4b1-4d9d-95cc-f7f117dca3ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:36.839332 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fc655-d4b1-4d9d-95cc-f7f117dca3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:36.839614 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fc655-d4b1-4d9d-95cc-f7f117dca3ca admin admin] PATH_INFO: `/v3/projects/885f9405fd4b4b429e5f34b9d8c269e3` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:36.840913 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47fc655-d4b1-4d9d-95cc-f7f117dca3ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=885f9405fd4b4b429e5f34b9d8c269e3)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:36.842871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47fc655-d4b1-4d9d-95cc-f7f117dca3ca admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:36.940079 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e47fc655-d4b1-4d9d-95cc-f7f117dca3ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '885f9405fd4b4b429e5f34b9d8c269e3', 'request_id': 'req-e47fc655-d4b1-4d9d-95cc-f7f117dca3ca'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:36.943146 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:37.037084 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e47fc655-d4b1-4d9d-95cc-f7f117dca3ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '885f9405fd4b4b429e5f34b9d8c269e3', 'request_id': 'req-e47fc655-d4b1-4d9d-95cc-f7f117dca3ca'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:37.047818 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e47fc655-d4b1-4d9d-95cc-f7f117dca3ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '885f9405fd4b4b429e5f34b9d8c269e3', 'request_id': 'req-e47fc655-d4b1-4d9d-95cc-f7f117dca3ca'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:37.059808 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e47fc655-d4b1-4d9d-95cc-f7f117dca3ca admin admin] The token cache is being invalidate because project 885f9405fd4b4b429e5f34b9d8c269e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:35:37.061253 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e47fc655-d4b1-4d9d-95cc-f7f117dca3ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:37.061253 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e47fc655-d4b1-4d9d-95cc-f7f117dca3ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:37.062334 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1305/2594] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:35:36 2022] DELETE /identity/v3/projects/885f9405fd4b4b429e5f34b9d8c269e3 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:37.067574 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a317aa-6ee3-4031-af5e-995e718ccf4e None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:37.068168 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a317aa-6ee3-4031-af5e-995e718ccf4e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:37.068331 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a317aa-6ee3-4031-af5e-995e718ccf4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:37.089145 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-32a317aa-6ee3-4031-af5e-995e718ccf4e None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:37.090426 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-32a317aa-6ee3-4031-af5e-995e718ccf4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:37.152748 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1290/2595] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:35:37.160706 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee9b03-ba46-40f3-bec9-b85fa3e1da47 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:37.160997 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee9b03-ba46-40f3-bec9-b85fa3e1da47 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:37.162188 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee9b03-ba46-40f3-bec9-b85fa3e1da47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:37.181543 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-f6ee9b03-ba46-40f3-bec9-b85fa3e1da47 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:37.182787 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-f6ee9b03-ba46-40f3-bec9-b85fa3e1da47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:37.190947 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1306/2596] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:35:37.195441 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a317aa-6ee3-4031-af5e-995e718ccf4e None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:37.205220 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a317aa-6ee3-4031-af5e-995e718ccf4e None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:37.210615 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7a706-7dc9-4f0d-ac3d-311fccde54ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:37.211270 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7a706-7dc9-4f0d-ac3d-311fccde54ec admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:37.211553 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7a706-7dc9-4f0d-ac3d-311fccde54ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:37.211829 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7a706-7dc9-4f0d-ac3d-311fccde54ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:37.212556 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7a706-7dc9-4f0d-ac3d-311fccde54ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:35:37.212867 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7a706-7dc9-4f0d-ac3d-311fccde54ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:37.214494 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7a706-7dc9-4f0d-ac3d-311fccde54ec admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:37.226505 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1291/2597] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:35:37.230893 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee9b03-ba46-40f3-bec9-b85fa3e1da47 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:37.240349 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee9b03-ba46-40f3-bec9-b85fa3e1da47 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:37.245043 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acaf864-a85b-4124-91cb-b7a3cfdd3d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:37.245690 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acaf864-a85b-4124-91cb-b7a3cfdd3d8b admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:37.246029 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acaf864-a85b-4124-91cb-b7a3cfdd3d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:37.246304 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acaf864-a85b-4124-91cb-b7a3cfdd3d8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:37.247203 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acaf864-a85b-4124-91cb-b7a3cfdd3d8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:37.248873 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acaf864-a85b-4124-91cb-b7a3cfdd3d8b admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:37.369613 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1307/2598] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:35:37 2022] POST /identity/v3/projects => generated 383 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:35:37.373820 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7a706-7dc9-4f0d-ac3d-311fccde54ec admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:37.384472 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7a706-7dc9-4f0d-ac3d-311fccde54ec admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:37.444454 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4757c45-6b48-42d1-88fb-00861d81960b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:37.445040 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4757c45-6b48-42d1-88fb-00861d81960b admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:37.445328 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4757c45-6b48-42d1-88fb-00861d81960b admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:37.445609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4757c45-6b48-42d1-88fb-00861d81960b admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:37.446336 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4757c45-6b48-42d1-88fb-00861d81960b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:37.448255 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4757c45-6b48-42d1-88fb-00861d81960b admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:37.552454 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1292/2599] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:35:37 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:35:37.559171 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acaf864-a85b-4124-91cb-b7a3cfdd3d8b admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:37.570396 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acaf864-a85b-4124-91cb-b7a3cfdd3d8b admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:37.575144 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004936d-cead-45f6-8007-fb2e191c3fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:37.575810 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004936d-cead-45f6-8007-fb2e191c3fdc admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:37.576097 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004936d-cead-45f6-8007-fb2e191c3fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:37.576379 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004936d-cead-45f6-8007-fb2e191c3fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:37.577109 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004936d-cead-45f6-8007-fb2e191c3fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:37.578731 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004936d-cead-45f6-8007-fb2e191c3fdc admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:37.590402 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1308/2600] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:35:37.594466 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4757c45-6b48-42d1-88fb-00861d81960b admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:37.605410 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4757c45-6b48-42d1-88fb-00861d81960b admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:37.610245 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf053d6-2cf7-45ed-9ea9-6fa0278580a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:37.610919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf053d6-2cf7-45ed-9ea9-6fa0278580a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:37.611230 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf053d6-2cf7-45ed-9ea9-6fa0278580a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:37.611511 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf053d6-2cf7-45ed-9ea9-6fa0278580a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:37.612271 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf053d6-2cf7-45ed-9ea9-6fa0278580a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:37.613894 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf053d6-2cf7-45ed-9ea9-6fa0278580a6 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:37.624268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1293/2601] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:35:37.634541 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004936d-cead-45f6-8007-fb2e191c3fdc admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:37.644383 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004936d-cead-45f6-8007-fb2e191c3fdc admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:37.650119 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc082a7d-6d69-420d-afc5-e079e0c4067d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:37.651134 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc082a7d-6d69-420d-afc5-e079e0c4067d admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:37.651480 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc082a7d-6d69-420d-afc5-e079e0c4067d admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:37.651785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc082a7d-6d69-420d-afc5-e079e0c4067d admin admin] PATH_INFO: `/v3/projects/14961872155144659a8e4f13c5bd6eef/users/4a386953e96344a3a800b9c4cdd6e8a0/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:37.670075 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc082a7d-6d69-420d-afc5-e079e0c4067d admin admin] RBAC: Authorizing `identity:create_grant(project_id=14961872155144659a8e4f13c5bd6eef, user_id=4a386953e96344a3a800b9c4cdd6e8a0, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:37.672798 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc082a7d-6d69-420d-afc5-e079e0c4067d admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:37.767543 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1309/2602] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:35:37 2022] PUT /identity/v3/projects/14961872155144659a8e4f13c5bd6eef/users/4a386953e96344a3a800b9c4cdd6e8a0/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:37.778630 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ce53b-d141-4b96-89b2-8af79e5e17ba None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:37.778925 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ce53b-d141-4b96-89b2-8af79e5e17ba None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:37.779209 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ce53b-d141-4b96-89b2-8af79e5e17ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:37.808239 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-c06ce53b-d141-4b96-89b2-8af79e5e17ba None None] MFA Rules not processed for user `4a386953e96344a3a800b9c4cdd6e8a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:37.809530 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c06ce53b-d141-4b96-89b2-8af79e5e17ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:37.834712 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:37.876202 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1294/2603] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:35:37.889672 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc082a7d-6d69-420d-afc5-e079e0c4067d admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:37.891413 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-fc082a7d-6d69-420d-afc5-e079e0c4067d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:37.969280 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc082a7d-6d69-420d-afc5-e079e0c4067d admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:37.975009 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d186f-994c-47b6-9b69-e9558a77b716 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:37.975677 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d186f-994c-47b6-9b69-e9558a77b716 service nova] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:37.975968 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d186f-994c-47b6-9b69-e9558a77b716 service nova] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:37.976252 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d186f-994c-47b6-9b69-e9558a77b716 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:37.984836 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d186f-994c-47b6-9b69-e9558a77b716 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:37.986469 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d186f-994c-47b6-9b69-e9558a77b716 service nova] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:37.995834 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1310/2604] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:35:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:35:46.178610 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ce53b-d141-4b96-89b2-8af79e5e17ba None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:46.237588 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ce53b-d141-4b96-89b2-8af79e5e17ba None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:46.243394 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af352008-6196-43f7-a09c-af7781982ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:46.244317 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af352008-6196-43f7-a09c-af7781982ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:46.244598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af352008-6196-43f7-a09c-af7781982ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:46.244872 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af352008-6196-43f7-a09c-af7781982ab9 admin admin] PATH_INFO: `/v3/users/4a386953e96344a3a800b9c4cdd6e8a0` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:46.246112 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af352008-6196-43f7-a09c-af7781982ab9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a386953e96344a3a800b9c4cdd6e8a0)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:46.248020 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af352008-6196-43f7-a09c-af7781982ab9 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:46.467477 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-af352008-6196-43f7-a09c-af7781982ab9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a386953e96344a3a800b9c4cdd6e8a0'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:46.468093 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-af352008-6196-43f7-a09c-af7781982ab9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a386953e96344a3a800b9c4cdd6e8a0'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:46.476007 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-af352008-6196-43f7-a09c-af7781982ab9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a386953e96344a3a800b9c4cdd6e8a0'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:46.544865 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-af352008-6196-43f7-a09c-af7781982ab9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a386953e96344a3a800b9c4cdd6e8a0'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:46.558175 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-af352008-6196-43f7-a09c-af7781982ab9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a386953e96344a3a800b9c4cdd6e8a0'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:46.565875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1295/2605] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:35:46 2022] DELETE /identity/v3/users/4a386953e96344a3a800b9c4cdd6e8a0 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:35:46.571262 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7589d-54ef-4eb7-b38b-4e0d76b5135d None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:46.572103 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7589d-54ef-4eb7-b38b-4e0d76b5135d None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:46.572278 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7589d-54ef-4eb7-b38b-4e0d76b5135d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:46.590071 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-e4b7589d-54ef-4eb7-b38b-4e0d76b5135d None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:46.591263 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-e4b7589d-54ef-4eb7-b38b-4e0d76b5135d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:46.650232 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1311/2606] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:35:46.659794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af352008-6196-43f7-a09c-af7781982ab9 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:46.661858 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-af352008-6196-43f7-a09c-af7781982ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:46.710274 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:46.720968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af352008-6196-43f7-a09c-af7781982ab9 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:46.725794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6e190-cb90-48ab-a545-000aceef3538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:46.726478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6e190-cb90-48ab-a545-000aceef3538 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:46.726793 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6e190-cb90-48ab-a545-000aceef3538 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:46.727096 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6e190-cb90-48ab-a545-000aceef3538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:46.736534 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c6e190-cb90-48ab-a545-000aceef3538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:46.738038 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c6e190-cb90-48ab-a545-000aceef3538 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:46.749179 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1296/2607] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:35:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:35:47.127671 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7589d-54ef-4eb7-b38b-4e0d76b5135d None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:47.130603 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-e4b7589d-54ef-4eb7-b38b-4e0d76b5135d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:47.137552 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:47.143180 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7589d-54ef-4eb7-b38b-4e0d76b5135d None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:47.148855 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4012e-bf15-4352-8158-3f0034e1d668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:47.149799 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4012e-bf15-4352-8158-3f0034e1d668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:47.150089 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4012e-bf15-4352-8158-3f0034e1d668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:47.150372 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4012e-bf15-4352-8158-3f0034e1d668 admin admin] PATH_INFO: `/v3/projects/14961872155144659a8e4f13c5bd6eef` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:47.151571 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4012e-bf15-4352-8158-3f0034e1d668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14961872155144659a8e4f13c5bd6eef)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:47.154321 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4012e-bf15-4352-8158-3f0034e1d668 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:47.289226 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-38e4012e-bf15-4352-8158-3f0034e1d668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14961872155144659a8e4f13c5bd6eef', 'request_id': 'req-38e4012e-bf15-4352-8158-3f0034e1d668'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:47.373308 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-38e4012e-bf15-4352-8158-3f0034e1d668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14961872155144659a8e4f13c5bd6eef', 'request_id': 'req-38e4012e-bf15-4352-8158-3f0034e1d668'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:47.380329 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-38e4012e-bf15-4352-8158-3f0034e1d668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14961872155144659a8e4f13c5bd6eef', 'request_id': 'req-38e4012e-bf15-4352-8158-3f0034e1d668'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:47.391298 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-38e4012e-bf15-4352-8158-3f0034e1d668 admin admin] The token cache is being invalidate because project 14961872155144659a8e4f13c5bd6eef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:35:47.391595 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-38e4012e-bf15-4352-8158-3f0034e1d668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:47.392239 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-38e4012e-bf15-4352-8158-3f0034e1d668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:47.393807 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1312/2608] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:35:47 2022] DELETE /identity/v3/projects/14961872155144659a8e4f13c5bd6eef => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:47.399515 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae3d20-3540-43a8-8113-38de1b9c3cf0 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:47.399999 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae3d20-3540-43a8-8113-38de1b9c3cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:47.400112 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae3d20-3540-43a8-8113-38de1b9c3cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:47.417527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-b3ae3d20-3540-43a8-8113-38de1b9c3cf0 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:47.418799 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b3ae3d20-3540-43a8-8113-38de1b9c3cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:47.477313 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1297/2609] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:35:47.484970 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5705f13-422f-4bd2-a3a3-e48fe26c4cd3 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:47.485268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5705f13-422f-4bd2-a3a3-e48fe26c4cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:47.485549 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5705f13-422f-4bd2-a3a3-e48fe26c4cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:47.504003 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-d5705f13-422f-4bd2-a3a3-e48fe26c4cd3 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:47.509223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-d5705f13-422f-4bd2-a3a3-e48fe26c4cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:47.513797 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1313/2610] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:35:47.517985 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae3d20-3540-43a8-8113-38de1b9c3cf0 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:47.528076 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae3d20-3540-43a8-8113-38de1b9c3cf0 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:47.532811 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b403e7-14d0-4bf7-abca-8c2f91ac6c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:47.533477 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b403e7-14d0-4bf7-abca-8c2f91ac6c13 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:47.533792 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b403e7-14d0-4bf7-abca-8c2f91ac6c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:47.534073 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b403e7-14d0-4bf7-abca-8c2f91ac6c13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:47.534804 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b403e7-14d0-4bf7-abca-8c2f91ac6c13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:35:47.535115 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b403e7-14d0-4bf7-abca-8c2f91ac6c13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:47.536786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b403e7-14d0-4bf7-abca-8c2f91ac6c13 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:47.553118 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1298/2611] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:35:47.554591 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5705f13-422f-4bd2-a3a3-e48fe26c4cd3 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:47.563776 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5705f13-422f-4bd2-a3a3-e48fe26c4cd3 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:47.569523 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bc2fe-164a-4c64-908a-b04b415032fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:47.572252 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bc2fe-164a-4c64-908a-b04b415032fa admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:47.572252 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bc2fe-164a-4c64-908a-b04b415032fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:47.572252 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bc2fe-164a-4c64-908a-b04b415032fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:47.572252 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bc2fe-164a-4c64-908a-b04b415032fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:47.573318 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bc2fe-164a-4c64-908a-b04b415032fa admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:47.698464 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1314/2612] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:35:47 2022] POST /identity/v3/projects => generated 403 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:35:47.700309 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b403e7-14d0-4bf7-abca-8c2f91ac6c13 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:47.710852 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b403e7-14d0-4bf7-abca-8c2f91ac6c13 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:47.773792 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448a2ce-a235-4782-807c-38f7a7b8da1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:47.774483 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448a2ce-a235-4782-807c-38f7a7b8da1e admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:47.774774 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448a2ce-a235-4782-807c-38f7a7b8da1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:47.775059 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448a2ce-a235-4782-807c-38f7a7b8da1e admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:47.775851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448a2ce-a235-4782-807c-38f7a7b8da1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:47.777796 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448a2ce-a235-4782-807c-38f7a7b8da1e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:47.859445 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1299/2613] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:35:47 2022] POST /identity/v3/users => generated 302 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:35:47.863439 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bc2fe-164a-4c64-908a-b04b415032fa admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:47.874342 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bc2fe-164a-4c64-908a-b04b415032fa admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:47.878866 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859524c-f2a3-4b8c-9eaa-624c6fabafbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:47.879518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859524c-f2a3-4b8c-9eaa-624c6fabafbc admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:47.879808 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859524c-f2a3-4b8c-9eaa-624c6fabafbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:47.880175 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859524c-f2a3-4b8c-9eaa-624c6fabafbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:47.880907 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2859524c-f2a3-4b8c-9eaa-624c6fabafbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:47.882540 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2859524c-f2a3-4b8c-9eaa-624c6fabafbc admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:47.892810 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1315/2614] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:35:47.896707 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448a2ce-a235-4782-807c-38f7a7b8da1e admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:47.906587 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448a2ce-a235-4782-807c-38f7a7b8da1e admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:47.912047 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca831e5-4aa1-492d-ae7e-2eb4ca82446f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:47.912689 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca831e5-4aa1-492d-ae7e-2eb4ca82446f admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:47.912976 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca831e5-4aa1-492d-ae7e-2eb4ca82446f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:47.913259 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca831e5-4aa1-492d-ae7e-2eb4ca82446f admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:47.914018 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca831e5-4aa1-492d-ae7e-2eb4ca82446f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:47.915697 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca831e5-4aa1-492d-ae7e-2eb4ca82446f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:47.925720 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1300/2615] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:35:47.930492 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859524c-f2a3-4b8c-9eaa-624c6fabafbc admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:47.940388 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859524c-f2a3-4b8c-9eaa-624c6fabafbc admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:47.945152 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf63912-7401-424e-81d0-d9b11a173a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:47.946055 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf63912-7401-424e-81d0-d9b11a173a52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:47.946337 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf63912-7401-424e-81d0-d9b11a173a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:47.946610 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf63912-7401-424e-81d0-d9b11a173a52 admin admin] PATH_INFO: `/v3/projects/fb10f326a7e14009b777902e1b362f65/users/9f4b966bb14446a792c16144131964dc/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:47.961061 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf63912-7401-424e-81d0-d9b11a173a52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb10f326a7e14009b777902e1b362f65, user_id=9f4b966bb14446a792c16144131964dc, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:47.963709 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf63912-7401-424e-81d0-d9b11a173a52 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:48.036720 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1316/2616] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:35:47 2022] PUT /identity/v3/projects/fb10f326a7e14009b777902e1b362f65/users/9f4b966bb14446a792c16144131964dc/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:35:48.047101 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33187a-3014-4e5c-9ff3-76cff34cc8cb None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:48.047401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33187a-3014-4e5c-9ff3-76cff34cc8cb None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:48.047688 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33187a-3014-4e5c-9ff3-76cff34cc8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:48.074454 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-fb33187a-3014-4e5c-9ff3-76cff34cc8cb None None] MFA Rules not processed for user `9f4b966bb14446a792c16144131964dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:48.075583 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-fb33187a-3014-4e5c-9ff3-76cff34cc8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:48.117855 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:48.139693 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1301/2617] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:35:48.144409 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf63912-7401-424e-81d0-d9b11a173a52 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:48.205244 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf63912-7401-424e-81d0-d9b11a173a52 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:48.210235 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805c524-5cf3-4e6a-980c-c40d1060abf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:48.210893 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805c524-5cf3-4e6a-980c-c40d1060abf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:48.211180 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805c524-5cf3-4e6a-980c-c40d1060abf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:48.211457 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805c524-5cf3-4e6a-980c-c40d1060abf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:48.212141 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805c524-5cf3-4e6a-980c-c40d1060abf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:48.214064 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805c524-5cf3-4e6a-980c-c40d1060abf9 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:48.321886 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1317/2618] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:35:48 2022] POST /identity/v3/projects => generated 405 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:35:48.326031 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33187a-3014-4e5c-9ff3-76cff34cc8cb None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:48.337576 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33187a-3014-4e5c-9ff3-76cff34cc8cb None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:48.392100 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21772cb0-3920-4f82-917b-01fb88c94bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:48.392772 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21772cb0-3920-4f82-917b-01fb88c94bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:48.393060 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21772cb0-3920-4f82-917b-01fb88c94bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:48.393342 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21772cb0-3920-4f82-917b-01fb88c94bc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:48.394055 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21772cb0-3920-4f82-917b-01fb88c94bc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:48.396743 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21772cb0-3920-4f82-917b-01fb88c94bc1 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:48.470734 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1302/2619] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:35:48 2022] POST /identity/v3/users => generated 309 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:35:48.475301 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805c524-5cf3-4e6a-980c-c40d1060abf9 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:48.485801 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805c524-5cf3-4e6a-980c-c40d1060abf9 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:48.490673 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379e8a4-3803-4648-aaea-0e885d4db700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:48.491346 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379e8a4-3803-4648-aaea-0e885d4db700 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:48.491623 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379e8a4-3803-4648-aaea-0e885d4db700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:48.491908 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379e8a4-3803-4648-aaea-0e885d4db700 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:48.492716 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379e8a4-3803-4648-aaea-0e885d4db700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:48.494344 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379e8a4-3803-4648-aaea-0e885d4db700 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:48.495613 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:48.505912 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1318/2620] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:35:48.510135 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21772cb0-3920-4f82-917b-01fb88c94bc1 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:48.519996 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21772cb0-3920-4f82-917b-01fb88c94bc1 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:48.525418 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c163b-bfc2-4c0f-a09e-3cdf03c0753c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:48.526347 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c163b-bfc2-4c0f-a09e-3cdf03c0753c admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:48.526639 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c163b-bfc2-4c0f-a09e-3cdf03c0753c admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:48.526989 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c163b-bfc2-4c0f-a09e-3cdf03c0753c admin admin] PATH_INFO: `/v3/projects/4036007902554ae0a73f29de6112f2cc/users/dd70a4dc00e343dd9e4f27408df5f62d/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:48.543680 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c163b-bfc2-4c0f-a09e-3cdf03c0753c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4036007902554ae0a73f29de6112f2cc, user_id=dd70a4dc00e343dd9e4f27408df5f62d, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:48.546362 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c163b-bfc2-4c0f-a09e-3cdf03c0753c admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:48.687946 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1303/2621] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:35:48 2022] PUT /identity/v3/projects/4036007902554ae0a73f29de6112f2cc/users/dd70a4dc00e343dd9e4f27408df5f62d/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:48.691861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379e8a4-3803-4648-aaea-0e885d4db700 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:48.702303 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379e8a4-3803-4648-aaea-0e885d4db700 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:48.758623 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d157160-3282-4537-948a-1e2d94858906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:48.759394 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d157160-3282-4537-948a-1e2d94858906 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:48.759695 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d157160-3282-4537-948a-1e2d94858906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:48.760045 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d157160-3282-4537-948a-1e2d94858906 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:48.760782 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d157160-3282-4537-948a-1e2d94858906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:48.762462 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d157160-3282-4537-948a-1e2d94858906 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:48.774209 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1319/2622] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:35:48.778111 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c163b-bfc2-4c0f-a09e-3cdf03c0753c admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:48.788553 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c163b-bfc2-4c0f-a09e-3cdf03c0753c admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:48.793270 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009364d-e2a4-44eb-8787-a7a9f36a4e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:48.794193 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009364d-e2a4-44eb-8787-a7a9f36a4e38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:48.794491 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009364d-e2a4-44eb-8787-a7a9f36a4e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:48.794799 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009364d-e2a4-44eb-8787-a7a9f36a4e38 admin admin] PATH_INFO: `/v3/projects/4036007902554ae0a73f29de6112f2cc/users/dd70a4dc00e343dd9e4f27408df5f62d/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:48.796750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009364d-e2a4-44eb-8787-a7a9f36a4e38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4036007902554ae0a73f29de6112f2cc, user_id=dd70a4dc00e343dd9e4f27408df5f62d, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:48.799448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009364d-e2a4-44eb-8787-a7a9f36a4e38 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:48.809704 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1304/2623] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:35:48 2022] PUT /identity/v3/projects/4036007902554ae0a73f29de6112f2cc/users/dd70a4dc00e343dd9e4f27408df5f62d/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:35:48.821620 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c8c40-ebe9-4286-825d-36627e26fc7c None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:48.821946 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c8c40-ebe9-4286-825d-36627e26fc7c None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:48.822226 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c8c40-ebe9-4286-825d-36627e26fc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:48.850092 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-9c9c8c40-ebe9-4286-825d-36627e26fc7c None None] MFA Rules not processed for user `dd70a4dc00e343dd9e4f27408df5f62d`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:48.851322 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-9c9c8c40-ebe9-4286-825d-36627e26fc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:48.923345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1320/2624] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:48 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:35:48.934369 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009364d-e2a4-44eb-8787-a7a9f36a4e38 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:48.936093 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8009364d-e2a4-44eb-8787-a7a9f36a4e38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:48.994772 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009364d-e2a4-44eb-8787-a7a9f36a4e38 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:48.998441 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b5fc8-cb94-49fb-83da-07df728c50b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:48.999087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b5fc8-cb94-49fb-83da-07df728c50b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:48.999378 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b5fc8-cb94-49fb-83da-07df728c50b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:48.999661 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b5fc8-cb94-49fb-83da-07df728c50b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:49.009259 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b5fc8-cb94-49fb-83da-07df728c50b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:49.010712 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b5fc8-cb94-49fb-83da-07df728c50b1 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:49.020307 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1305/2625] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:35:48 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:35:49.338948 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c8c40-ebe9-4286-825d-36627e26fc7c None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:49.399972 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c8c40-ebe9-4286-825d-36627e26fc7c None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:49.404746 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdec055-020c-4817-b516-b57a0ef36ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:49.405606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdec055-020c-4817-b516-b57a0ef36ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:49.405923 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdec055-020c-4817-b516-b57a0ef36ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:49.406261 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdec055-020c-4817-b516-b57a0ef36ba1 admin admin] PATH_INFO: `/v3/users/9f4b966bb14446a792c16144131964dc` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:49.411651 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdec055-020c-4817-b516-b57a0ef36ba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f4b966bb14446a792c16144131964dc)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:49.411651 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdec055-020c-4817-b516-b57a0ef36ba1 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:49.430940 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:49.598188 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-8cdec055-020c-4817-b516-b57a0ef36ba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f4b966bb14446a792c16144131964dc'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:49.682310 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-8cdec055-020c-4817-b516-b57a0ef36ba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f4b966bb14446a792c16144131964dc'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:49.689733 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-8cdec055-020c-4817-b516-b57a0ef36ba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f4b966bb14446a792c16144131964dc'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:49.692296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-8cdec055-020c-4817-b516-b57a0ef36ba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f4b966bb14446a792c16144131964dc'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:49.692296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-8cdec055-020c-4817-b516-b57a0ef36ba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f4b966bb14446a792c16144131964dc'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:49.709045 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1321/2626] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:35:49 2022] DELETE /identity/v3/users/9f4b966bb14446a792c16144131964dc => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:49.713487 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f346b6-18c6-40fb-8687-4f7574f901eb None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:49.713976 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f346b6-18c6-40fb-8687-4f7574f901eb None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:49.714083 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f346b6-18c6-40fb-8687-4f7574f901eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:49.731927 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-22f346b6-18c6-40fb-8687-4f7574f901eb None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:49.733125 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-22f346b6-18c6-40fb-8687-4f7574f901eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:49.766049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:49.794993 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1306/2627] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:35:49.805003 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdec055-020c-4817-b516-b57a0ef36ba1 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:49.806625 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-8cdec055-020c-4817-b516-b57a0ef36ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:49.865575 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdec055-020c-4817-b516-b57a0ef36ba1 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:49.869328 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96991bd2-8dda-4e47-90e3-3d5d025a2001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:49.869928 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96991bd2-8dda-4e47-90e3-3d5d025a2001 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:49.870211 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96991bd2-8dda-4e47-90e3-3d5d025a2001 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:49.870488 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96991bd2-8dda-4e47-90e3-3d5d025a2001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:49.880052 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96991bd2-8dda-4e47-90e3-3d5d025a2001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:49.881591 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96991bd2-8dda-4e47-90e3-3d5d025a2001 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:49.891511 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1322/2628] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:35:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:35:50.299223 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f346b6-18c6-40fb-8687-4f7574f901eb None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:50.300691 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-22f346b6-18c6-40fb-8687-4f7574f901eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:50.312854 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f346b6-18c6-40fb-8687-4f7574f901eb None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:50.318223 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff30966-2e3c-4efe-953a-5893b824c6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:50.319319 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff30966-2e3c-4efe-953a-5893b824c6b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:50.319603 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff30966-2e3c-4efe-953a-5893b824c6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:50.319887 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff30966-2e3c-4efe-953a-5893b824c6b6 admin admin] PATH_INFO: `/v3/projects/fb10f326a7e14009b777902e1b362f65` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:50.321092 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff30966-2e3c-4efe-953a-5893b824c6b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb10f326a7e14009b777902e1b362f65)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:50.323083 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff30966-2e3c-4efe-953a-5893b824c6b6 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:50.446904 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-aff30966-2e3c-4efe-953a-5893b824c6b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb10f326a7e14009b777902e1b362f65', 'request_id': 'req-aff30966-2e3c-4efe-953a-5893b824c6b6'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:50.452276 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-aff30966-2e3c-4efe-953a-5893b824c6b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb10f326a7e14009b777902e1b362f65', 'request_id': 'req-aff30966-2e3c-4efe-953a-5893b824c6b6'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:50.510747 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-aff30966-2e3c-4efe-953a-5893b824c6b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb10f326a7e14009b777902e1b362f65', 'request_id': 'req-aff30966-2e3c-4efe-953a-5893b824c6b6'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:50.522401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-aff30966-2e3c-4efe-953a-5893b824c6b6 admin admin] The token cache is being invalidate because project fb10f326a7e14009b777902e1b362f65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:35:50.522697 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-aff30966-2e3c-4efe-953a-5893b824c6b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:50.523328 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-aff30966-2e3c-4efe-953a-5893b824c6b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:50.524963 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1307/2629] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:35:50 2022] DELETE /identity/v3/projects/fb10f326a7e14009b777902e1b362f65 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:50.529235 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96991bd2-8dda-4e47-90e3-3d5d025a2001 service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:50.539118 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96991bd2-8dda-4e47-90e3-3d5d025a2001 service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:50.596394 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64454d2d-7e01-4338-9dd6-a54bff41516a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:50.597268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64454d2d-7e01-4338-9dd6-a54bff41516a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:50.597551 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64454d2d-7e01-4338-9dd6-a54bff41516a admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:50.597866 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64454d2d-7e01-4338-9dd6-a54bff41516a admin admin] PATH_INFO: `/v3/users/dd70a4dc00e343dd9e4f27408df5f62d` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:50.601408 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64454d2d-7e01-4338-9dd6-a54bff41516a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd70a4dc00e343dd9e4f27408df5f62d)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:50.603443 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64454d2d-7e01-4338-9dd6-a54bff41516a admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:50.823496 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:50.828936 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-64454d2d-7e01-4338-9dd6-a54bff41516a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd70a4dc00e343dd9e4f27408df5f62d'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:50.904765 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-64454d2d-7e01-4338-9dd6-a54bff41516a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd70a4dc00e343dd9e4f27408df5f62d'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:50.912704 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-64454d2d-7e01-4338-9dd6-a54bff41516a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd70a4dc00e343dd9e4f27408df5f62d'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:50.913358 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-64454d2d-7e01-4338-9dd6-a54bff41516a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd70a4dc00e343dd9e4f27408df5f62d'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:50.914011 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-64454d2d-7e01-4338-9dd6-a54bff41516a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd70a4dc00e343dd9e4f27408df5f62d'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:50.932076 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1323/2630] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:35:50 2022] DELETE /identity/v3/users/dd70a4dc00e343dd9e4f27408df5f62d => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:51.375110 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff30966-2e3c-4efe-953a-5893b824c6b6 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:51.376593 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-aff30966-2e3c-4efe-953a-5893b824c6b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:51.391890 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff30966-2e3c-4efe-953a-5893b824c6b6 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:51.450180 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d3970-c7bb-47d8-b6ab-c2938fe4a524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:51.451054 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d3970-c7bb-47d8-b6ab-c2938fe4a524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:51.451342 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d3970-c7bb-47d8-b6ab-c2938fe4a524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:51.451624 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d3970-c7bb-47d8-b6ab-c2938fe4a524 admin admin] PATH_INFO: `/v3/projects/4036007902554ae0a73f29de6112f2cc` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:51.452793 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d3970-c7bb-47d8-b6ab-c2938fe4a524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4036007902554ae0a73f29de6112f2cc)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:51.454713 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d3970-c7bb-47d8-b6ab-c2938fe4a524 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:51.596529 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-9b6d3970-c7bb-47d8-b6ab-c2938fe4a524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4036007902554ae0a73f29de6112f2cc', 'request_id': 'req-9b6d3970-c7bb-47d8-b6ab-c2938fe4a524'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:51.602641 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-9b6d3970-c7bb-47d8-b6ab-c2938fe4a524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4036007902554ae0a73f29de6112f2cc', 'request_id': 'req-9b6d3970-c7bb-47d8-b6ab-c2938fe4a524'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:51.606232 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:51.670378 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-9b6d3970-c7bb-47d8-b6ab-c2938fe4a524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4036007902554ae0a73f29de6112f2cc', 'request_id': 'req-9b6d3970-c7bb-47d8-b6ab-c2938fe4a524'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:51.683020 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-9b6d3970-c7bb-47d8-b6ab-c2938fe4a524 admin admin] The token cache is being invalidate because project 4036007902554ae0a73f29de6112f2cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:35:51.683685 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-9b6d3970-c7bb-47d8-b6ab-c2938fe4a524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:51.684388 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-9b6d3970-c7bb-47d8-b6ab-c2938fe4a524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:51.686008 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1308/2631] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:35:51 2022] DELETE /identity/v3/projects/4036007902554ae0a73f29de6112f2cc => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:51.691683 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd0993-942b-452b-a16e-2372f79f9119 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:51.691683 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd0993-942b-452b-a16e-2372f79f9119 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:51.691683 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd0993-942b-452b-a16e-2372f79f9119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:51.710061 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-0abd0993-942b-452b-a16e-2372f79f9119 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:51.711254 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-0abd0993-942b-452b-a16e-2372f79f9119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:51.776500 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1324/2632] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:35:51.783860 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de80f90-7c3f-420b-b35a-5049a8343eea None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:51.784158 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de80f90-7c3f-420b-b35a-5049a8343eea None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:51.784460 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de80f90-7c3f-420b-b35a-5049a8343eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:51.803706 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-5de80f90-7c3f-420b-b35a-5049a8343eea None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:51.804913 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-5de80f90-7c3f-420b-b35a-5049a8343eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:51.812943 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1309/2633] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:35:51.817156 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd0993-942b-452b-a16e-2372f79f9119 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:51.826758 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd0993-942b-452b-a16e-2372f79f9119 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:51.831415 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8d01e-cc83-4f8b-a93f-c66fc6b7b3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:51.832101 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8d01e-cc83-4f8b-a93f-c66fc6b7b3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:51.832388 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8d01e-cc83-4f8b-a93f-c66fc6b7b3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:51.832665 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8d01e-cc83-4f8b-a93f-c66fc6b7b3e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:51.833689 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8d01e-cc83-4f8b-a93f-c66fc6b7b3e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:35:51.834027 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8d01e-cc83-4f8b-a93f-c66fc6b7b3e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:51.835665 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8d01e-cc83-4f8b-a93f-c66fc6b7b3e4 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:51.846963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1325/2634] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:35:51.852051 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de80f90-7c3f-420b-b35a-5049a8343eea None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:51.861403 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de80f90-7c3f-420b-b35a-5049a8343eea None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:51.866862 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40f7fa-32e2-40fc-93c4-b5a44dbf4cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:51.867510 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40f7fa-32e2-40fc-93c4-b5a44dbf4cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:51.867793 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40f7fa-32e2-40fc-93c4-b5a44dbf4cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:51.868070 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40f7fa-32e2-40fc-93c4-b5a44dbf4cd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:51.868763 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40f7fa-32e2-40fc-93c4-b5a44dbf4cd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:51.870690 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40f7fa-32e2-40fc-93c4-b5a44dbf4cd6 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:51.940322 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1310/2635] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:35:51 2022] POST /identity/v3/projects => generated 405 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:35:51.944507 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8d01e-cc83-4f8b-a93f-c66fc6b7b3e4 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:51.954312 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8d01e-cc83-4f8b-a93f-c66fc6b7b3e4 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:52.012733 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a637a6-d9b7-4d52-bde6-32c5c7f8c292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:52.013403 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a637a6-d9b7-4d52-bde6-32c5c7f8c292 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:52.013687 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a637a6-d9b7-4d52-bde6-32c5c7f8c292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:52.014003 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a637a6-d9b7-4d52-bde6-32c5c7f8c292 admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:52.014702 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a637a6-d9b7-4d52-bde6-32c5c7f8c292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:52.016601 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a637a6-d9b7-4d52-bde6-32c5c7f8c292 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:52.110243 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1326/2636] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:35:51 2022] POST /identity/v3/users => generated 303 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:35:52.113731 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40f7fa-32e2-40fc-93c4-b5a44dbf4cd6 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:52.124584 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40f7fa-32e2-40fc-93c4-b5a44dbf4cd6 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:52.129387 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ead14d-bab8-4859-8322-8ff38fac13b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:52.130657 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ead14d-bab8-4859-8322-8ff38fac13b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:52.133281 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ead14d-bab8-4859-8322-8ff38fac13b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:52.133281 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ead14d-bab8-4859-8322-8ff38fac13b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:52.133281 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ead14d-bab8-4859-8322-8ff38fac13b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:52.133623 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ead14d-bab8-4859-8322-8ff38fac13b4 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:52.144162 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1311/2637] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:35:52.148338 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a637a6-d9b7-4d52-bde6-32c5c7f8c292 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:52.158647 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a637a6-d9b7-4d52-bde6-32c5c7f8c292 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:52.163310 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b69db8-8f72-4dfe-984d-67cd577132ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:52.163962 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b69db8-8f72-4dfe-984d-67cd577132ff admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:52.164247 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b69db8-8f72-4dfe-984d-67cd577132ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:52.164522 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b69db8-8f72-4dfe-984d-67cd577132ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:52.165249 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b69db8-8f72-4dfe-984d-67cd577132ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:52.166942 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b69db8-8f72-4dfe-984d-67cd577132ff admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:52.177591 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1327/2638] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:35:52.181251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ead14d-bab8-4859-8322-8ff38fac13b4 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:52.191120 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ead14d-bab8-4859-8322-8ff38fac13b4 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:52.196460 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68278c82-8288-43e7-b238-a173b5218505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:52.197340 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68278c82-8288-43e7-b238-a173b5218505 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:52.197625 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68278c82-8288-43e7-b238-a173b5218505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:52.197950 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68278c82-8288-43e7-b238-a173b5218505 admin admin] PATH_INFO: `/v3/projects/b9277565559c45ffb1b02db277252f7e/users/27a3ec6c13604a34b5e84291308a2ca0/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:52.212815 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68278c82-8288-43e7-b238-a173b5218505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9277565559c45ffb1b02db277252f7e, user_id=27a3ec6c13604a34b5e84291308a2ca0, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:52.215505 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68278c82-8288-43e7-b238-a173b5218505 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:52.323485 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1312/2639] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:35:52 2022] PUT /identity/v3/projects/b9277565559c45ffb1b02db277252f7e/users/27a3ec6c13604a34b5e84291308a2ca0/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:35:52.328743 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167803ca-b6a0-40ad-84c2-7d791167324e None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:52.329039 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167803ca-b6a0-40ad-84c2-7d791167324e None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:52.329322 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167803ca-b6a0-40ad-84c2-7d791167324e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:52.349195 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-167803ca-b6a0-40ad-84c2-7d791167324e None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:52.350864 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-167803ca-b6a0-40ad-84c2-7d791167324e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:52.370514 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:52.409915 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1328/2640] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:35:52.420316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68278c82-8288-43e7-b238-a173b5218505 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:52.422045 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-68278c82-8288-43e7-b238-a173b5218505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:52.482181 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68278c82-8288-43e7-b238-a173b5218505 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:52.485895 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222ddc7-2bc3-41fe-bebc-67af98ac0df7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:52.486566 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222ddc7-2bc3-41fe-bebc-67af98ac0df7 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:52.486838 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222ddc7-2bc3-41fe-bebc-67af98ac0df7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:52.487121 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222ddc7-2bc3-41fe-bebc-67af98ac0df7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:52.497269 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222ddc7-2bc3-41fe-bebc-67af98ac0df7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:52.498796 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222ddc7-2bc3-41fe-bebc-67af98ac0df7 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:52.508609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1313/2641] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:35:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:35:53.672488 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d53314-d97b-44c9-852c-86ee6b63021b None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:53.672956 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d53314-d97b-44c9-852c-86ee6b63021b None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:53.673164 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d53314-d97b-44c9-852c-86ee6b63021b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:53.709149 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-b5d53314-d97b-44c9-852c-86ee6b63021b None None] MFA Rules not processed for user `27a3ec6c13604a34b5e84291308a2ca0`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:53.710689 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-b5d53314-d97b-44c9-852c-86ee6b63021b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:53.785653 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1329/2642] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:53 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:35:53.790467 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222ddc7-2bc3-41fe-bebc-67af98ac0df7 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:53.800574 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222ddc7-2bc3-41fe-bebc-67af98ac0df7 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:53.805739 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d41e873-e9fb-4856-b3ab-dfe98db39632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:53.806439 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41e873-e9fb-4856-b3ab-dfe98db39632 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:53.806718 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41e873-e9fb-4856-b3ab-dfe98db39632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:53.807609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41e873-e9fb-4856-b3ab-dfe98db39632 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:53.808322 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d41e873-e9fb-4856-b3ab-dfe98db39632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:53.810227 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d41e873-e9fb-4856-b3ab-dfe98db39632 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:53.913858 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1314/2643] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:35:53 2022] POST /identity/v3/projects => generated 403 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:35:53.917606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d53314-d97b-44c9-852c-86ee6b63021b None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:53.928971 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d53314-d97b-44c9-852c-86ee6b63021b None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:53.986538 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe8645-afbd-4a09-862c-12d87d45724c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:53.987409 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe8645-afbd-4a09-862c-12d87d45724c admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:53.987696 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe8645-afbd-4a09-862c-12d87d45724c admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:53.987978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe8645-afbd-4a09-862c-12d87d45724c admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:53.988684 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe8645-afbd-4a09-862c-12d87d45724c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:53.991198 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe8645-afbd-4a09-862c-12d87d45724c admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:54.107674 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1330/2644] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:35:53 2022] POST /identity/v3/users => generated 308 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:35:54.109617 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d41e873-e9fb-4856-b3ab-dfe98db39632 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:54.122343 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d41e873-e9fb-4856-b3ab-dfe98db39632 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:54.127973 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c81550-770c-4e41-bbd2-49b2d27faa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:54.128837 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c81550-770c-4e41-bbd2-49b2d27faa0f admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:54.129253 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c81550-770c-4e41-bbd2-49b2d27faa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:54.129630 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c81550-770c-4e41-bbd2-49b2d27faa0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:54.130706 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c81550-770c-4e41-bbd2-49b2d27faa0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:54.132423 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c81550-770c-4e41-bbd2-49b2d27faa0f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:54.144755 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1315/2645] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:35:54.149172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe8645-afbd-4a09-862c-12d87d45724c admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:54.160565 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe8645-afbd-4a09-862c-12d87d45724c admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:54.167369 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5f927-e699-4342-8ac6-b3b7410c3bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:54.168266 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5f927-e699-4342-8ac6-b3b7410c3bb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:54.168554 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5f927-e699-4342-8ac6-b3b7410c3bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:54.168833 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5f927-e699-4342-8ac6-b3b7410c3bb2 admin admin] PATH_INFO: `/v3/projects/3a2d394adea342e6a85afdb8fd20cfa7/users/945d49d7ca3e4099802265bbd2cb2583/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:54.185683 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab5f927-e699-4342-8ac6-b3b7410c3bb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a2d394adea342e6a85afdb8fd20cfa7, user_id=945d49d7ca3e4099802265bbd2cb2583, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:54.188860 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab5f927-e699-4342-8ac6-b3b7410c3bb2 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:54.288767 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1331/2646] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:35:54 2022] PUT /identity/v3/projects/3a2d394adea342e6a85afdb8fd20cfa7/users/945d49d7ca3e4099802265bbd2cb2583/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:54.293474 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c81550-770c-4e41-bbd2-49b2d27faa0f admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:54.302832 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c81550-770c-4e41-bbd2-49b2d27faa0f admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:54.345983 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:54.357809 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594de4b-cd2b-425c-bf75-2118b8b56797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:54.358410 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594de4b-cd2b-425c-bf75-2118b8b56797 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:54.358693 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594de4b-cd2b-425c-bf75-2118b8b56797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:54.358969 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594de4b-cd2b-425c-bf75-2118b8b56797 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:54.359690 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5594de4b-cd2b-425c-bf75-2118b8b56797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:54.361261 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5594de4b-cd2b-425c-bf75-2118b8b56797 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:54.370784 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1316/2647] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:35:54.374934 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5f927-e699-4342-8ac6-b3b7410c3bb2 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:54.385121 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5f927-e699-4342-8ac6-b3b7410c3bb2 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:54.389591 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba187d-b2a8-420d-8575-28d2d4f46cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:54.390499 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba187d-b2a8-420d-8575-28d2d4f46cfa admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:54.390782 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba187d-b2a8-420d-8575-28d2d4f46cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:54.391059 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba187d-b2a8-420d-8575-28d2d4f46cfa admin admin] PATH_INFO: `/v3/projects/3a2d394adea342e6a85afdb8fd20cfa7/users/945d49d7ca3e4099802265bbd2cb2583/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:54.393003 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba187d-b2a8-420d-8575-28d2d4f46cfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a2d394adea342e6a85afdb8fd20cfa7, user_id=945d49d7ca3e4099802265bbd2cb2583, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:54.396191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba187d-b2a8-420d-8575-28d2d4f46cfa admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:54.406644 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1332/2648] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:35:54 2022] PUT /identity/v3/projects/3a2d394adea342e6a85afdb8fd20cfa7/users/945d49d7ca3e4099802265bbd2cb2583/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:35:55.718668 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e5eac-a765-4718-9f30-5aa54af84515 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:55.719715 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e5eac-a765-4718-9f30-5aa54af84515 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:55.720569 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e5eac-a765-4718-9f30-5aa54af84515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:55.755118 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-786e5eac-a765-4718-9f30-5aa54af84515 None None] MFA Rules not processed for user `945d49d7ca3e4099802265bbd2cb2583`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:55.758845 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-786e5eac-a765-4718-9f30-5aa54af84515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:55.859465 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1317/2649] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:55 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:35:57.216690 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba187d-b2a8-420d-8575-28d2d4f46cfa admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:57.230517 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:57.323533 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba187d-b2a8-420d-8575-28d2d4f46cfa admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:57.329951 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf1062-75b0-4e63-9d43-f63a7675abd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:57.331210 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf1062-75b0-4e63-9d43-f63a7675abd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:57.333357 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf1062-75b0-4e63-9d43-f63a7675abd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:57.333357 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf1062-75b0-4e63-9d43-f63a7675abd1 admin admin] PATH_INFO: `/v3/users/27a3ec6c13604a34b5e84291308a2ca0` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:57.335987 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf1062-75b0-4e63-9d43-f63a7675abd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27a3ec6c13604a34b5e84291308a2ca0)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:57.338792 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf1062-75b0-4e63-9d43-f63a7675abd1 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:57.544693 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-8cbf1062-75b0-4e63-9d43-f63a7675abd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27a3ec6c13604a34b5e84291308a2ca0'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:57.665480 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-8cbf1062-75b0-4e63-9d43-f63a7675abd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27a3ec6c13604a34b5e84291308a2ca0'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:57.674341 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-8cbf1062-75b0-4e63-9d43-f63a7675abd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27a3ec6c13604a34b5e84291308a2ca0'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:57.674640 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-8cbf1062-75b0-4e63-9d43-f63a7675abd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27a3ec6c13604a34b5e84291308a2ca0'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:57.675385 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-8cbf1062-75b0-4e63-9d43-f63a7675abd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27a3ec6c13604a34b5e84291308a2ca0'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:57.703223 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1333/2650] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:35:57 2022] DELETE /identity/v3/users/27a3ec6c13604a34b5e84291308a2ca0 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:58.001631 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e5eac-a765-4718-9f30-5aa54af84515 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:58.019066 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e5eac-a765-4718-9f30-5aa54af84515 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:58.077511 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e742f1-2892-41de-bccb-315130a74c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:58.078330 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e742f1-2892-41de-bccb-315130a74c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:58.078618 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e742f1-2892-41de-bccb-315130a74c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:58.078897 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e742f1-2892-41de-bccb-315130a74c76 admin admin] PATH_INFO: `/v3/projects/b9277565559c45ffb1b02db277252f7e` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:58.080074 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e742f1-2892-41de-bccb-315130a74c76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9277565559c45ffb1b02db277252f7e)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:58.081986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e742f1-2892-41de-bccb-315130a74c76 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:58.226736 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a6e742f1-2892-41de-bccb-315130a74c76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9277565559c45ffb1b02db277252f7e', 'request_id': 'req-a6e742f1-2892-41de-bccb-315130a74c76'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:58.234947 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a6e742f1-2892-41de-bccb-315130a74c76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9277565559c45ffb1b02db277252f7e', 'request_id': 'req-a6e742f1-2892-41de-bccb-315130a74c76'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:58.331298 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a6e742f1-2892-41de-bccb-315130a74c76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9277565559c45ffb1b02db277252f7e', 'request_id': 'req-a6e742f1-2892-41de-bccb-315130a74c76'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:58.344584 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:58.349577 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a6e742f1-2892-41de-bccb-315130a74c76 admin admin] The token cache is being invalidate because project b9277565559c45ffb1b02db277252f7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:35:58.349986 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a6e742f1-2892-41de-bccb-315130a74c76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:58.350665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a6e742f1-2892-41de-bccb-315130a74c76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:58.352220 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1318/2651] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:35:58 2022] DELETE /identity/v3/projects/b9277565559c45ffb1b02db277252f7e => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:58.356149 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf1062-75b0-4e63-9d43-f63a7675abd1 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:58.357583 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-8cbf1062-75b0-4e63-9d43-f63a7675abd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:58.370956 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf1062-75b0-4e63-9d43-f63a7675abd1 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:58.436826 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3413003-8926-47a1-84a8-db3203adb8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:58.437921 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3413003-8926-47a1-84a8-db3203adb8e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:58.438284 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3413003-8926-47a1-84a8-db3203adb8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:58.438569 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3413003-8926-47a1-84a8-db3203adb8e1 admin admin] PATH_INFO: `/v3/users/945d49d7ca3e4099802265bbd2cb2583` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:58.440767 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3413003-8926-47a1-84a8-db3203adb8e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=945d49d7ca3e4099802265bbd2cb2583)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:58.443935 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3413003-8926-47a1-84a8-db3203adb8e1 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:58.570548 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:58.696955 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-c3413003-8926-47a1-84a8-db3203adb8e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '945d49d7ca3e4099802265bbd2cb2583'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:58.779254 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-c3413003-8926-47a1-84a8-db3203adb8e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '945d49d7ca3e4099802265bbd2cb2583'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:58.787614 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-c3413003-8926-47a1-84a8-db3203adb8e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '945d49d7ca3e4099802265bbd2cb2583'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:58.793869 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-c3413003-8926-47a1-84a8-db3203adb8e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '945d49d7ca3e4099802265bbd2cb2583'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:58.793869 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-c3413003-8926-47a1-84a8-db3203adb8e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '945d49d7ca3e4099802265bbd2cb2583'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:58.807119 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1334/2652] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:35:58 2022] DELETE /identity/v3/users/945d49d7ca3e4099802265bbd2cb2583 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:59.045957 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e742f1-2892-41de-bccb-315130a74c76 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:59.052441 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a6e742f1-2892-41de-bccb-315130a74c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:59.062211 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e742f1-2892-41de-bccb-315130a74c76 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:59.084116 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3413003-8926-47a1-84a8-db3203adb8e1 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:59.085550 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-c3413003-8926-47a1-84a8-db3203adb8e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:59.135505 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7260d2-ad45-42ce-a856-e338ca2d3c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:59.136472 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7260d2-ad45-42ce-a856-e338ca2d3c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:59.136822 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7260d2-ad45-42ce-a856-e338ca2d3c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:59.137167 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7260d2-ad45-42ce-a856-e338ca2d3c7e admin admin] PATH_INFO: `/v3/users/f795a2e25bdd4b42b2875980f20e8403` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:59.138533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7260d2-ad45-42ce-a856-e338ca2d3c7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f795a2e25bdd4b42b2875980f20e8403)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:59.140507 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7260d2-ad45-42ce-a856-e338ca2d3c7e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:59.167317 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3413003-8926-47a1-84a8-db3203adb8e1 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:59.172735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243e230-cff4-4908-9ec6-26ca5dc41c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:59.173749 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243e230-cff4-4908-9ec6-26ca5dc41c04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:59.174114 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243e230-cff4-4908-9ec6-26ca5dc41c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:59.174402 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243e230-cff4-4908-9ec6-26ca5dc41c04 admin admin] PATH_INFO: `/v3/projects/3a2d394adea342e6a85afdb8fd20cfa7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:59.175619 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8243e230-cff4-4908-9ec6-26ca5dc41c04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a2d394adea342e6a85afdb8fd20cfa7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:59.178592 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8243e230-cff4-4908-9ec6-26ca5dc41c04 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:59.339488 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-8243e230-cff4-4908-9ec6-26ca5dc41c04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a2d394adea342e6a85afdb8fd20cfa7', 'request_id': 'req-8243e230-cff4-4908-9ec6-26ca5dc41c04'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:59.341097 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ca7260d2-ad45-42ce-a856-e338ca2d3c7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f795a2e25bdd4b42b2875980f20e8403'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:59.341996 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ca7260d2-ad45-42ce-a856-e338ca2d3c7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f795a2e25bdd4b42b2875980f20e8403'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:59.352552 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ca7260d2-ad45-42ce-a856-e338ca2d3c7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f795a2e25bdd4b42b2875980f20e8403'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:59.425097 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-8243e230-cff4-4908-9ec6-26ca5dc41c04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a2d394adea342e6a85afdb8fd20cfa7', 'request_id': 'req-8243e230-cff4-4908-9ec6-26ca5dc41c04'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:59.433509 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-8243e230-cff4-4908-9ec6-26ca5dc41c04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a2d394adea342e6a85afdb8fd20cfa7', 'request_id': 'req-8243e230-cff4-4908-9ec6-26ca5dc41c04'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:59.444013 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-8243e230-cff4-4908-9ec6-26ca5dc41c04 admin admin] The token cache is being invalidate because project 3a2d394adea342e6a85afdb8fd20cfa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:35:59.444384 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-8243e230-cff4-4908-9ec6-26ca5dc41c04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:59.444989 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-8243e230-cff4-4908-9ec6-26ca5dc41c04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:59.446626 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1335/2653] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:35:59 2022] DELETE /identity/v3/projects/3a2d394adea342e6a85afdb8fd20cfa7 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:59.452087 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d74b39-ffb0-46f0-9284-48aed0f54aec None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:59.452384 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d74b39-ffb0-46f0-9284-48aed0f54aec None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:59.455853 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d74b39-ffb0-46f0-9284-48aed0f54aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:59.470766 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-04d74b39-ffb0-46f0-9284-48aed0f54aec None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:59.472032 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-04d74b39-ffb0-46f0-9284-48aed0f54aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:59.504851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ca7260d2-ad45-42ce-a856-e338ca2d3c7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f795a2e25bdd4b42b2875980f20e8403'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:59.506508 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:59.517667 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ca7260d2-ad45-42ce-a856-e338ca2d3c7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f795a2e25bdd4b42b2875980f20e8403'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:35:59.524757 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1319/2654] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:35:59 2022] DELETE /identity/v3/users/f795a2e25bdd4b42b2875980f20e8403 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:35:59.529303 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0275b76-b6d2-497c-9b41-138c3e95d3b7 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:59.529597 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0275b76-b6d2-497c-9b41-138c3e95d3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:59.529971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0275b76-b6d2-497c-9b41-138c3e95d3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:59.538174 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1336/2655] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:35:59.547305 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-a0275b76-b6d2-497c-9b41-138c3e95d3b7 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:59.548512 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a0275b76-b6d2-497c-9b41-138c3e95d3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:59.550443 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c3cae-e94d-494d-82ce-9cb98892dca6 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:59.550741 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c3cae-e94d-494d-82ce-9cb98892dca6 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:59.551024 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c3cae-e94d-494d-82ce-9cb98892dca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:59.570540 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-e94c3cae-e94d-494d-82ce-9cb98892dca6 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:35:59.571753 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-e94c3cae-e94d-494d-82ce-9cb98892dca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:59.614237 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1320/2656] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:35:59.624563 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0275b76-b6d2-497c-9b41-138c3e95d3b7 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:59.625979 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a0275b76-b6d2-497c-9b41-138c3e95d3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:35:59.633548 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1337/2657] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:35:59.637958 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c3cae-e94d-494d-82ce-9cb98892dca6 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:59.647804 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c3cae-e94d-494d-82ce-9cb98892dca6 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:59.652067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:59.652822 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383edc89-d2b2-4f37-9bab-ecfb2ec41434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:59.653529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383edc89-d2b2-4f37-9bab-ecfb2ec41434 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:59.653853 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383edc89-d2b2-4f37-9bab-ecfb2ec41434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:59.654138 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383edc89-d2b2-4f37-9bab-ecfb2ec41434 admin admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:59.654894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383edc89-d2b2-4f37-9bab-ecfb2ec41434 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:35:59.655204 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383edc89-d2b2-4f37-9bab-ecfb2ec41434 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:59.656796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383edc89-d2b2-4f37-9bab-ecfb2ec41434 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:59.669496 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1338/2658] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:35:59.673908 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383edc89-d2b2-4f37-9bab-ecfb2ec41434 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:59.683744 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383edc89-d2b2-4f37-9bab-ecfb2ec41434 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:59.688620 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ec694-7eb0-44f4-a843-ed1275f776eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:59.689102 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0275b76-b6d2-497c-9b41-138c3e95d3b7 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:59.689259 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ec694-7eb0-44f4-a843-ed1275f776eb admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:59.689544 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ec694-7eb0-44f4-a843-ed1275f776eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:59.689850 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ec694-7eb0-44f4-a843-ed1275f776eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:59.690650 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ec694-7eb0-44f4-a843-ed1275f776eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:59.692744 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ec694-7eb0-44f4-a843-ed1275f776eb admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:59.693221 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47b7d3-5219-4465-badd-3c74b458bc26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:59.693955 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47b7d3-5219-4465-badd-3c74b458bc26 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:59.694246 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47b7d3-5219-4465-badd-3c74b458bc26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:59.694525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47b7d3-5219-4465-badd-3c74b458bc26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:59.704684 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47b7d3-5219-4465-badd-3c74b458bc26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:59.706152 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47b7d3-5219-4465-badd-3c74b458bc26 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:59.716977 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1321/2659] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:35:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:35:59.784995 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1339/2660] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:35:59 2022] POST /identity/v3/projects => generated 369 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:35:59.789574 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47b7d3-5219-4465-badd-3c74b458bc26 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:59.799641 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47b7d3-5219-4465-badd-3c74b458bc26 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:35:59.858415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb587b-8ecb-436f-8f5c-106ae969102a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:35:59.859097 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb587b-8ecb-436f-8f5c-106ae969102a admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:35:59.859401 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb587b-8ecb-436f-8f5c-106ae969102a admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:35:59.859676 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb587b-8ecb-436f-8f5c-106ae969102a admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:35:59.860403 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb587b-8ecb-436f-8f5c-106ae969102a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:35:59.862375 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb587b-8ecb-436f-8f5c-106ae969102a admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:35:59.980628 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1322/2661] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:35:59 2022] POST /identity/v3/users => generated 285 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:35:59.984987 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ec694-7eb0-44f4-a843-ed1275f776eb admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:35:59.996372 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ec694-7eb0-44f4-a843-ed1275f776eb admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:00.001204 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949304a-0c54-4d83-9d05-7ec2d51d6da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:00.001935 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949304a-0c54-4d83-9d05-7ec2d51d6da8 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:00.002226 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949304a-0c54-4d83-9d05-7ec2d51d6da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:00.002505 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949304a-0c54-4d83-9d05-7ec2d51d6da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:00.003235 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949304a-0c54-4d83-9d05-7ec2d51d6da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:00.005334 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949304a-0c54-4d83-9d05-7ec2d51d6da8 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:00.017910 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1340/2662] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:36:00.028943 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb587b-8ecb-436f-8f5c-106ae969102a admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:00.030827 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb587b-8ecb-436f-8f5c-106ae969102a admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:00.035536 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43b577-4c92-469e-90ae-875d34a98731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:00.036469 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43b577-4c92-469e-90ae-875d34a98731 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:00.036848 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43b577-4c92-469e-90ae-875d34a98731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:00.037138 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43b577-4c92-469e-90ae-875d34a98731 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:00.038041 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43b577-4c92-469e-90ae-875d34a98731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:00.039636 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43b577-4c92-469e-90ae-875d34a98731 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:00.050134 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1323/2663] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:36:00.054458 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949304a-0c54-4d83-9d05-7ec2d51d6da8 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:00.064491 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949304a-0c54-4d83-9d05-7ec2d51d6da8 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:00.069721 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3f389-71dc-4446-a025-cd069db160ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:00.070658 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3f389-71dc-4446-a025-cd069db160ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:00.070939 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3f389-71dc-4446-a025-cd069db160ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:00.071294 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3f389-71dc-4446-a025-cd069db160ce admin admin] PATH_INFO: `/v3/projects/b8d03bc3a10445ffa6b51d25af996bb6/users/ff379fd5335a45b3895c3c811bf9bf53/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:00.086921 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd3f389-71dc-4446-a025-cd069db160ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8d03bc3a10445ffa6b51d25af996bb6, user_id=ff379fd5335a45b3895c3c811bf9bf53, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:00.089631 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd3f389-71dc-4446-a025-cd069db160ce admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:00.191529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1341/2664] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:36:00 2022] PUT /identity/v3/projects/b8d03bc3a10445ffa6b51d25af996bb6/users/ff379fd5335a45b3895c3c811bf9bf53/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:36:00.201750 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9983a-6c60-41a1-bc91-3888c2ab00c9 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:00.202076 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9983a-6c60-41a1-bc91-3888c2ab00c9 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:00.202362 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9983a-6c60-41a1-bc91-3888c2ab00c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:00.229675 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-6bd9983a-6c60-41a1-bc91-3888c2ab00c9 None None] MFA Rules not processed for user `ff379fd5335a45b3895c3c811bf9bf53`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:00.231011 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6bd9983a-6c60-41a1-bc91-3888c2ab00c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:00.233085 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3f389-71dc-4446-a025-cd069db160ce admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:00.234929 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-6dd3f389-71dc-4446-a025-cd069db160ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:00.304472 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3f389-71dc-4446-a025-cd069db160ce admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:00.306136 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1324/2665] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:00 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:36:00.309296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4be74d-3b16-4055-aafc-628a3b473525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:00.310275 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4be74d-3b16-4055-aafc-628a3b473525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:00.310562 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4be74d-3b16-4055-aafc-628a3b473525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:00.310701 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9983a-6c60-41a1-bc91-3888c2ab00c9 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:00.310843 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4be74d-3b16-4055-aafc-628a3b473525 admin admin] PATH_INFO: `/v3/projects/aca58fdd0cb3472ea6a0606801dc3982` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:00.312086 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4be74d-3b16-4055-aafc-628a3b473525 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aca58fdd0cb3472ea6a0606801dc3982)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:00.314036 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4be74d-3b16-4055-aafc-628a3b473525 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:00.321031 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9983a-6c60-41a1-bc91-3888c2ab00c9 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:00.322752 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:00.326132 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885b8b1-3217-485a-bc20-4287fdafde28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:00.326899 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885b8b1-3217-485a-bc20-4287fdafde28 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:00.327193 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885b8b1-3217-485a-bc20-4287fdafde28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:00.327478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885b8b1-3217-485a-bc20-4287fdafde28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:00.328179 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885b8b1-3217-485a-bc20-4287fdafde28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:00.330129 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885b8b1-3217-485a-bc20-4287fdafde28 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:00.419555 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-5c4be74d-3b16-4055-aafc-628a3b473525 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aca58fdd0cb3472ea6a0606801dc3982', 'request_id': 'req-5c4be74d-3b16-4055-aafc-628a3b473525'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:00.435756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1325/2666] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:36:00 2022] POST /identity/v3/projects => generated 367 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:36:00.439882 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885b8b1-3217-485a-bc20-4287fdafde28 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:00.459845 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:00.497244 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-5c4be74d-3b16-4055-aafc-628a3b473525 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aca58fdd0cb3472ea6a0606801dc3982', 'request_id': 'req-5c4be74d-3b16-4055-aafc-628a3b473525'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:00.501510 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885b8b1-3217-485a-bc20-4287fdafde28 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:00.504553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-5c4be74d-3b16-4055-aafc-628a3b473525 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aca58fdd0cb3472ea6a0606801dc3982', 'request_id': 'req-5c4be74d-3b16-4055-aafc-628a3b473525'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:00.506611 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a9256-041f-4297-9cfe-19762538e1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:00.507374 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a9256-041f-4297-9cfe-19762538e1aa admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:00.507727 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a9256-041f-4297-9cfe-19762538e1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:00.508235 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a9256-041f-4297-9cfe-19762538e1aa admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:00.509126 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a9256-041f-4297-9cfe-19762538e1aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:00.511293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a9256-041f-4297-9cfe-19762538e1aa admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:00.516280 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-5c4be74d-3b16-4055-aafc-628a3b473525 admin admin] The token cache is being invalidate because project aca58fdd0cb3472ea6a0606801dc3982 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:36:00.516574 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-5c4be74d-3b16-4055-aafc-628a3b473525 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:00.517245 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-5c4be74d-3b16-4055-aafc-628a3b473525 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:00.518936 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1342/2667] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:36:00 2022] DELETE /identity/v3/projects/aca58fdd0cb3472ea6a0606801dc3982 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:36:00.524367 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8af6e-7ce5-490e-9cf1-08db2b634b3c None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:00.524659 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8af6e-7ce5-490e-9cf1-08db2b634b3c None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:00.524941 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8af6e-7ce5-490e-9cf1-08db2b634b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:00.543655 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-b1b8af6e-7ce5-490e-9cf1-08db2b634b3c None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:00.544856 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-b1b8af6e-7ce5-490e-9cf1-08db2b634b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:00.553155 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1343/2668] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:36:00.560643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cfdd1-34af-4420-935c-eb745c94651d None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:00.560941 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cfdd1-34af-4420-935c-eb745c94651d None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:00.561224 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cfdd1-34af-4420-935c-eb745c94651d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:00.579168 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-196cfdd1-34af-4420-935c-eb745c94651d None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:00.580372 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-196cfdd1-34af-4420-935c-eb745c94651d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:00.587901 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1326/2669] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:36:00 2022] POST /identity/v3/users => generated 290 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:36:00.589219 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a9256-041f-4297-9cfe-19762538e1aa admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:00.590872 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f85a9256-041f-4297-9cfe-19762538e1aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:00.592234 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1344/2670] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:36:00.596159 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cfdd1-34af-4420-935c-eb745c94651d None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:00.603868 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a9256-041f-4297-9cfe-19762538e1aa admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:00.606101 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cfdd1-34af-4420-935c-eb745c94651d None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:00.608665 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c32f2-0380-4654-a56f-c2cf0ad294f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:00.609325 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c32f2-0380-4654-a56f-c2cf0ad294f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:00.609609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c32f2-0380-4654-a56f-c2cf0ad294f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:00.610025 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c32f2-0380-4654-a56f-c2cf0ad294f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:00.610763 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4b3b2-ca6b-4193-bbf2-4694be690096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:00.610954 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c32f2-0380-4654-a56f-c2cf0ad294f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:00.611406 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4b3b2-ca6b-4193-bbf2-4694be690096 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:00.611700 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4b3b2-ca6b-4193-bbf2-4694be690096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:00.611980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4b3b2-ca6b-4193-bbf2-4694be690096 admin admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:00.612528 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c32f2-0380-4654-a56f-c2cf0ad294f9 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:00.612707 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4b3b2-ca6b-4193-bbf2-4694be690096 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:36:00.613019 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4b3b2-ca6b-4193-bbf2-4694be690096 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:00.614713 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4b3b2-ca6b-4193-bbf2-4694be690096 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:00.629330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1345/2671] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:36:00.629527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1327/2672] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:36:00.644352 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c32f2-0380-4654-a56f-c2cf0ad294f9 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:00.644514 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4b3b2-ca6b-4193-bbf2-4694be690096 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:00.654744 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4b3b2-ca6b-4193-bbf2-4694be690096 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:00.654925 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c32f2-0380-4654-a56f-c2cf0ad294f9 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:00.659309 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618904ab-e958-4431-8f49-37ded92a64c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:00.659949 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618904ab-e958-4431-8f49-37ded92a64c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:00.660232 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618904ab-e958-4431-8f49-37ded92a64c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:00.660333 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d24846-a087-40d3-98c6-b33ef0f40ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:00.660514 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618904ab-e958-4431-8f49-37ded92a64c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:00.661296 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d24846-a087-40d3-98c6-b33ef0f40ca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:00.661484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618904ab-e958-4431-8f49-37ded92a64c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:00.661603 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d24846-a087-40d3-98c6-b33ef0f40ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:00.661958 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d24846-a087-40d3-98c6-b33ef0f40ca9 admin admin] PATH_INFO: `/v3/projects/b847f375e22d4897b550c4fedaf78f97/users/4dbfb7dc3e41427ca35209a8a7a2446f/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:00.663401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618904ab-e958-4431-8f49-37ded92a64c6 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:00.676393 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d24846-a087-40d3-98c6-b33ef0f40ca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b847f375e22d4897b550c4fedaf78f97, user_id=4dbfb7dc3e41427ca35209a8a7a2446f, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:00.679179 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d24846-a087-40d3-98c6-b33ef0f40ca9 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:00.775564 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1346/2673] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:36:00 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:36:00.780698 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618904ab-e958-4431-8f49-37ded92a64c6 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:00.785603 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1328/2674] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:36:00 2022] PUT /identity/v3/projects/b847f375e22d4897b550c4fedaf78f97/users/4dbfb7dc3e41427ca35209a8a7a2446f/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:36:00.798335 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d24846-a087-40d3-98c6-b33ef0f40ca9 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:00.843712 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618904ab-e958-4431-8f49-37ded92a64c6 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:00.859601 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d24846-a087-40d3-98c6-b33ef0f40ca9 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:00.864472 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2f880-cdef-4174-a83f-8d94b55185a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:00.865172 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2f880-cdef-4174-a83f-8d94b55185a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:00.865492 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2f880-cdef-4174-a83f-8d94b55185a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:00.865783 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2f880-cdef-4174-a83f-8d94b55185a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:00.866537 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2f880-cdef-4174-a83f-8d94b55185a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:00.868123 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2f880-cdef-4174-a83f-8d94b55185a0 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:00.878097 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1329/2675] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:36:00.882699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2f880-cdef-4174-a83f-8d94b55185a0 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:00.892325 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2f880-cdef-4174-a83f-8d94b55185a0 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:00.893850 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:00.897285 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838090f-942b-4cb5-8726-6cfe9f58323b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:00.898233 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838090f-942b-4cb5-8726-6cfe9f58323b admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:00.898518 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838090f-942b-4cb5-8726-6cfe9f58323b admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:00.898795 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838090f-942b-4cb5-8726-6cfe9f58323b admin admin] PATH_INFO: `/v3/projects/b847f375e22d4897b550c4fedaf78f97/users/4dbfb7dc3e41427ca35209a8a7a2446f/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:00.900948 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838090f-942b-4cb5-8726-6cfe9f58323b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b847f375e22d4897b550c4fedaf78f97, user_id=4dbfb7dc3e41427ca35209a8a7a2446f, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:00.901076 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494c614-dec8-400e-b81d-bbfff61a2efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:00.901739 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494c614-dec8-400e-b81d-bbfff61a2efc admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:00.902072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494c614-dec8-400e-b81d-bbfff61a2efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:00.902351 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494c614-dec8-400e-b81d-bbfff61a2efc admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:00.903032 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494c614-dec8-400e-b81d-bbfff61a2efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:00.903640 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838090f-942b-4cb5-8726-6cfe9f58323b admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:00.904969 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494c614-dec8-400e-b81d-bbfff61a2efc admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:00.915136 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1330/2676] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:36:00 2022] PUT /identity/v3/projects/b847f375e22d4897b550c4fedaf78f97/users/4dbfb7dc3e41427ca35209a8a7a2446f/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:36:00.926304 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d2219-9c12-4238-a0d0-cc54e99556a3 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:00.927252 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d2219-9c12-4238-a0d0-cc54e99556a3 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:00.927540 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d2219-9c12-4238-a0d0-cc54e99556a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:00.954298 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-705d2219-9c12-4238-a0d0-cc54e99556a3 None None] MFA Rules not processed for user `4dbfb7dc3e41427ca35209a8a7a2446f`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:00.955574 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-705d2219-9c12-4238-a0d0-cc54e99556a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:00.980504 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1347/2677] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:36:00 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:36:00.984557 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494c614-dec8-400e-b81d-bbfff61a2efc admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:00.991992 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:00.996025 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494c614-dec8-400e-b81d-bbfff61a2efc admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:01.026950 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1331/2678] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:00 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:36:01.040036 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d2219-9c12-4238-a0d0-cc54e99556a3 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:01.041451 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-705d2219-9c12-4238-a0d0-cc54e99556a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:01.058218 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830815b-7273-42d8-9e5d-f710bd846a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:01.058886 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830815b-7273-42d8-9e5d-f710bd846a85 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:01.059172 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830815b-7273-42d8-9e5d-f710bd846a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:01.059453 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830815b-7273-42d8-9e5d-f710bd846a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:01.060183 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830815b-7273-42d8-9e5d-f710bd846a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:01.061816 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830815b-7273-42d8-9e5d-f710bd846a85 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:01.074927 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1348/2679] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:36:01.075932 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830815b-7273-42d8-9e5d-f710bd846a85 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:01.086396 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830815b-7273-42d8-9e5d-f710bd846a85 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:01.091237 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786044a-6b24-4dad-ac51-322f3c4aad7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:01.091878 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786044a-6b24-4dad-ac51-322f3c4aad7d admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:01.092164 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786044a-6b24-4dad-ac51-322f3c4aad7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:01.092440 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786044a-6b24-4dad-ac51-322f3c4aad7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:01.093155 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5786044a-6b24-4dad-ac51-322f3c4aad7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:01.094757 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5786044a-6b24-4dad-ac51-322f3c4aad7d admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:01.100111 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d2219-9c12-4238-a0d0-cc54e99556a3 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:01.104345 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ef5fa-cab9-46e8-86f2-7d37cd0fd466 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:01.104993 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ef5fa-cab9-46e8-86f2-7d37cd0fd466 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:01.105280 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ef5fa-cab9-46e8-86f2-7d37cd0fd466 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:01.105556 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ef5fa-cab9-46e8-86f2-7d37cd0fd466 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:01.105660 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1349/2680] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:36:01.109704 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786044a-6b24-4dad-ac51-322f3c4aad7d admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:01.118184 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ef5fa-cab9-46e8-86f2-7d37cd0fd466 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:01.119430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786044a-6b24-4dad-ac51-322f3c4aad7d admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:01.119650 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ef5fa-cab9-46e8-86f2-7d37cd0fd466 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:01.124043 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0462961-82b7-4fbc-a339-703cddfb1251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:01.124901 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0462961-82b7-4fbc-a339-703cddfb1251 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:01.125188 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0462961-82b7-4fbc-a339-703cddfb1251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:01.125471 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0462961-82b7-4fbc-a339-703cddfb1251 admin admin] PATH_INFO: `/v3/projects/2044ea917268495ea19609bf180a0737/users/1dfe05bd9459421ab0de8b991c11abfd/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:01.129224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1332/2681] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:36:01 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:36:01.141011 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0462961-82b7-4fbc-a339-703cddfb1251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2044ea917268495ea19609bf180a0737, user_id=1dfe05bd9459421ab0de8b991c11abfd, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:01.143728 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0462961-82b7-4fbc-a339-703cddfb1251 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:01.220477 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1350/2682] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:36:01 2022] PUT /identity/v3/projects/2044ea917268495ea19609bf180a0737/users/1dfe05bd9459421ab0de8b991c11abfd/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:36:01.233744 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3ff11-429d-47d7-8d99-f781eab2ca89 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:01.234270 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3ff11-429d-47d7-8d99-f781eab2ca89 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:01.234588 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3ff11-429d-47d7-8d99-f781eab2ca89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:01.263540 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-c8b3ff11-429d-47d7-8d99-f781eab2ca89 None None] MFA Rules not processed for user `1dfe05bd9459421ab0de8b991c11abfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:01.264858 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c8b3ff11-429d-47d7-8d99-f781eab2ca89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:01.336939 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1333/2683] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:36:01.346834 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0462961-82b7-4fbc-a339-703cddfb1251 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:01.412287 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0462961-82b7-4fbc-a339-703cddfb1251 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:01.417152 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a5e38-5e59-41b4-94a5-3ea9513413a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:01.417889 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a5e38-5e59-41b4-94a5-3ea9513413a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:01.418175 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a5e38-5e59-41b4-94a5-3ea9513413a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:01.418471 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a5e38-5e59-41b4-94a5-3ea9513413a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:01.419150 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a5e38-5e59-41b4-94a5-3ea9513413a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:01.421034 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a5e38-5e59-41b4-94a5-3ea9513413a5 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:01.505159 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1351/2684] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:36:01 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:36:01.509016 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3ff11-429d-47d7-8d99-f781eab2ca89 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:01.519654 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3ff11-429d-47d7-8d99-f781eab2ca89 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:01.581826 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be97cef-ed8d-4657-b104-77074bf8e5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:01.582024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be97cef-ed8d-4657-b104-77074bf8e5bb admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:01.582294 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be97cef-ed8d-4657-b104-77074bf8e5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:01.582583 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be97cef-ed8d-4657-b104-77074bf8e5bb admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:01.583926 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be97cef-ed8d-4657-b104-77074bf8e5bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:01.585956 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be97cef-ed8d-4657-b104-77074bf8e5bb admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:01.595547 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:01.706103 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1334/2685] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:36:01 2022] POST /identity/v3/users => generated 288 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:36:01.713066 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a5e38-5e59-41b4-94a5-3ea9513413a5 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:01.723473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a5e38-5e59-41b4-94a5-3ea9513413a5 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:01.728791 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfdabd-ab66-485f-935b-83590f3ad783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:01.729459 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfdabd-ab66-485f-935b-83590f3ad783 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:01.729748 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfdabd-ab66-485f-935b-83590f3ad783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:01.730060 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfdabd-ab66-485f-935b-83590f3ad783 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:01.730797 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfdabd-ab66-485f-935b-83590f3ad783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:01.732437 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfdabd-ab66-485f-935b-83590f3ad783 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:01.744136 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1352/2686] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:36:01.748250 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be97cef-ed8d-4657-b104-77074bf8e5bb admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:01.759584 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be97cef-ed8d-4657-b104-77074bf8e5bb admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:01.764402 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110b689-37ef-491d-ba33-561400429dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:01.766982 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110b689-37ef-491d-ba33-561400429dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:01.766982 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110b689-37ef-491d-ba33-561400429dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:01.766982 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110b689-37ef-491d-ba33-561400429dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:01.766982 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110b689-37ef-491d-ba33-561400429dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:01.768135 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110b689-37ef-491d-ba33-561400429dd9 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:01.778817 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1335/2687] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:36:01.782942 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfdabd-ab66-485f-935b-83590f3ad783 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:01.793096 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfdabd-ab66-485f-935b-83590f3ad783 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:01.797784 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f52999-3f7d-499a-bfc9-6ade8577bdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:01.798661 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f52999-3f7d-499a-bfc9-6ade8577bdb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:01.798948 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f52999-3f7d-499a-bfc9-6ade8577bdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:01.799228 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f52999-3f7d-499a-bfc9-6ade8577bdb7 admin admin] PATH_INFO: `/v3/projects/a854b4156da74499a99ffe8f8b9af108/users/a1ad51cae85b48d5867ecb183f814ca0/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:01.814593 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f52999-3f7d-499a-bfc9-6ade8577bdb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a854b4156da74499a99ffe8f8b9af108, user_id=a1ad51cae85b48d5867ecb183f814ca0, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:01.817804 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f52999-3f7d-499a-bfc9-6ade8577bdb7 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:01.821069 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:01.940251 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1353/2688] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:36:01 2022] PUT /identity/v3/projects/a854b4156da74499a99ffe8f8b9af108/users/a1ad51cae85b48d5867ecb183f814ca0/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:36:01.950842 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe8cea-03f6-43b2-991c-731a752d2495 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:01.951172 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe8cea-03f6-43b2-991c-731a752d2495 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:01.951463 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe8cea-03f6-43b2-991c-731a752d2495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:01.980456 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-1dbe8cea-03f6-43b2-991c-731a752d2495 None None] MFA Rules not processed for user `a1ad51cae85b48d5867ecb183f814ca0`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:01.981679 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1dbe8cea-03f6-43b2-991c-731a752d2495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:02.046601 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1336/2689] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:36:02.051272 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f52999-3f7d-499a-bfc9-6ade8577bdb7 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:02.117258 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f52999-3f7d-499a-bfc9-6ade8577bdb7 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:02.121973 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad407db-174e-46d3-b143-ee208dcd847d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:02.123130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad407db-174e-46d3-b143-ee208dcd847d admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:02.123130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad407db-174e-46d3-b143-ee208dcd847d admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:02.123130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad407db-174e-46d3-b143-ee208dcd847d admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:02.123817 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad407db-174e-46d3-b143-ee208dcd847d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:02.125701 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad407db-174e-46d3-b143-ee208dcd847d admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:02.216701 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1354/2690] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:36:02 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:36:02.220583 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe8cea-03f6-43b2-991c-731a752d2495 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:02.232776 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe8cea-03f6-43b2-991c-731a752d2495 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:02.289683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e31b7-6fb7-4fc2-9a63-8a6c5fa89548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:02.290434 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e31b7-6fb7-4fc2-9a63-8a6c5fa89548 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:02.290719 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e31b7-6fb7-4fc2-9a63-8a6c5fa89548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:02.291002 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e31b7-6fb7-4fc2-9a63-8a6c5fa89548 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:02.291710 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e31b7-6fb7-4fc2-9a63-8a6c5fa89548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:02.298875 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e31b7-6fb7-4fc2-9a63-8a6c5fa89548 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:02.397293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1337/2691] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:36:02 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:36:02.399872 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad407db-174e-46d3-b143-ee208dcd847d admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:02.411950 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad407db-174e-46d3-b143-ee208dcd847d admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:02.417050 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56417db5-e904-473d-9e24-a9737553ab9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:02.417813 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56417db5-e904-473d-9e24-a9737553ab9e admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:02.418663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56417db5-e904-473d-9e24-a9737553ab9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:02.418663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56417db5-e904-473d-9e24-a9737553ab9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:02.419253 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56417db5-e904-473d-9e24-a9737553ab9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:02.426080 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56417db5-e904-473d-9e24-a9737553ab9e admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:02.441571 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1355/2692] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:36:02.441969 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e31b7-6fb7-4fc2-9a63-8a6c5fa89548 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:02.457888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e31b7-6fb7-4fc2-9a63-8a6c5fa89548 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:02.473978 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ece5a-1465-4f90-804b-85ecadab81fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:02.475282 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ece5a-1465-4f90-804b-85ecadab81fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:02.475942 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ece5a-1465-4f90-804b-85ecadab81fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:02.476445 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ece5a-1465-4f90-804b-85ecadab81fe admin admin] PATH_INFO: `/v3/projects/c12a7c639405467280a0d2df17f826c2/users/07293d3a4af94c3580e91e3b74c4c676/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:02.504243 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ece5a-1465-4f90-804b-85ecadab81fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c12a7c639405467280a0d2df17f826c2, user_id=07293d3a4af94c3580e91e3b74c4c676, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:02.507075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ece5a-1465-4f90-804b-85ecadab81fe admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:02.597011 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1338/2693] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:36:02 2022] PUT /identity/v3/projects/c12a7c639405467280a0d2df17f826c2/users/07293d3a4af94c3580e91e3b74c4c676/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:36:02.603196 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56417db5-e904-473d-9e24-a9737553ab9e admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:02.613338 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56417db5-e904-473d-9e24-a9737553ab9e admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:02.672397 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358372e8-4801-420a-a2c3-d00fb9cb72dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:02.673066 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358372e8-4801-420a-a2c3-d00fb9cb72dc admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:02.673355 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358372e8-4801-420a-a2c3-d00fb9cb72dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:02.673633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358372e8-4801-420a-a2c3-d00fb9cb72dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:02.674392 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358372e8-4801-420a-a2c3-d00fb9cb72dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:02.676041 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358372e8-4801-420a-a2c3-d00fb9cb72dc admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:02.689855 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1356/2694] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:36:02.693974 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ece5a-1465-4f90-804b-85ecadab81fe admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:02.704491 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ece5a-1465-4f90-804b-85ecadab81fe admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:02.709952 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c43dc-c243-463d-bfbc-700e5cc2a902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:02.715286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c43dc-c243-463d-bfbc-700e5cc2a902 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:02.715286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c43dc-c243-463d-bfbc-700e5cc2a902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:02.715286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c43dc-c243-463d-bfbc-700e5cc2a902 admin admin] PATH_INFO: `/v3/projects/c12a7c639405467280a0d2df17f826c2/users/07293d3a4af94c3580e91e3b74c4c676/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:02.715286 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c43dc-c243-463d-bfbc-700e5cc2a902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c12a7c639405467280a0d2df17f826c2, user_id=07293d3a4af94c3580e91e3b74c4c676, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:02.716134 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c43dc-c243-463d-bfbc-700e5cc2a902 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:02.727763 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1339/2695] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:36:02 2022] PUT /identity/v3/projects/c12a7c639405467280a0d2df17f826c2/users/07293d3a4af94c3580e91e3b74c4c676/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:36:02.737735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2644b7-9ab2-485a-a041-6b86781c8a41 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:02.738065 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2644b7-9ab2-485a-a041-6b86781c8a41 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:02.738355 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2644b7-9ab2-485a-a041-6b86781c8a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:02.768944 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-eb2644b7-9ab2-485a-a041-6b86781c8a41 None None] MFA Rules not processed for user `07293d3a4af94c3580e91e3b74c4c676`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:02.770193 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-eb2644b7-9ab2-485a-a041-6b86781c8a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:02.828319 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:02.849590 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1357/2696] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:02 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:36:02.861088 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c43dc-c243-463d-bfbc-700e5cc2a902 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:02.891697 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:02.925251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c43dc-c243-463d-bfbc-700e5cc2a902 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:02.935406 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568745e-35d3-41c3-a2e2-b0278b79e1af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:02.935406 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568745e-35d3-41c3-a2e2-b0278b79e1af service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:02.935406 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568745e-35d3-41c3-a2e2-b0278b79e1af service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:02.935406 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568745e-35d3-41c3-a2e2-b0278b79e1af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:03.014158 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568745e-35d3-41c3-a2e2-b0278b79e1af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:03.015797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568745e-35d3-41c3-a2e2-b0278b79e1af service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:03.026219 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1340/2697] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:36:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:36:04.047710 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2644b7-9ab2-485a-a041-6b86781c8a41 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:04.111473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2644b7-9ab2-485a-a041-6b86781c8a41 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:04.120353 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81503a1-11c3-4ea6-b8cb-509374aed7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:04.120353 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81503a1-11c3-4ea6-b8cb-509374aed7a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:04.120353 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81503a1-11c3-4ea6-b8cb-509374aed7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:04.120353 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81503a1-11c3-4ea6-b8cb-509374aed7a8 admin admin] PATH_INFO: `/v3/users/ff379fd5335a45b3895c3c811bf9bf53` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:04.120796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81503a1-11c3-4ea6-b8cb-509374aed7a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff379fd5335a45b3895c3c811bf9bf53)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:04.120796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81503a1-11c3-4ea6-b8cb-509374aed7a8 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:04.296470 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e81503a1-11c3-4ea6-b8cb-509374aed7a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff379fd5335a45b3895c3c811bf9bf53'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:04.379078 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e81503a1-11c3-4ea6-b8cb-509374aed7a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff379fd5335a45b3895c3c811bf9bf53'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:04.387064 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e81503a1-11c3-4ea6-b8cb-509374aed7a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff379fd5335a45b3895c3c811bf9bf53'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:04.387788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e81503a1-11c3-4ea6-b8cb-509374aed7a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff379fd5335a45b3895c3c811bf9bf53'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:04.388481 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-e81503a1-11c3-4ea6-b8cb-509374aed7a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff379fd5335a45b3895c3c811bf9bf53'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:04.406847 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1358/2698] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:36:04 2022] DELETE /identity/v3/users/ff379fd5335a45b3895c3c811bf9bf53 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:36:04.411451 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c0e0b-773b-4fb8-9786-7bcdd05782c1 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:04.411968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c0e0b-773b-4fb8-9786-7bcdd05782c1 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:04.412068 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c0e0b-773b-4fb8-9786-7bcdd05782c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:04.429134 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-0d2c0e0b-773b-4fb8-9786-7bcdd05782c1 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:04.430375 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-0d2c0e0b-773b-4fb8-9786-7bcdd05782c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:04.489278 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1341/2699] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:36:04.498860 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81503a1-11c3-4ea6-b8cb-509374aed7a8 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:04.503604 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-e81503a1-11c3-4ea6-b8cb-509374aed7a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:04.557546 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81503a1-11c3-4ea6-b8cb-509374aed7a8 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:04.561162 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50d3bd-b57f-438d-9fd5-253b0e0929ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:04.561830 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50d3bd-b57f-438d-9fd5-253b0e0929ca service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:04.562121 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50d3bd-b57f-438d-9fd5-253b0e0929ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:04.562397 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50d3bd-b57f-438d-9fd5-253b0e0929ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:04.572206 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50d3bd-b57f-438d-9fd5-253b0e0929ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:04.575059 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50d3bd-b57f-438d-9fd5-253b0e0929ca service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:04.584442 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1359/2700] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:36:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:36:05.024630 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c0e0b-773b-4fb8-9786-7bcdd05782c1 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:05.026022 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-0d2c0e0b-773b-4fb8-9786-7bcdd05782c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:05.038568 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c0e0b-773b-4fb8-9786-7bcdd05782c1 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:05.043346 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b5e4c-6ccc-4aa1-a690-a179c367f2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:05.044224 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b5e4c-6ccc-4aa1-a690-a179c367f2ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:05.044515 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b5e4c-6ccc-4aa1-a690-a179c367f2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:05.044861 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b5e4c-6ccc-4aa1-a690-a179c367f2ee admin admin] PATH_INFO: `/v3/projects/b8d03bc3a10445ffa6b51d25af996bb6` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:05.046251 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b5e4c-6ccc-4aa1-a690-a179c367f2ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8d03bc3a10445ffa6b51d25af996bb6)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:05.048175 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b5e4c-6ccc-4aa1-a690-a179c367f2ee admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:05.104270 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50d3bd-b57f-438d-9fd5-253b0e0929ca service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:05.105811 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-ec50d3bd-b57f-438d-9fd5-253b0e0929ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:05.122453 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:05.169268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50d3bd-b57f-438d-9fd5-253b0e0929ca service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:05.187190 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4c5b5e4c-6ccc-4aa1-a690-a179c367f2ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8d03bc3a10445ffa6b51d25af996bb6', 'request_id': 'req-4c5b5e4c-6ccc-4aa1-a690-a179c367f2ee'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:05.196289 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4c5b5e4c-6ccc-4aa1-a690-a179c367f2ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8d03bc3a10445ffa6b51d25af996bb6', 'request_id': 'req-4c5b5e4c-6ccc-4aa1-a690-a179c367f2ee'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:05.221722 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93751011-161e-43b7-8405-99a4cbe6622d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:05.222601 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93751011-161e-43b7-8405-99a4cbe6622d service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:05.222896 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93751011-161e-43b7-8405-99a4cbe6622d service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:05.223176 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93751011-161e-43b7-8405-99a4cbe6622d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:05.225873 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-93751011-161e-43b7-8405-99a4cbe6622d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:05.279990 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4c5b5e4c-6ccc-4aa1-a690-a179c367f2ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8d03bc3a10445ffa6b51d25af996bb6', 'request_id': 'req-4c5b5e4c-6ccc-4aa1-a690-a179c367f2ee'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:05.291767 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93751011-161e-43b7-8405-99a4cbe6622d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:05.296009 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4c5b5e4c-6ccc-4aa1-a690-a179c367f2ee admin admin] The token cache is being invalidate because project b8d03bc3a10445ffa6b51d25af996bb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:36:05.296146 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93751011-161e-43b7-8405-99a4cbe6622d service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:05.296250 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4c5b5e4c-6ccc-4aa1-a690-a179c367f2ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:05.296250 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4c5b5e4c-6ccc-4aa1-a690-a179c367f2ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:05.296703 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1342/2701] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:36:05 2022] DELETE /identity/v3/projects/b8d03bc3a10445ffa6b51d25af996bb6 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:36:05.300405 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b5e4c-6ccc-4aa1-a690-a179c367f2ee admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:05.302457 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4c5b5e4c-6ccc-4aa1-a690-a179c367f2ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:05.305437 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1360/2702] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:36:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:36:05.308374 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:05.370748 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b5e4c-6ccc-4aa1-a690-a179c367f2ee admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:05.375527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440767c7-882c-4338-b56f-0dd456c12361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:05.376491 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440767c7-882c-4338-b56f-0dd456c12361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:05.376784 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440767c7-882c-4338-b56f-0dd456c12361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:05.377064 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440767c7-882c-4338-b56f-0dd456c12361 admin admin] PATH_INFO: `/v3/users/4dbfb7dc3e41427ca35209a8a7a2446f` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:05.378369 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440767c7-882c-4338-b56f-0dd456c12361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dbfb7dc3e41427ca35209a8a7a2446f)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:05.380312 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440767c7-882c-4338-b56f-0dd456c12361 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:05.629160 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-440767c7-882c-4338-b56f-0dd456c12361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dbfb7dc3e41427ca35209a8a7a2446f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:05.630372 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-440767c7-882c-4338-b56f-0dd456c12361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dbfb7dc3e41427ca35209a8a7a2446f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:05.638565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-440767c7-882c-4338-b56f-0dd456c12361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dbfb7dc3e41427ca35209a8a7a2446f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:05.714763 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-440767c7-882c-4338-b56f-0dd456c12361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dbfb7dc3e41427ca35209a8a7a2446f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:05.727480 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-440767c7-882c-4338-b56f-0dd456c12361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dbfb7dc3e41427ca35209a8a7a2446f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:05.733340 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1343/2703] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:36:05 2022] DELETE /identity/v3/users/4dbfb7dc3e41427ca35209a8a7a2446f => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:36:06.211216 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93751011-161e-43b7-8405-99a4cbe6622d service cinder] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:06.222663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93751011-161e-43b7-8405-99a4cbe6622d service cinder] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:06.290466 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3550626-8fe5-4fbf-a53c-4c0078bbb678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:06.291333 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3550626-8fe5-4fbf-a53c-4c0078bbb678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:06.291629 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3550626-8fe5-4fbf-a53c-4c0078bbb678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:06.291893 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3550626-8fe5-4fbf-a53c-4c0078bbb678 admin admin] PATH_INFO: `/v3/projects/b847f375e22d4897b550c4fedaf78f97` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:06.293069 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3550626-8fe5-4fbf-a53c-4c0078bbb678 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b847f375e22d4897b550c4fedaf78f97)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:06.295753 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3550626-8fe5-4fbf-a53c-4c0078bbb678 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:06.427073 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:06.445473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-c3550626-8fe5-4fbf-a53c-4c0078bbb678 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b847f375e22d4897b550c4fedaf78f97', 'request_id': 'req-c3550626-8fe5-4fbf-a53c-4c0078bbb678'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:06.573478 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-c3550626-8fe5-4fbf-a53c-4c0078bbb678 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b847f375e22d4897b550c4fedaf78f97', 'request_id': 'req-c3550626-8fe5-4fbf-a53c-4c0078bbb678'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:06.580669 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-c3550626-8fe5-4fbf-a53c-4c0078bbb678 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b847f375e22d4897b550c4fedaf78f97', 'request_id': 'req-c3550626-8fe5-4fbf-a53c-4c0078bbb678'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:06.594871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-c3550626-8fe5-4fbf-a53c-4c0078bbb678 admin admin] The token cache is being invalidate because project b847f375e22d4897b550c4fedaf78f97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:36:06.595163 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-c3550626-8fe5-4fbf-a53c-4c0078bbb678 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:06.595893 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-c3550626-8fe5-4fbf-a53c-4c0078bbb678 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:06.597476 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1361/2704] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:36:06 2022] DELETE /identity/v3/projects/b847f375e22d4897b550c4fedaf78f97 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:36:06.603861 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1703c3-6a1b-44df-9dcf-9f394900cd69 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:06.604354 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1703c3-6a1b-44df-9dcf-9f394900cd69 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:06.604645 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1703c3-6a1b-44df-9dcf-9f394900cd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:06.624635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-0e1703c3-6a1b-44df-9dcf-9f394900cd69 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:06.626582 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-0e1703c3-6a1b-44df-9dcf-9f394900cd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:06.700315 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1344/2705] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:36:06.708827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f513b73-de45-4186-8588-8c8538e77b9a None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:06.709322 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f513b73-de45-4186-8588-8c8538e77b9a None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:06.709645 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f513b73-de45-4186-8588-8c8538e77b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:06.728173 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-2f513b73-de45-4186-8588-8c8538e77b9a None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:06.729396 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-2f513b73-de45-4186-8588-8c8538e77b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:06.738100 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1362/2706] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:36:06.742638 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1703c3-6a1b-44df-9dcf-9f394900cd69 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:06.752413 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1703c3-6a1b-44df-9dcf-9f394900cd69 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:06.758452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82000d2-c1a1-4904-b54d-7fb3bcb280b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:06.759140 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82000d2-c1a1-4904-b54d-7fb3bcb280b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:06.759432 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82000d2-c1a1-4904-b54d-7fb3bcb280b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:06.759718 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82000d2-c1a1-4904-b54d-7fb3bcb280b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:06.760461 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82000d2-c1a1-4904-b54d-7fb3bcb280b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:36:06.760838 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82000d2-c1a1-4904-b54d-7fb3bcb280b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:06.762466 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82000d2-c1a1-4904-b54d-7fb3bcb280b4 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:06.781328 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1345/2707] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:36:06.782770 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f513b73-de45-4186-8588-8c8538e77b9a None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:06.793667 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f513b73-de45-4186-8588-8c8538e77b9a None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:06.798482 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea697b-bf32-448c-9e5c-b0cc3bf1b500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:06.799130 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea697b-bf32-448c-9e5c-b0cc3bf1b500 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:06.799441 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea697b-bf32-448c-9e5c-b0cc3bf1b500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:06.799716 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea697b-bf32-448c-9e5c-b0cc3bf1b500 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:06.800401 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea697b-bf32-448c-9e5c-b0cc3bf1b500 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:06.802331 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea697b-bf32-448c-9e5c-b0cc3bf1b500 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:06.905657 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1363/2708] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:36:06 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:36:06.906746 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82000d2-c1a1-4904-b54d-7fb3bcb280b4 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:06.917086 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82000d2-c1a1-4904-b54d-7fb3bcb280b4 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:06.922565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:06.981533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c7216-bbb7-4f49-aa3e-0ce6732ba8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:06.982415 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c7216-bbb7-4f49-aa3e-0ce6732ba8ba admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:06.982765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c7216-bbb7-4f49-aa3e-0ce6732ba8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:06.983049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c7216-bbb7-4f49-aa3e-0ce6732ba8ba admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:06.983745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c7216-bbb7-4f49-aa3e-0ce6732ba8ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:06.985673 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c7216-bbb7-4f49-aa3e-0ce6732ba8ba admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:07.013045 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea697b-bf32-448c-9e5c-b0cc3bf1b500 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:07.014825 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-deea697b-bf32-448c-9e5c-b0cc3bf1b500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:07.083728 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea697b-bf32-448c-9e5c-b0cc3bf1b500 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:07.087693 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd844f-f186-4a05-9f19-93aa254fed24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:07.088343 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd844f-f186-4a05-9f19-93aa254fed24 service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:07.088630 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd844f-f186-4a05-9f19-93aa254fed24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:07.088921 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd844f-f186-4a05-9f19-93aa254fed24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:07.090789 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-cfdd844f-f186-4a05-9f19-93aa254fed24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:07.157735 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd844f-f186-4a05-9f19-93aa254fed24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:07.159143 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd844f-f186-4a05-9f19-93aa254fed24 service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:07.168854 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1364/2709] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:36:07 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:36:07.208147 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1346/2710] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:36:06 2022] POST /identity/v3/users => generated 293 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:36:07.212436 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd844f-f186-4a05-9f19-93aa254fed24 service cinder] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:07.224452 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd844f-f186-4a05-9f19-93aa254fed24 service cinder] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:07.229221 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad5611-e6bd-42ad-9a28-006687ccf092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:07.229938 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad5611-e6bd-42ad-9a28-006687ccf092 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:07.230227 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad5611-e6bd-42ad-9a28-006687ccf092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:07.230507 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad5611-e6bd-42ad-9a28-006687ccf092 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:07.231245 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad5611-e6bd-42ad-9a28-006687ccf092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:07.232859 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad5611-e6bd-42ad-9a28-006687ccf092 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:07.244083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1365/2711] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:36:07.248247 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c7216-bbb7-4f49-aa3e-0ce6732ba8ba admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:07.271692 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c7216-bbb7-4f49-aa3e-0ce6732ba8ba admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:07.271692 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40f379-34f8-46cd-b1cf-206f7091f470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:07.271692 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40f379-34f8-46cd-b1cf-206f7091f470 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:07.271692 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40f379-34f8-46cd-b1cf-206f7091f470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:07.272162 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40f379-34f8-46cd-b1cf-206f7091f470 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:07.272162 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40f379-34f8-46cd-b1cf-206f7091f470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:07.272162 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40f379-34f8-46cd-b1cf-206f7091f470 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:07.278238 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1347/2712] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:36:07.282747 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad5611-e6bd-42ad-9a28-006687ccf092 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:07.294684 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad5611-e6bd-42ad-9a28-006687ccf092 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:07.299461 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e2456-e806-457a-ae2c-594b5ae1df40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:07.300345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e2456-e806-457a-ae2c-594b5ae1df40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:07.300628 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e2456-e806-457a-ae2c-594b5ae1df40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:07.300905 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e2456-e806-457a-ae2c-594b5ae1df40 admin admin] PATH_INFO: `/v3/projects/33f05f9028294b62943dcdfc915c7223/users/e00861212cc84da38ddf044a9f31581d/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:07.319422 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e2456-e806-457a-ae2c-594b5ae1df40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33f05f9028294b62943dcdfc915c7223, user_id=e00861212cc84da38ddf044a9f31581d, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:07.324236 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e2456-e806-457a-ae2c-594b5ae1df40 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:07.391407 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:07.397670 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1366/2713] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:36:07 2022] PUT /identity/v3/projects/33f05f9028294b62943dcdfc915c7223/users/e00861212cc84da38ddf044a9f31581d/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:36:07.421437 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de87f6b-d99e-48a5-a05a-5c4d095de81a None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:07.421437 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de87f6b-d99e-48a5-a05a-5c4d095de81a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:07.421437 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de87f6b-d99e-48a5-a05a-5c4d095de81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:07.443278 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-2de87f6b-d99e-48a5-a05a-5c4d095de81a None None] MFA Rules not processed for user `e00861212cc84da38ddf044a9f31581d`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:07.444564 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2de87f6b-d99e-48a5-a05a-5c4d095de81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:07.512961 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1348/2714] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:36:07.518041 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e2456-e806-457a-ae2c-594b5ae1df40 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:07.582093 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e2456-e806-457a-ae2c-594b5ae1df40 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:07.587076 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc15b1-65d2-44f7-8967-fbf7ea34a93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:07.587739 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc15b1-65d2-44f7-8967-fbf7ea34a93b admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:07.588012 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc15b1-65d2-44f7-8967-fbf7ea34a93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:07.588290 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc15b1-65d2-44f7-8967-fbf7ea34a93b admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:07.588978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc15b1-65d2-44f7-8967-fbf7ea34a93b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:07.590965 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc15b1-65d2-44f7-8967-fbf7ea34a93b admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:07.717792 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1367/2715] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:36:07 2022] POST /identity/v3/projects => generated 387 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:36:07.721712 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de87f6b-d99e-48a5-a05a-5c4d095de81a None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:07.733325 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de87f6b-d99e-48a5-a05a-5c4d095de81a None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:07.791658 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c60e2f-b10f-4e9a-8b74-aa56a5085b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:07.797040 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c60e2f-b10f-4e9a-8b74-aa56a5085b30 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:07.797040 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c60e2f-b10f-4e9a-8b74-aa56a5085b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:07.797040 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c60e2f-b10f-4e9a-8b74-aa56a5085b30 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:07.797040 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c60e2f-b10f-4e9a-8b74-aa56a5085b30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:07.797040 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c60e2f-b10f-4e9a-8b74-aa56a5085b30 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:07.911358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1349/2716] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:36:07 2022] POST /identity/v3/users => generated 294 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:36:07.915726 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc15b1-65d2-44f7-8967-fbf7ea34a93b admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:07.929072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc15b1-65d2-44f7-8967-fbf7ea34a93b admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:07.933834 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfcd29c-08fb-454b-8951-7d2a0ec43bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:07.934500 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcd29c-08fb-454b-8951-7d2a0ec43bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:07.934816 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcd29c-08fb-454b-8951-7d2a0ec43bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:07.935098 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcd29c-08fb-454b-8951-7d2a0ec43bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:07.935832 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfcd29c-08fb-454b-8951-7d2a0ec43bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:07.937583 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfcd29c-08fb-454b-8951-7d2a0ec43bb5 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:07.948807 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1368/2717] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:36:07.953016 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c60e2f-b10f-4e9a-8b74-aa56a5085b30 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:07.963357 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c60e2f-b10f-4e9a-8b74-aa56a5085b30 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:07.968094 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0585665-42c5-4f66-b401-2f4c1e52bf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:07.968695 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0585665-42c5-4f66-b401-2f4c1e52bf20 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:07.968977 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0585665-42c5-4f66-b401-2f4c1e52bf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:07.969252 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0585665-42c5-4f66-b401-2f4c1e52bf20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:07.970006 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0585665-42c5-4f66-b401-2f4c1e52bf20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:07.971584 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0585665-42c5-4f66-b401-2f4c1e52bf20 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:07.972861 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:07.982820 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1350/2718] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:36:07.992505 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfcd29c-08fb-454b-8951-7d2a0ec43bb5 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:08.002359 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfcd29c-08fb-454b-8951-7d2a0ec43bb5 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:08.007697 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd42f7-9647-4c53-9331-082c47d7436e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:08.009133 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd42f7-9647-4c53-9331-082c47d7436e admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:08.009133 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd42f7-9647-4c53-9331-082c47d7436e admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:08.009133 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd42f7-9647-4c53-9331-082c47d7436e admin admin] PATH_INFO: `/v3/projects/b7be8323586540aba48a7ddf1f800aeb/users/dd8d79e0c8b84815b5978152990327bb/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:08.023593 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd42f7-9647-4c53-9331-082c47d7436e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7be8323586540aba48a7ddf1f800aeb, user_id=dd8d79e0c8b84815b5978152990327bb, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:08.026257 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd42f7-9647-4c53-9331-082c47d7436e admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:08.106687 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1369/2719] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:36:07 2022] PUT /identity/v3/projects/b7be8323586540aba48a7ddf1f800aeb/users/dd8d79e0c8b84815b5978152990327bb/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:36:08.117565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c250b-cd03-4ad1-9e44-8597330dd58a None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:08.123866 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c250b-cd03-4ad1-9e44-8597330dd58a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:08.123866 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c250b-cd03-4ad1-9e44-8597330dd58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:08.144484 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-1f7c250b-cd03-4ad1-9e44-8597330dd58a None None] MFA Rules not processed for user `dd8d79e0c8b84815b5978152990327bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:08.146006 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1f7c250b-cd03-4ad1-9e44-8597330dd58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:08.211332 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1351/2720] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:36:08.215871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd42f7-9647-4c53-9331-082c47d7436e admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:08.281264 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd42f7-9647-4c53-9331-082c47d7436e admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:08.286232 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb11a1c-adb5-4da4-a6ef-fa8e9f0ccea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:08.286894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb11a1c-adb5-4da4-a6ef-fa8e9f0ccea0 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:08.287163 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb11a1c-adb5-4da4-a6ef-fa8e9f0ccea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:08.287442 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb11a1c-adb5-4da4-a6ef-fa8e9f0ccea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:08.288179 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb11a1c-adb5-4da4-a6ef-fa8e9f0ccea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:08.290104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb11a1c-adb5-4da4-a6ef-fa8e9f0ccea0 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:08.387157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1370/2721] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:36:08 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:36:08.391368 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c250b-cd03-4ad1-9e44-8597330dd58a None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:08.403011 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c250b-cd03-4ad1-9e44-8597330dd58a None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:08.473257 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a280fe-5f1c-49d1-8f2e-177709510461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:08.473898 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a280fe-5f1c-49d1-8f2e-177709510461 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:08.474226 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a280fe-5f1c-49d1-8f2e-177709510461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:08.474608 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a280fe-5f1c-49d1-8f2e-177709510461 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:08.475252 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a280fe-5f1c-49d1-8f2e-177709510461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:08.477227 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a280fe-5f1c-49d1-8f2e-177709510461 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:08.591071 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1352/2722] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:36:08 2022] POST /identity/v3/users => generated 299 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:36:08.595149 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb11a1c-adb5-4da4-a6ef-fa8e9f0ccea0 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:08.608340 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb11a1c-adb5-4da4-a6ef-fa8e9f0ccea0 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:08.612978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454790e7-de03-46c6-8a34-29c759a03cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:08.615685 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454790e7-de03-46c6-8a34-29c759a03cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:08.615685 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454790e7-de03-46c6-8a34-29c759a03cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:08.615685 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454790e7-de03-46c6-8a34-29c759a03cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:08.615685 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454790e7-de03-46c6-8a34-29c759a03cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:08.617001 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454790e7-de03-46c6-8a34-29c759a03cf4 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:08.620118 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a280fe-5f1c-49d1-8f2e-177709510461 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:08.621983 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f0a280fe-5f1c-49d1-8f2e-177709510461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:08.629795 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1371/2723] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:36:08.632820 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454790e7-de03-46c6-8a34-29c759a03cf4 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:08.643340 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454790e7-de03-46c6-8a34-29c759a03cf4 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:08.649102 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a54e0-4010-46a6-a90d-0ae98a3cb86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:08.650083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a54e0-4010-46a6-a90d-0ae98a3cb86c admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:08.650370 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a54e0-4010-46a6-a90d-0ae98a3cb86c admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:08.650648 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a54e0-4010-46a6-a90d-0ae98a3cb86c admin admin] PATH_INFO: `/v3/projects/2f14344553f24477b62a39d1a3b13f52/users/a34158937cac40f48b61f4adf7567c55/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:08.668167 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a54e0-4010-46a6-a90d-0ae98a3cb86c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f14344553f24477b62a39d1a3b13f52, user_id=a34158937cac40f48b61f4adf7567c55, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:08.671235 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a54e0-4010-46a6-a90d-0ae98a3cb86c admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:08.685220 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a280fe-5f1c-49d1-8f2e-177709510461 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:08.689064 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee28ff0-5b56-47fe-974e-c7deaa33654f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:08.689728 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee28ff0-5b56-47fe-974e-c7deaa33654f service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:08.690045 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee28ff0-5b56-47fe-974e-c7deaa33654f service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:08.690469 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee28ff0-5b56-47fe-974e-c7deaa33654f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:08.692301 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-dee28ff0-5b56-47fe-974e-c7deaa33654f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:08.722418 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:08.756191 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee28ff0-5b56-47fe-974e-c7deaa33654f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:08.757627 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee28ff0-5b56-47fe-974e-c7deaa33654f service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:08.763763 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:08.768691 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1353/2724] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:36:08 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:36:08.772187 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1372/2725] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:36:08 2022] PUT /identity/v3/projects/2f14344553f24477b62a39d1a3b13f52/users/a34158937cac40f48b61f4adf7567c55/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:36:08.776087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee28ff0-5b56-47fe-974e-c7deaa33654f service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:08.787471 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee28ff0-5b56-47fe-974e-c7deaa33654f service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:08.853565 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659f63a-0c90-498b-80e4-803ddac1ac09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:08.854307 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659f63a-0c90-498b-80e4-803ddac1ac09 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:08.854600 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659f63a-0c90-498b-80e4-803ddac1ac09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:08.854886 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659f63a-0c90-498b-80e4-803ddac1ac09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:08.855614 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659f63a-0c90-498b-80e4-803ddac1ac09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:08.857210 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659f63a-0c90-498b-80e4-803ddac1ac09 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:08.867500 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1354/2726] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:36:08.871705 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a54e0-4010-46a6-a90d-0ae98a3cb86c admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:08.883031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a54e0-4010-46a6-a90d-0ae98a3cb86c admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:08.887721 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a99fb0-c14c-487b-ad1c-28fd2a2676a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:08.888597 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a99fb0-c14c-487b-ad1c-28fd2a2676a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:08.888901 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a99fb0-c14c-487b-ad1c-28fd2a2676a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:08.889165 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a99fb0-c14c-487b-ad1c-28fd2a2676a2 admin admin] PATH_INFO: `/v3/projects/2f14344553f24477b62a39d1a3b13f52/users/a34158937cac40f48b61f4adf7567c55/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:08.891203 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a99fb0-c14c-487b-ad1c-28fd2a2676a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f14344553f24477b62a39d1a3b13f52, user_id=a34158937cac40f48b61f4adf7567c55, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:08.893871 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a99fb0-c14c-487b-ad1c-28fd2a2676a2 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:08.912388 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1373/2727] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:36:08 2022] PUT /identity/v3/projects/2f14344553f24477b62a39d1a3b13f52/users/a34158937cac40f48b61f4adf7567c55/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:36:08.922308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be50862-ae9c-462f-913f-ed0befe3a83e None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:08.922625 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be50862-ae9c-462f-913f-ed0befe3a83e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:08.922908 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be50862-ae9c-462f-913f-ed0befe3a83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:08.951851 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-8be50862-ae9c-462f-913f-ed0befe3a83e None None] MFA Rules not processed for user `a34158937cac40f48b61f4adf7567c55`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:08.953062 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8be50862-ae9c-462f-913f-ed0befe3a83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:09.046532 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1355/2728] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:36:09.058518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a99fb0-c14c-487b-ad1c-28fd2a2676a2 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:09.062353 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-b6a99fb0-c14c-487b-ad1c-28fd2a2676a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:09.126333 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a99fb0-c14c-487b-ad1c-28fd2a2676a2 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:09.131368 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795c5b8-0b51-4ae4-a8ca-5076fc5acd90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:09.136838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795c5b8-0b51-4ae4-a8ca-5076fc5acd90 service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:09.136838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795c5b8-0b51-4ae4-a8ca-5076fc5acd90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:09.136838 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795c5b8-0b51-4ae4-a8ca-5076fc5acd90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:09.148137 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795c5b8-0b51-4ae4-a8ca-5076fc5acd90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:09.149801 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795c5b8-0b51-4ae4-a8ca-5076fc5acd90 service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:09.161139 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1374/2729] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:36:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:36:10.438291 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be50862-ae9c-462f-913f-ed0befe3a83e None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:10.448548 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be50862-ae9c-462f-913f-ed0befe3a83e None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:10.452079 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efadf0-484f-43db-b3dc-e102d72f3711 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:10.452724 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efadf0-484f-43db-b3dc-e102d72f3711 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:10.453007 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efadf0-484f-43db-b3dc-e102d72f3711 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:10.453284 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efadf0-484f-43db-b3dc-e102d72f3711 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:10.497313 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:10.510988 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efadf0-484f-43db-b3dc-e102d72f3711 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:10.512456 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efadf0-484f-43db-b3dc-e102d72f3711 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:10.522099 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1356/2730] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:36:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:36:12.944917 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795c5b8-0b51-4ae4-a8ca-5076fc5acd90 service cinder] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:12.946384 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-b795c5b8-0b51-4ae4-a8ca-5076fc5acd90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:13.012149 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795c5b8-0b51-4ae4-a8ca-5076fc5acd90 service cinder] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:13.016642 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca7639-5974-4c1c-9723-82ba79ae3d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:13.017441 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca7639-5974-4c1c-9723-82ba79ae3d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:13.017730 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca7639-5974-4c1c-9723-82ba79ae3d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:13.018045 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca7639-5974-4c1c-9723-82ba79ae3d38 admin admin] PATH_INFO: `/v3/users/1dfe05bd9459421ab0de8b991c11abfd` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:13.019226 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca7639-5974-4c1c-9723-82ba79ae3d38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dfe05bd9459421ab0de8b991c11abfd)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:13.023945 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca7639-5974-4c1c-9723-82ba79ae3d38 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:13.205018 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-01ca7639-5974-4c1c-9723-82ba79ae3d38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dfe05bd9459421ab0de8b991c11abfd'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:13.292987 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-01ca7639-5974-4c1c-9723-82ba79ae3d38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dfe05bd9459421ab0de8b991c11abfd'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:13.300600 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-01ca7639-5974-4c1c-9723-82ba79ae3d38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dfe05bd9459421ab0de8b991c11abfd'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:13.302391 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-01ca7639-5974-4c1c-9723-82ba79ae3d38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dfe05bd9459421ab0de8b991c11abfd'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:13.302535 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-01ca7639-5974-4c1c-9723-82ba79ae3d38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dfe05bd9459421ab0de8b991c11abfd'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:13.320103 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1375/2731] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:36:12 2022] DELETE /identity/v3/users/1dfe05bd9459421ab0de8b991c11abfd => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:36:13.324836 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bc5b8-8cc0-4887-9a5e-fc3016c7efb6 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:13.327898 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bc5b8-8cc0-4887-9a5e-fc3016c7efb6 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:13.327898 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bc5b8-8cc0-4887-9a5e-fc3016c7efb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:13.342757 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-f43bc5b8-8cc0-4887-9a5e-fc3016c7efb6 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:13.343975 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f43bc5b8-8cc0-4887-9a5e-fc3016c7efb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:13.402860 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1357/2732] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:36:13.413103 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca7639-5974-4c1c-9723-82ba79ae3d38 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:13.414507 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-01ca7639-5974-4c1c-9723-82ba79ae3d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:13.425353 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:13.471257 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca7639-5974-4c1c-9723-82ba79ae3d38 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:13.475976 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4339a65-042e-4bf1-ba75-a75823e04f07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:13.476596 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4339a65-042e-4bf1-ba75-a75823e04f07 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:13.476885 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4339a65-042e-4bf1-ba75-a75823e04f07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:13.478242 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4339a65-042e-4bf1-ba75-a75823e04f07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:13.492137 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4339a65-042e-4bf1-ba75-a75823e04f07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:13.492137 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4339a65-042e-4bf1-ba75-a75823e04f07 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:13.505456 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1376/2733] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:36:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:36:13.917468 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43bc5b8-8cc0-4887-9a5e-fc3016c7efb6 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:13.919288 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f43bc5b8-8cc0-4887-9a5e-fc3016c7efb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:13.933213 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43bc5b8-8cc0-4887-9a5e-fc3016c7efb6 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:13.937911 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f65c9-8f7a-4fff-b137-9082997091ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:13.938795 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f65c9-8f7a-4fff-b137-9082997091ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:13.939083 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f65c9-8f7a-4fff-b137-9082997091ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:13.939365 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f65c9-8f7a-4fff-b137-9082997091ad admin admin] PATH_INFO: `/v3/projects/2044ea917268495ea19609bf180a0737` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:13.940558 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f65c9-8f7a-4fff-b137-9082997091ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=2044ea917268495ea19609bf180a0737)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:13.942951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f65c9-8f7a-4fff-b137-9082997091ad admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:14.050669 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-637f65c9-8f7a-4fff-b137-9082997091ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2044ea917268495ea19609bf180a0737', 'request_id': 'req-637f65c9-8f7a-4fff-b137-9082997091ad'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:14.056435 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-637f65c9-8f7a-4fff-b137-9082997091ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2044ea917268495ea19609bf180a0737', 'request_id': 'req-637f65c9-8f7a-4fff-b137-9082997091ad'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:14.133427 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-637f65c9-8f7a-4fff-b137-9082997091ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2044ea917268495ea19609bf180a0737', 'request_id': 'req-637f65c9-8f7a-4fff-b137-9082997091ad'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:14.146164 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-637f65c9-8f7a-4fff-b137-9082997091ad admin admin] The token cache is being invalidate because project 2044ea917268495ea19609bf180a0737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:36:14.146496 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-637f65c9-8f7a-4fff-b137-9082997091ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:14.147115 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-637f65c9-8f7a-4fff-b137-9082997091ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:14.148661 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1358/2734] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:36:13 2022] DELETE /identity/v3/projects/2044ea917268495ea19609bf180a0737 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:36:14.152788 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4339a65-042e-4bf1-ba75-a75823e04f07 service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:14.163532 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4339a65-042e-4bf1-ba75-a75823e04f07 service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:14.222741 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cdb25-a9ca-4a8c-90c6-45b08557fd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:14.223897 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cdb25-a9ca-4a8c-90c6-45b08557fd36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:14.224192 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cdb25-a9ca-4a8c-90c6-45b08557fd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:14.224475 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cdb25-a9ca-4a8c-90c6-45b08557fd36 admin admin] PATH_INFO: `/v3/users/a1ad51cae85b48d5867ecb183f814ca0` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:14.225718 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17cdb25-a9ca-4a8c-90c6-45b08557fd36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1ad51cae85b48d5867ecb183f814ca0)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:14.227692 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17cdb25-a9ca-4a8c-90c6-45b08557fd36 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:14.427275 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-b17cdb25-a9ca-4a8c-90c6-45b08557fd36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1ad51cae85b48d5867ecb183f814ca0'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:14.510468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-b17cdb25-a9ca-4a8c-90c6-45b08557fd36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1ad51cae85b48d5867ecb183f814ca0'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:14.517745 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-b17cdb25-a9ca-4a8c-90c6-45b08557fd36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1ad51cae85b48d5867ecb183f814ca0'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:14.518447 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-b17cdb25-a9ca-4a8c-90c6-45b08557fd36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1ad51cae85b48d5867ecb183f814ca0'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:14.519052 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-b17cdb25-a9ca-4a8c-90c6-45b08557fd36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1ad51cae85b48d5867ecb183f814ca0'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:14.536068 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1377/2735] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:36:14 2022] DELETE /identity/v3/users/a1ad51cae85b48d5867ecb183f814ca0 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:36:14.980020 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f65c9-8f7a-4fff-b137-9082997091ad admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:14.980020 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-637f65c9-8f7a-4fff-b137-9082997091ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:14.994101 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f65c9-8f7a-4fff-b137-9082997091ad admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:15.058358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8309f9-465e-422d-9ebb-f9cf830c39ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:15.059232 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8309f9-465e-422d-9ebb-f9cf830c39ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:15.059515 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8309f9-465e-422d-9ebb-f9cf830c39ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:15.059791 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8309f9-465e-422d-9ebb-f9cf830c39ec admin admin] PATH_INFO: `/v3/projects/a854b4156da74499a99ffe8f8b9af108` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:15.060984 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8309f9-465e-422d-9ebb-f9cf830c39ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=a854b4156da74499a99ffe8f8b9af108)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:15.062941 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8309f9-465e-422d-9ebb-f9cf830c39ec admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:15.075606 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:15.218381 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bd8309f9-465e-422d-9ebb-f9cf830c39ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a854b4156da74499a99ffe8f8b9af108', 'request_id': 'req-bd8309f9-465e-422d-9ebb-f9cf830c39ec'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:15.229109 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bd8309f9-465e-422d-9ebb-f9cf830c39ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a854b4156da74499a99ffe8f8b9af108', 'request_id': 'req-bd8309f9-465e-422d-9ebb-f9cf830c39ec'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:15.293189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bd8309f9-465e-422d-9ebb-f9cf830c39ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a854b4156da74499a99ffe8f8b9af108', 'request_id': 'req-bd8309f9-465e-422d-9ebb-f9cf830c39ec'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:15.309288 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bd8309f9-465e-422d-9ebb-f9cf830c39ec admin admin] The token cache is being invalidate because project a854b4156da74499a99ffe8f8b9af108 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:36:15.309586 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bd8309f9-465e-422d-9ebb-f9cf830c39ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:15.310312 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bd8309f9-465e-422d-9ebb-f9cf830c39ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:15.312301 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1359/2736] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:36:14 2022] DELETE /identity/v3/projects/a854b4156da74499a99ffe8f8b9af108 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:36:15.316114 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cdb25-a9ca-4a8c-90c6-45b08557fd36 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:15.317870 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-b17cdb25-a9ca-4a8c-90c6-45b08557fd36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:15.330840 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cdb25-a9ca-4a8c-90c6-45b08557fd36 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:15.364840 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8309f9-465e-422d-9ebb-f9cf830c39ec admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:15.366585 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-bd8309f9-465e-422d-9ebb-f9cf830c39ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:15.371057 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:15.405119 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8c61c-e951-4ca6-a152-0b0c1e440e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:15.406062 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8c61c-e951-4ca6-a152-0b0c1e440e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:15.406398 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8c61c-e951-4ca6-a152-0b0c1e440e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:15.406682 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8c61c-e951-4ca6-a152-0b0c1e440e61 admin admin] PATH_INFO: `/v3/users/07293d3a4af94c3580e91e3b74c4c676` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:15.407956 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8c61c-e951-4ca6-a152-0b0c1e440e61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07293d3a4af94c3580e91e3b74c4c676)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:15.410094 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8c61c-e951-4ca6-a152-0b0c1e440e61 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:15.459725 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8309f9-465e-422d-9ebb-f9cf830c39ec admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:15.465472 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142df1b-a2a4-490b-a46e-d0108072fec1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:15.466508 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142df1b-a2a4-490b-a46e-d0108072fec1 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:15.466974 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142df1b-a2a4-490b-a46e-d0108072fec1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:15.467407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142df1b-a2a4-490b-a46e-d0108072fec1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:15.470003 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1142df1b-a2a4-490b-a46e-d0108072fec1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:15.551533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142df1b-a2a4-490b-a46e-d0108072fec1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:15.552809 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142df1b-a2a4-490b-a46e-d0108072fec1 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:15.562826 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1360/2737] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:36:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:36:15.617663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-78c8c61c-e951-4ca6-a152-0b0c1e440e61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07293d3a4af94c3580e91e3b74c4c676'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:15.709630 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-78c8c61c-e951-4ca6-a152-0b0c1e440e61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07293d3a4af94c3580e91e3b74c4c676'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:15.717530 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-78c8c61c-e951-4ca6-a152-0b0c1e440e61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07293d3a4af94c3580e91e3b74c4c676'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:15.718293 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-78c8c61c-e951-4ca6-a152-0b0c1e440e61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07293d3a4af94c3580e91e3b74c4c676'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:15.718897 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-78c8c61c-e951-4ca6-a152-0b0c1e440e61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07293d3a4af94c3580e91e3b74c4c676'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:15.740047 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1378/2738] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:36:15 2022] DELETE /identity/v3/users/07293d3a4af94c3580e91e3b74c4c676 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:36:16.100040 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142df1b-a2a4-490b-a46e-d0108072fec1 service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:16.101542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1142df1b-a2a4-490b-a46e-d0108072fec1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:16.162416 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142df1b-a2a4-490b-a46e-d0108072fec1 service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:16.167858 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:16.193792 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8c61c-e951-4ca6-a152-0b0c1e440e61 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:16.195615 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-78c8c61c-e951-4ca6-a152-0b0c1e440e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:16.224869 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b871fe-4fc0-4f8d-8895-32e55b82aa1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:16.225529 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b871fe-4fc0-4f8d-8895-32e55b82aa1e service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:16.225897 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b871fe-4fc0-4f8d-8895-32e55b82aa1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:16.226115 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b871fe-4fc0-4f8d-8895-32e55b82aa1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:16.228021 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e7b871fe-4fc0-4f8d-8895-32e55b82aa1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:16.302147 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8c61c-e951-4ca6-a152-0b0c1e440e61 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:16.307285 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b6f93-1604-411e-bb3e-4f403e226f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:16.308160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b6f93-1604-411e-bb3e-4f403e226f6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:16.308446 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b6f93-1604-411e-bb3e-4f403e226f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:16.308727 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b6f93-1604-411e-bb3e-4f403e226f6e admin admin] PATH_INFO: `/v3/projects/c12a7c639405467280a0d2df17f826c2` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:16.310393 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b6f93-1604-411e-bb3e-4f403e226f6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c12a7c639405467280a0d2df17f826c2)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:16.312623 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b6f93-1604-411e-bb3e-4f403e226f6e admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:16.331587 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b871fe-4fc0-4f8d-8895-32e55b82aa1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:16.333083 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b871fe-4fc0-4f8d-8895-32e55b82aa1e service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:16.348743 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1361/2739] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:36:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:36:16.436266 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-d84b6f93-1604-411e-bb3e-4f403e226f6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c12a7c639405467280a0d2df17f826c2', 'request_id': 'req-d84b6f93-1604-411e-bb3e-4f403e226f6e'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:16.439957 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:16.526544 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-d84b6f93-1604-411e-bb3e-4f403e226f6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c12a7c639405467280a0d2df17f826c2', 'request_id': 'req-d84b6f93-1604-411e-bb3e-4f403e226f6e'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:16.533730 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-d84b6f93-1604-411e-bb3e-4f403e226f6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c12a7c639405467280a0d2df17f826c2', 'request_id': 'req-d84b6f93-1604-411e-bb3e-4f403e226f6e'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:16.545151 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-d84b6f93-1604-411e-bb3e-4f403e226f6e admin admin] The token cache is being invalidate because project c12a7c639405467280a0d2df17f826c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:36:16.545441 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-d84b6f93-1604-411e-bb3e-4f403e226f6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:16.546123 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-d84b6f93-1604-411e-bb3e-4f403e226f6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:16.547671 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1379/2740] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:36:16 2022] DELETE /identity/v3/projects/c12a7c639405467280a0d2df17f826c2 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:36:16.554718 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2fc61-8445-409d-a8d5-e9cbe09fa03d None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:16.555091 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2fc61-8445-409d-a8d5-e9cbe09fa03d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:16.556222 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2fc61-8445-409d-a8d5-e9cbe09fa03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:16.579064 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-bef2fc61-8445-409d-a8d5-e9cbe09fa03d None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:16.580440 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-bef2fc61-8445-409d-a8d5-e9cbe09fa03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:16.641397 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1362/2741] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:36:16.707279 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be7181-2aa0-4e70-9b32-fb9961051357 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:16.707608 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be7181-2aa0-4e70-9b32-fb9961051357 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:16.708047 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be7181-2aa0-4e70-9b32-fb9961051357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:16.730040 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-a5be7181-2aa0-4e70-9b32-fb9961051357 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:16.731273 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-a5be7181-2aa0-4e70-9b32-fb9961051357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:16.740253 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1380/2742] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:36:16.745473 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2fc61-8445-409d-a8d5-e9cbe09fa03d None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:16.765143 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2fc61-8445-409d-a8d5-e9cbe09fa03d None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:16.770515 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1683d8-f80d-4140-a6fa-6aff34e8490f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:16.771197 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1683d8-f80d-4140-a6fa-6aff34e8490f admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:16.771484 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1683d8-f80d-4140-a6fa-6aff34e8490f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:16.771764 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1683d8-f80d-4140-a6fa-6aff34e8490f admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:16.772605 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1683d8-f80d-4140-a6fa-6aff34e8490f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:36:16.772921 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1683d8-f80d-4140-a6fa-6aff34e8490f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:16.774608 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1683d8-f80d-4140-a6fa-6aff34e8490f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:16.787287 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1363/2743] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:36:16.791793 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be7181-2aa0-4e70-9b32-fb9961051357 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:16.801099 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be7181-2aa0-4e70-9b32-fb9961051357 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:16.806576 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc4c99-7ca9-4b1b-ad08-7c229e13d789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:16.806804 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc4c99-7ca9-4b1b-ad08-7c229e13d789 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:16.807089 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc4c99-7ca9-4b1b-ad08-7c229e13d789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:16.807365 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc4c99-7ca9-4b1b-ad08-7c229e13d789 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:16.808052 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc4c99-7ca9-4b1b-ad08-7c229e13d789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:16.810089 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc4c99-7ca9-4b1b-ad08-7c229e13d789 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:16.906721 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1381/2744] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:36:16 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:36:16.911413 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1683d8-f80d-4140-a6fa-6aff34e8490f admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:16.921890 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1683d8-f80d-4140-a6fa-6aff34e8490f admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:16.956799 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:16.980939 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fbb61-8ead-4902-b791-dd27d6d7ac93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:16.981619 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fbb61-8ead-4902-b791-dd27d6d7ac93 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:16.981944 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fbb61-8ead-4902-b791-dd27d6d7ac93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:16.982255 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fbb61-8ead-4902-b791-dd27d6d7ac93 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:16.982955 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07fbb61-8ead-4902-b791-dd27d6d7ac93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:16.984954 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07fbb61-8ead-4902-b791-dd27d6d7ac93 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:17.089080 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1364/2745] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:36:16 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:36:17.095541 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc4c99-7ca9-4b1b-ad08-7c229e13d789 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:17.107396 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc4c99-7ca9-4b1b-ad08-7c229e13d789 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:17.112146 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831c98f-a983-413b-b2fe-76aff14a1455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:17.112785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831c98f-a983-413b-b2fe-76aff14a1455 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:17.113072 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831c98f-a983-413b-b2fe-76aff14a1455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:17.113349 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831c98f-a983-413b-b2fe-76aff14a1455 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:17.114242 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831c98f-a983-413b-b2fe-76aff14a1455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:17.115837 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831c98f-a983-413b-b2fe-76aff14a1455 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:17.131736 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1382/2746] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:36:17.134464 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fbb61-8ead-4902-b791-dd27d6d7ac93 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:17.144641 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fbb61-8ead-4902-b791-dd27d6d7ac93 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:17.150600 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b268f-c2b1-4e8c-b46e-4602eba7dc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:17.151268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b268f-c2b1-4e8c-b46e-4602eba7dc58 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:17.151556 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b268f-c2b1-4e8c-b46e-4602eba7dc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:17.151837 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b268f-c2b1-4e8c-b46e-4602eba7dc58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:17.152574 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b268f-c2b1-4e8c-b46e-4602eba7dc58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:17.154198 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b268f-c2b1-4e8c-b46e-4602eba7dc58 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:17.167988 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1365/2747] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:36:17.169364 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831c98f-a983-413b-b2fe-76aff14a1455 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:17.180136 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831c98f-a983-413b-b2fe-76aff14a1455 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:17.189378 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c23b0-1216-4e75-a914-3461167ca037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:17.189378 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c23b0-1216-4e75-a914-3461167ca037 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:17.189378 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c23b0-1216-4e75-a914-3461167ca037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:17.189378 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c23b0-1216-4e75-a914-3461167ca037 admin admin] PATH_INFO: `/v3/projects/29e66bcfe54a47f0b5313fb0b2a95f0e/users/d7bb4ddc5eb94072b2741fe1d08ceb99/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:17.203894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c23b0-1216-4e75-a914-3461167ca037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29e66bcfe54a47f0b5313fb0b2a95f0e, user_id=d7bb4ddc5eb94072b2741fe1d08ceb99, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:17.206635 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c23b0-1216-4e75-a914-3461167ca037 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:17.299206 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1383/2748] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:36:17 2022] PUT /identity/v3/projects/29e66bcfe54a47f0b5313fb0b2a95f0e/users/d7bb4ddc5eb94072b2741fe1d08ceb99/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:36:17.309423 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2932b0-6e3c-48e2-9c6f-8ca8876d8b34 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:17.309737 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2932b0-6e3c-48e2-9c6f-8ca8876d8b34 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:17.310056 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2932b0-6e3c-48e2-9c6f-8ca8876d8b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:17.337824 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-8b2932b0-6e3c-48e2-9c6f-8ca8876d8b34 None None] MFA Rules not processed for user `d7bb4ddc5eb94072b2741fe1d08ceb99`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:17.339025 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8b2932b0-6e3c-48e2-9c6f-8ca8876d8b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:17.406466 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1366/2749] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:36:17.418663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c23b0-1216-4e75-a914-3461167ca037 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:17.420564 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-ad5c23b0-1216-4e75-a914-3461167ca037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:17.483879 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c23b0-1216-4e75-a914-3461167ca037 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:17.487715 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c18b0-9179-4fca-8d25-6878b0016072 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:17.488399 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c18b0-9179-4fca-8d25-6878b0016072 service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:17.488726 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c18b0-9179-4fca-8d25-6878b0016072 service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:17.489980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c18b0-9179-4fca-8d25-6878b0016072 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:17.498875 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c18b0-9179-4fca-8d25-6878b0016072 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:17.500290 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c18b0-9179-4fca-8d25-6878b0016072 service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:17.509826 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1384/2750] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:36:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:36:19.882699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2932b0-6e3c-48e2-9c6f-8ca8876d8b34 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:19.884379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8b2932b0-6e3c-48e2-9c6f-8ca8876d8b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:19.950321 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2932b0-6e3c-48e2-9c6f-8ca8876d8b34 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:19.954772 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbdec6b-4717-47b6-95d0-b29e041c77f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:19.955637 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdec6b-4717-47b6-95d0-b29e041c77f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:19.955927 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdec6b-4717-47b6-95d0-b29e041c77f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:19.956204 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdec6b-4717-47b6-95d0-b29e041c77f9 admin admin] PATH_INFO: `/v3/users/e00861212cc84da38ddf044a9f31581d` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:19.957386 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbdec6b-4717-47b6-95d0-b29e041c77f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e00861212cc84da38ddf044a9f31581d)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:19.960292 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbdec6b-4717-47b6-95d0-b29e041c77f9 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:20.198772 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-5cbdec6b-4717-47b6-95d0-b29e041c77f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e00861212cc84da38ddf044a9f31581d'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:20.199568 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-5cbdec6b-4717-47b6-95d0-b29e041c77f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e00861212cc84da38ddf044a9f31581d'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:20.201387 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:20.208664 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-5cbdec6b-4717-47b6-95d0-b29e041c77f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e00861212cc84da38ddf044a9f31581d'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:20.282091 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-5cbdec6b-4717-47b6-95d0-b29e041c77f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e00861212cc84da38ddf044a9f31581d'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:20.294757 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-5cbdec6b-4717-47b6-95d0-b29e041c77f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e00861212cc84da38ddf044a9f31581d'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:20.300780 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1367/2751] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:36:19 2022] DELETE /identity/v3/users/e00861212cc84da38ddf044a9f31581d => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:36:20.305178 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f93ffb-03ca-44e2-ac90-aa147c97bfed None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:20.305661 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f93ffb-03ca-44e2-ac90-aa147c97bfed None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:20.305819 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f93ffb-03ca-44e2-ac90-aa147c97bfed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:20.323383 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-e7f93ffb-03ca-44e2-ac90-aa147c97bfed None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:20.324573 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-e7f93ffb-03ca-44e2-ac90-aa147c97bfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:20.382351 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1385/2752] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:36:20.391829 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbdec6b-4717-47b6-95d0-b29e041c77f9 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:20.393313 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-5cbdec6b-4717-47b6-95d0-b29e041c77f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:20.450948 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbdec6b-4717-47b6-95d0-b29e041c77f9 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:20.454496 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a5fcf-51f6-4186-91bd-6e515bdc85ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:20.455165 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a5fcf-51f6-4186-91bd-6e515bdc85ee service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:20.455446 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a5fcf-51f6-4186-91bd-6e515bdc85ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:20.455723 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a5fcf-51f6-4186-91bd-6e515bdc85ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:20.465576 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a5fcf-51f6-4186-91bd-6e515bdc85ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:20.467016 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a5fcf-51f6-4186-91bd-6e515bdc85ee service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:20.476316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1368/2753] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:36:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:36:20.838044 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f93ffb-03ca-44e2-ac90-aa147c97bfed None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:20.839729 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-e7f93ffb-03ca-44e2-ac90-aa147c97bfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:20.852539 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f93ffb-03ca-44e2-ac90-aa147c97bfed None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:20.857346 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6552e1d-04d8-4ab0-b5f3-b3ea5a351ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:20.858252 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6552e1d-04d8-4ab0-b5f3-b3ea5a351ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:20.858537 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6552e1d-04d8-4ab0-b5f3-b3ea5a351ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:20.858812 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6552e1d-04d8-4ab0-b5f3-b3ea5a351ba0 admin admin] PATH_INFO: `/v3/users/d7bb4ddc5eb94072b2741fe1d08ceb99` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:20.860064 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6552e1d-04d8-4ab0-b5f3-b3ea5a351ba0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7bb4ddc5eb94072b2741fe1d08ceb99)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:20.862015 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6552e1d-04d8-4ab0-b5f3-b3ea5a351ba0 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:20.878801 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:20.905249 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a5fcf-51f6-4186-91bd-6e515bdc85ee service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:20.907111 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-dd2a5fcf-51f6-4186-91bd-6e515bdc85ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:20.930383 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a5fcf-51f6-4186-91bd-6e515bdc85ee service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:20.935609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befdec0-6109-4b70-8d3d-9d1d9c6b5af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:20.937433 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befdec0-6109-4b70-8d3d-9d1d9c6b5af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:20.937735 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befdec0-6109-4b70-8d3d-9d1d9c6b5af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:20.938073 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befdec0-6109-4b70-8d3d-9d1d9c6b5af3 admin admin] PATH_INFO: `/v3/projects/33f05f9028294b62943dcdfc915c7223` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:20.939379 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befdec0-6109-4b70-8d3d-9d1d9c6b5af3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33f05f9028294b62943dcdfc915c7223)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:20.941221 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befdec0-6109-4b70-8d3d-9d1d9c6b5af3 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:21.047966 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-a6552e1d-04d8-4ab0-b5f3-b3ea5a351ba0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7bb4ddc5eb94072b2741fe1d08ceb99'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:21.071504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8befdec0-6109-4b70-8d3d-9d1d9c6b5af3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33f05f9028294b62943dcdfc915c7223', 'request_id': 'req-8befdec0-6109-4b70-8d3d-9d1d9c6b5af3'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:21.076987 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8befdec0-6109-4b70-8d3d-9d1d9c6b5af3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33f05f9028294b62943dcdfc915c7223', 'request_id': 'req-8befdec0-6109-4b70-8d3d-9d1d9c6b5af3'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:21.093462 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-a6552e1d-04d8-4ab0-b5f3-b3ea5a351ba0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7bb4ddc5eb94072b2741fe1d08ceb99'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:21.100886 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-a6552e1d-04d8-4ab0-b5f3-b3ea5a351ba0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7bb4ddc5eb94072b2741fe1d08ceb99'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:21.101530 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-a6552e1d-04d8-4ab0-b5f3-b3ea5a351ba0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7bb4ddc5eb94072b2741fe1d08ceb99'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:21.102182 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-a6552e1d-04d8-4ab0-b5f3-b3ea5a351ba0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7bb4ddc5eb94072b2741fe1d08ceb99'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:21.122332 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1386/2754] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:36:20 2022] DELETE /identity/v3/users/d7bb4ddc5eb94072b2741fe1d08ceb99 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:36:21.127185 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259cf63-5b3b-49cb-883d-a493f23ba4f7 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:21.127477 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259cf63-5b3b-49cb-883d-a493f23ba4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:21.127943 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259cf63-5b3b-49cb-883d-a493f23ba4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:21.139124 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8befdec0-6109-4b70-8d3d-9d1d9c6b5af3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33f05f9028294b62943dcdfc915c7223', 'request_id': 'req-8befdec0-6109-4b70-8d3d-9d1d9c6b5af3'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:21.147196 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-2259cf63-5b3b-49cb-883d-a493f23ba4f7 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:21.148339 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-2259cf63-5b3b-49cb-883d-a493f23ba4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:21.152358 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8befdec0-6109-4b70-8d3d-9d1d9c6b5af3 admin admin] The token cache is being invalidate because project 33f05f9028294b62943dcdfc915c7223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:36:21.152669 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8befdec0-6109-4b70-8d3d-9d1d9c6b5af3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:21.153312 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8befdec0-6109-4b70-8d3d-9d1d9c6b5af3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:21.155189 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1369/2755] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:36:20 2022] DELETE /identity/v3/projects/33f05f9028294b62943dcdfc915c7223 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:36:21.158993 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befdec0-6109-4b70-8d3d-9d1d9c6b5af3 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:21.160344 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8befdec0-6109-4b70-8d3d-9d1d9c6b5af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:21.218389 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1387/2756] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:36:21.225619 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:21.229198 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259cf63-5b3b-49cb-883d-a493f23ba4f7 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:21.230721 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-2259cf63-5b3b-49cb-883d-a493f23ba4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:21.240528 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befdec0-6109-4b70-8d3d-9d1d9c6b5af3 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:21.246901 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711cb681-280a-4a91-a536-d5f381ac4345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:21.247950 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cb681-280a-4a91-a536-d5f381ac4345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:21.248879 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cb681-280a-4a91-a536-d5f381ac4345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:21.248879 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cb681-280a-4a91-a536-d5f381ac4345 admin admin] PATH_INFO: `/v3/users/dd8d79e0c8b84815b5978152990327bb` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:21.250060 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711cb681-280a-4a91-a536-d5f381ac4345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd8d79e0c8b84815b5978152990327bb)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:21.252031 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711cb681-280a-4a91-a536-d5f381ac4345 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:21.297316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259cf63-5b3b-49cb-883d-a493f23ba4f7 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:21.300949 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5ac91-7ec2-4fb2-a087-b4b558f331e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:21.302243 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5ac91-7ec2-4fb2-a087-b4b558f331e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:21.302486 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5ac91-7ec2-4fb2-a087-b4b558f331e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:21.302765 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5ac91-7ec2-4fb2-a087-b4b558f331e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:21.312249 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5ac91-7ec2-4fb2-a087-b4b558f331e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:21.313695 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5ac91-7ec2-4fb2-a087-b4b558f331e6 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:21.324842 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1388/2757] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:36:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:36:21.453867 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-711cb681-280a-4a91-a536-d5f381ac4345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd8d79e0c8b84815b5978152990327bb'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:21.454527 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-711cb681-280a-4a91-a536-d5f381ac4345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd8d79e0c8b84815b5978152990327bb'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:21.462177 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-711cb681-280a-4a91-a536-d5f381ac4345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd8d79e0c8b84815b5978152990327bb'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:21.527488 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-711cb681-280a-4a91-a536-d5f381ac4345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd8d79e0c8b84815b5978152990327bb'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:21.541258 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-711cb681-280a-4a91-a536-d5f381ac4345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd8d79e0c8b84815b5978152990327bb'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:21.553232 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1370/2758] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:36:21 2022] DELETE /identity/v3/users/dd8d79e0c8b84815b5978152990327bb => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:36:21.775658 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5ac91-7ec2-4fb2-a087-b4b558f331e6 service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:21.775658 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-6df5ac91-7ec2-4fb2-a087-b4b558f331e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:21.788939 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5ac91-7ec2-4fb2-a087-b4b558f331e6 service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:21.828658 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:21.854297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51398e-8ea7-4277-95ad-fbcae5e07da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:21.855165 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51398e-8ea7-4277-95ad-fbcae5e07da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:21.855458 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51398e-8ea7-4277-95ad-fbcae5e07da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:21.855739 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51398e-8ea7-4277-95ad-fbcae5e07da8 admin admin] PATH_INFO: `/v3/projects/29e66bcfe54a47f0b5313fb0b2a95f0e` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:21.856943 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad51398e-8ea7-4277-95ad-fbcae5e07da8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29e66bcfe54a47f0b5313fb0b2a95f0e)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:21.859031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad51398e-8ea7-4277-95ad-fbcae5e07da8 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:21.993602 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ad51398e-8ea7-4277-95ad-fbcae5e07da8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29e66bcfe54a47f0b5313fb0b2a95f0e', 'request_id': 'req-ad51398e-8ea7-4277-95ad-fbcae5e07da8'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:22.013272 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711cb681-280a-4a91-a536-d5f381ac4345 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:22.014792 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-711cb681-280a-4a91-a536-d5f381ac4345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:22.029050 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711cb681-280a-4a91-a536-d5f381ac4345 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:22.089185 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd4baf-4d96-4069-baa0-0a03e41f045c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:22.090131 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd4baf-4d96-4069-baa0-0a03e41f045c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:22.090419 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd4baf-4d96-4069-baa0-0a03e41f045c admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:22.095590 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd4baf-4d96-4069-baa0-0a03e41f045c admin admin] PATH_INFO: `/v3/projects/b7be8323586540aba48a7ddf1f800aeb` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:22.095709 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ad51398e-8ea7-4277-95ad-fbcae5e07da8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29e66bcfe54a47f0b5313fb0b2a95f0e', 'request_id': 'req-ad51398e-8ea7-4277-95ad-fbcae5e07da8'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:22.095825 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd4baf-4d96-4069-baa0-0a03e41f045c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7be8323586540aba48a7ddf1f800aeb)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:22.095825 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd4baf-4d96-4069-baa0-0a03e41f045c admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:22.099126 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ad51398e-8ea7-4277-95ad-fbcae5e07da8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29e66bcfe54a47f0b5313fb0b2a95f0e', 'request_id': 'req-ad51398e-8ea7-4277-95ad-fbcae5e07da8'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:22.110562 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ad51398e-8ea7-4277-95ad-fbcae5e07da8 admin admin] The token cache is being invalidate because project 29e66bcfe54a47f0b5313fb0b2a95f0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:36:22.110857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ad51398e-8ea7-4277-95ad-fbcae5e07da8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:22.111690 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-ad51398e-8ea7-4277-95ad-fbcae5e07da8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:22.113289 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1389/2759] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:36:21 2022] DELETE /identity/v3/projects/29e66bcfe54a47f0b5313fb0b2a95f0e => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:36:22.118902 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fb374-3800-4a94-9169-436b46bea969 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:22.119074 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fb374-3800-4a94-9169-436b46bea969 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:22.119360 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fb374-3800-4a94-9169-436b46bea969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:22.138101 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-249fb374-3800-4a94-9169-436b46bea969 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:22.139330 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-249fb374-3800-4a94-9169-436b46bea969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:22.147438 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1390/2760] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:36:22.158994 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde2b76-c6ff-4950-a7c1-41d0593a8d10 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:22.158994 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde2b76-c6ff-4950-a7c1-41d0593a8d10 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:22.158994 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde2b76-c6ff-4950-a7c1-41d0593a8d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:22.173282 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-dbde2b76-c6ff-4950-a7c1-41d0593a8d10 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:22.174624 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-dbde2b76-c6ff-4950-a7c1-41d0593a8d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:22.183233 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1391/2761] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:36:22.187272 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde2b76-c6ff-4950-a7c1-41d0593a8d10 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:22.196842 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde2b76-c6ff-4950-a7c1-41d0593a8d10 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:22.201463 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f0c91-c7c4-4ea1-bdb2-acede1cae121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:22.202176 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f0c91-c7c4-4ea1-bdb2-acede1cae121 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:22.202518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f0c91-c7c4-4ea1-bdb2-acede1cae121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:22.202814 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f0c91-c7c4-4ea1-bdb2-acede1cae121 admin admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:22.203551 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f0c91-c7c4-4ea1-bdb2-acede1cae121 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:36:22.203862 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f0c91-c7c4-4ea1-bdb2-acede1cae121 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:22.205436 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f0c91-c7c4-4ea1-bdb2-acede1cae121 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:22.217865 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1392/2762] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:36:22.221878 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f0c91-c7c4-4ea1-bdb2-acede1cae121 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:22.230871 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-53cd4baf-4d96-4069-baa0-0a03e41f045c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7be8323586540aba48a7ddf1f800aeb', 'request_id': 'req-53cd4baf-4d96-4069-baa0-0a03e41f045c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:22.232282 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f0c91-c7c4-4ea1-bdb2-acede1cae121 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:22.236544 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-53cd4baf-4d96-4069-baa0-0a03e41f045c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7be8323586540aba48a7ddf1f800aeb', 'request_id': 'req-53cd4baf-4d96-4069-baa0-0a03e41f045c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:22.289378 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf9974-3414-4928-9bca-68e8c5d0453b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:22.290079 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf9974-3414-4928-9bca-68e8c5d0453b admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:22.290370 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf9974-3414-4928-9bca-68e8c5d0453b admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:22.290656 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf9974-3414-4928-9bca-68e8c5d0453b admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:22.291347 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf9974-3414-4928-9bca-68e8c5d0453b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:22.293243 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf9974-3414-4928-9bca-68e8c5d0453b admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:22.297100 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-53cd4baf-4d96-4069-baa0-0a03e41f045c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7be8323586540aba48a7ddf1f800aeb', 'request_id': 'req-53cd4baf-4d96-4069-baa0-0a03e41f045c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:22.306374 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:22.313615 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-53cd4baf-4d96-4069-baa0-0a03e41f045c admin admin] The token cache is being invalidate because project b7be8323586540aba48a7ddf1f800aeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:36:22.313615 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-53cd4baf-4d96-4069-baa0-0a03e41f045c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:22.313615 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-53cd4baf-4d96-4069-baa0-0a03e41f045c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:22.313615 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1371/2763] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:36:22 2022] DELETE /identity/v3/projects/b7be8323586540aba48a7ddf1f800aeb => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:36:22.316677 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd4baf-4d96-4069-baa0-0a03e41f045c admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:22.319453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-53cd4baf-4d96-4069-baa0-0a03e41f045c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:22.331778 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd4baf-4d96-4069-baa0-0a03e41f045c admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:22.337253 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d399fd-6b5b-4ef7-b08b-913d6467277c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:22.342336 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d399fd-6b5b-4ef7-b08b-913d6467277c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:22.342336 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d399fd-6b5b-4ef7-b08b-913d6467277c admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:22.342336 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d399fd-6b5b-4ef7-b08b-913d6467277c admin admin] PATH_INFO: `/v3/users/a34158937cac40f48b61f4adf7567c55` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:22.342336 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d399fd-6b5b-4ef7-b08b-913d6467277c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a34158937cac40f48b61f4adf7567c55)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:22.342336 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d399fd-6b5b-4ef7-b08b-913d6467277c admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:22.399531 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1393/2764] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:36:22 2022] POST /identity/v3/projects => generated 389 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:36:22.403732 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf9974-3414-4928-9bca-68e8c5d0453b admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:22.405442 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-81bf9974-3414-4928-9bca-68e8c5d0453b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:22.470254 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf9974-3414-4928-9bca-68e8c5d0453b admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:22.475949 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559637da-55c8-47e2-9c2d-9b9d0019910a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:22.476613 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559637da-55c8-47e2-9c2d-9b9d0019910a admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:22.476904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559637da-55c8-47e2-9c2d-9b9d0019910a admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:22.477188 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559637da-55c8-47e2-9c2d-9b9d0019910a admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:22.477921 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559637da-55c8-47e2-9c2d-9b9d0019910a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:22.479852 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559637da-55c8-47e2-9c2d-9b9d0019910a admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:22.529738 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c3d399fd-6b5b-4ef7-b08b-913d6467277c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a34158937cac40f48b61f4adf7567c55'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:22.530437 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c3d399fd-6b5b-4ef7-b08b-913d6467277c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a34158937cac40f48b61f4adf7567c55'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:22.538418 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c3d399fd-6b5b-4ef7-b08b-913d6467277c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a34158937cac40f48b61f4adf7567c55'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:22.539591 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:22.568073 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1394/2765] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:36:22 2022] POST /identity/v3/users => generated 295 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:36:22.569002 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559637da-55c8-47e2-9c2d-9b9d0019910a admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:22.570722 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-559637da-55c8-47e2-9c2d-9b9d0019910a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:22.618832 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c3d399fd-6b5b-4ef7-b08b-913d6467277c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a34158937cac40f48b61f4adf7567c55'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:22.628641 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559637da-55c8-47e2-9c2d-9b9d0019910a admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:22.632018 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c3d399fd-6b5b-4ef7-b08b-913d6467277c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a34158937cac40f48b61f4adf7567c55'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:22.632546 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8cfa8-2c88-4a6c-841e-8608428e563f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:22.633188 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8cfa8-2c88-4a6c-841e-8608428e563f service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:22.633471 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8cfa8-2c88-4a6c-841e-8608428e563f service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:22.633745 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8cfa8-2c88-4a6c-841e-8608428e563f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:22.635609 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-e8c8cfa8-2c88-4a6c-841e-8608428e563f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:22.638225 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1372/2766] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:36:22 2022] DELETE /identity/v3/users/a34158937cac40f48b61f4adf7567c55 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:36:22.639210 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d399fd-6b5b-4ef7-b08b-913d6467277c admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:22.640595 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c3d399fd-6b5b-4ef7-b08b-913d6467277c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:22.713028 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d399fd-6b5b-4ef7-b08b-913d6467277c admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:22.718479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8aeb5-73d4-4cf7-b08f-39fb1499c653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:22.718634 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8cfa8-2c88-4a6c-841e-8608428e563f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:22.719432 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8aeb5-73d4-4cf7-b08f-39fb1499c653 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:22.720020 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8aeb5-73d4-4cf7-b08f-39fb1499c653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:22.720252 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8aeb5-73d4-4cf7-b08f-39fb1499c653 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:22.720468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8cfa8-2c88-4a6c-841e-8608428e563f service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:22.721083 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8aeb5-73d4-4cf7-b08f-39fb1499c653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:22.722797 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8aeb5-73d4-4cf7-b08f-39fb1499c653 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:22.733670 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1395/2767] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:36:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:36:22.733944 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1373/2768] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:36:22.737885 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8cfa8-2c88-4a6c-841e-8608428e563f service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:22.749280 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8cfa8-2c88-4a6c-841e-8608428e563f service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:22.753937 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d8ab2-e94b-4e55-addc-4cbbdd8b9d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:22.755177 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d8ab2-e94b-4e55-addc-4cbbdd8b9d73 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:22.755573 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d8ab2-e94b-4e55-addc-4cbbdd8b9d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:22.756287 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d8ab2-e94b-4e55-addc-4cbbdd8b9d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:22.757138 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d8ab2-e94b-4e55-addc-4cbbdd8b9d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:22.763019 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d8ab2-e94b-4e55-addc-4cbbdd8b9d73 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:22.777996 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1396/2769] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:36:22.782248 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8aeb5-73d4-4cf7-b08f-39fb1499c653 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:22.794992 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8aeb5-73d4-4cf7-b08f-39fb1499c653 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:22.798796 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b600569-ba7c-4262-a022-204528eb24ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:22.799740 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b600569-ba7c-4262-a022-204528eb24ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:22.800026 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b600569-ba7c-4262-a022-204528eb24ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:22.800353 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b600569-ba7c-4262-a022-204528eb24ce admin admin] PATH_INFO: `/v3/projects/7f9d48e13dda45cca179ed69487e83a8/users/a63f43f9821540989d0ca06505f8deec/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:22.816534 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b600569-ba7c-4262-a022-204528eb24ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9d48e13dda45cca179ed69487e83a8, user_id=a63f43f9821540989d0ca06505f8deec, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:22.819742 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b600569-ba7c-4262-a022-204528eb24ce admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:22.901016 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1374/2770] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:36:22 2022] PUT /identity/v3/projects/7f9d48e13dda45cca179ed69487e83a8/users/a63f43f9821540989d0ca06505f8deec/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:36:22.912742 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de94e4-b929-4588-b894-fa238454d469 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:22.913024 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de94e4-b929-4588-b894-fa238454d469 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:22.913296 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de94e4-b929-4588-b894-fa238454d469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:22.941100 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-26de94e4-b929-4588-b894-fa238454d469 None None] MFA Rules not processed for user `a63f43f9821540989d0ca06505f8deec`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:22.942490 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-26de94e4-b929-4588-b894-fa238454d469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:22.986355 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:23.009842 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1397/2771] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:36:23.021168 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b600569-ba7c-4262-a022-204528eb24ce admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:23.022925 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-0b600569-ba7c-4262-a022-204528eb24ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:23.072439 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:23.083249 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b600569-ba7c-4262-a022-204528eb24ce admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:23.087416 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a7e61-9f25-4a8a-b067-892bca730766 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:23.088060 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a7e61-9f25-4a8a-b067-892bca730766 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:23.088344 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a7e61-9f25-4a8a-b067-892bca730766 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:23.088620 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a7e61-9f25-4a8a-b067-892bca730766 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:23.097025 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a7e61-9f25-4a8a-b067-892bca730766 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:23.099237 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a7e61-9f25-4a8a-b067-892bca730766 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:23.107792 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1375/2772] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:36:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:36:23.123719 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de94e4-b929-4588-b894-fa238454d469 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:23.125208 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-26de94e4-b929-4588-b894-fa238454d469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:23.197165 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de94e4-b929-4588-b894-fa238454d469 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:23.211402 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed1c447-a485-4263-970b-367a9906d584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:23.212680 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1c447-a485-4263-970b-367a9906d584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:23.213141 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1c447-a485-4263-970b-367a9906d584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:23.213579 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1c447-a485-4263-970b-367a9906d584 admin admin] PATH_INFO: `/v3/projects/2f14344553f24477b62a39d1a3b13f52` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:23.215034 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed1c447-a485-4263-970b-367a9906d584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f14344553f24477b62a39d1a3b13f52)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:23.218314 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed1c447-a485-4263-970b-367a9906d584 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:23.345460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-2ed1c447-a485-4263-970b-367a9906d584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f14344553f24477b62a39d1a3b13f52', 'request_id': 'req-2ed1c447-a485-4263-970b-367a9906d584'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:23.407937 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-2ed1c447-a485-4263-970b-367a9906d584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f14344553f24477b62a39d1a3b13f52', 'request_id': 'req-2ed1c447-a485-4263-970b-367a9906d584'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:23.416049 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-2ed1c447-a485-4263-970b-367a9906d584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f14344553f24477b62a39d1a3b13f52', 'request_id': 'req-2ed1c447-a485-4263-970b-367a9906d584'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:23.428160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-2ed1c447-a485-4263-970b-367a9906d584 admin admin] The token cache is being invalidate because project 2f14344553f24477b62a39d1a3b13f52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:36:23.428457 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-2ed1c447-a485-4263-970b-367a9906d584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:23.429167 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-2ed1c447-a485-4263-970b-367a9906d584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:23.430842 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1398/2773] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:36:23 2022] DELETE /identity/v3/projects/2f14344553f24477b62a39d1a3b13f52 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:36:23.436751 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15a51c-8421-4d09-b34b-3b25c3edcdd1 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:23.436994 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15a51c-8421-4d09-b34b-3b25c3edcdd1 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:23.437283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15a51c-8421-4d09-b34b-3b25c3edcdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:23.455421 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-0d15a51c-8421-4d09-b34b-3b25c3edcdd1 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:23.456670 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-0d15a51c-8421-4d09-b34b-3b25c3edcdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:23.523132 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1376/2774] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:36:23.589263 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4096540-98c9-4fd9-b52e-6f5ef0da27e5 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:23.589461 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4096540-98c9-4fd9-b52e-6f5ef0da27e5 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:23.589748 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4096540-98c9-4fd9-b52e-6f5ef0da27e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:23.609195 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-c4096540-98c9-4fd9-b52e-6f5ef0da27e5 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:23.610698 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-c4096540-98c9-4fd9-b52e-6f5ef0da27e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:23.621361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1399/2775] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:36:23.625852 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15a51c-8421-4d09-b34b-3b25c3edcdd1 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:23.639560 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15a51c-8421-4d09-b34b-3b25c3edcdd1 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:23.644364 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a004c-15d3-4a6c-83d0-06deaab110f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:23.650747 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a004c-15d3-4a6c-83d0-06deaab110f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:23.650747 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a004c-15d3-4a6c-83d0-06deaab110f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:23.650747 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a004c-15d3-4a6c-83d0-06deaab110f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:23.650747 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a004c-15d3-4a6c-83d0-06deaab110f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:36:23.650747 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a004c-15d3-4a6c-83d0-06deaab110f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:23.650747 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a004c-15d3-4a6c-83d0-06deaab110f7 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:23.663787 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1377/2776] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:36:23.668363 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4096540-98c9-4fd9-b52e-6f5ef0da27e5 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:23.679501 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4096540-98c9-4fd9-b52e-6f5ef0da27e5 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:23.684483 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00483bae-f7eb-4115-8500-9f893fb5a83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:23.685186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00483bae-f7eb-4115-8500-9f893fb5a83d admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:23.685474 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00483bae-f7eb-4115-8500-9f893fb5a83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:23.691049 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00483bae-f7eb-4115-8500-9f893fb5a83d admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:23.691049 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00483bae-f7eb-4115-8500-9f893fb5a83d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:23.691049 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00483bae-f7eb-4115-8500-9f893fb5a83d admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:23.777879 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1400/2777] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:36:23 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:36:23.782150 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a004c-15d3-4a6c-83d0-06deaab110f7 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:23.792192 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a004c-15d3-4a6c-83d0-06deaab110f7 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:23.849695 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58a2f9-0e0a-47ca-99a0-338db3e21a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:23.850432 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58a2f9-0e0a-47ca-99a0-338db3e21a3e admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:23.850747 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58a2f9-0e0a-47ca-99a0-338db3e21a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:23.854128 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58a2f9-0e0a-47ca-99a0-338db3e21a3e admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:23.854128 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58a2f9-0e0a-47ca-99a0-338db3e21a3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:23.854128 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58a2f9-0e0a-47ca-99a0-338db3e21a3e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:23.968887 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1378/2778] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:36:23 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:36:23.973796 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00483bae-f7eb-4115-8500-9f893fb5a83d admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:23.985137 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00483bae-f7eb-4115-8500-9f893fb5a83d admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:23.997576 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f61927-5a2a-4b5f-8f4b-fcf2c4c9188f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:23.998416 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f61927-5a2a-4b5f-8f4b-fcf2c4c9188f admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:23.998707 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f61927-5a2a-4b5f-8f4b-fcf2c4c9188f admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:23.998973 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f61927-5a2a-4b5f-8f4b-fcf2c4c9188f admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:23.999710 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f61927-5a2a-4b5f-8f4b-fcf2c4c9188f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:24.001315 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f61927-5a2a-4b5f-8f4b-fcf2c4c9188f admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:24.012723 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1401/2779] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:36:24.016933 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58a2f9-0e0a-47ca-99a0-338db3e21a3e admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:24.027831 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58a2f9-0e0a-47ca-99a0-338db3e21a3e admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:24.032775 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee44cba-9c78-4639-8508-1a4424a70bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:24.033446 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee44cba-9c78-4639-8508-1a4424a70bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:24.033733 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee44cba-9c78-4639-8508-1a4424a70bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:24.034052 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee44cba-9c78-4639-8508-1a4424a70bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:24.034789 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee44cba-9c78-4639-8508-1a4424a70bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:24.037119 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee44cba-9c78-4639-8508-1a4424a70bf1 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:24.047681 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1379/2780] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:36:24.052787 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f61927-5a2a-4b5f-8f4b-fcf2c4c9188f admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:24.064107 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f61927-5a2a-4b5f-8f4b-fcf2c4c9188f admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:24.069188 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff35175-0c95-459a-826e-5d5fba6c2c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:24.070111 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff35175-0c95-459a-826e-5d5fba6c2c64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:24.072642 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff35175-0c95-459a-826e-5d5fba6c2c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:24.072642 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff35175-0c95-459a-826e-5d5fba6c2c64 admin admin] PATH_INFO: `/v3/projects/f9741502a0934a1c803933ef5dfcdd92/users/c3b0fccc658d43ed8d906e1ba0f9dc95/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:24.086873 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff35175-0c95-459a-826e-5d5fba6c2c64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9741502a0934a1c803933ef5dfcdd92, user_id=c3b0fccc658d43ed8d906e1ba0f9dc95, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:24.089549 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff35175-0c95-459a-826e-5d5fba6c2c64 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:24.181298 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:24.187337 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1402/2781] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:36:24 2022] PUT /identity/v3/projects/f9741502a0934a1c803933ef5dfcdd92/users/c3b0fccc658d43ed8d906e1ba0f9dc95/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:36:24.198597 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2719b96-f415-4dea-8e7b-1d6fbd5071ff None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:24.203887 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2719b96-f415-4dea-8e7b-1d6fbd5071ff None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:24.203887 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2719b96-f415-4dea-8e7b-1d6fbd5071ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:24.239822 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-b2719b96-f415-4dea-8e7b-1d6fbd5071ff None None] MFA Rules not processed for user `c3b0fccc658d43ed8d906e1ba0f9dc95`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:24.241714 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b2719b96-f415-4dea-8e7b-1d6fbd5071ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:24.298642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:24.324793 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1380/2782] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:36:24.329291 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff35175-0c95-459a-826e-5d5fba6c2c64 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:24.418543 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff35175-0c95-459a-826e-5d5fba6c2c64 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:24.423441 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d6c31-d63a-48f8-a0ba-43c9fca34a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:24.424110 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d6c31-d63a-48f8-a0ba-43c9fca34a60 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:24.424449 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d6c31-d63a-48f8-a0ba-43c9fca34a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:24.425298 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d6c31-d63a-48f8-a0ba-43c9fca34a60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:24.425549 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d6c31-d63a-48f8-a0ba-43c9fca34a60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:24.428648 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d6c31-d63a-48f8-a0ba-43c9fca34a60 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:24.542751 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1403/2783] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:36:24 2022] POST /identity/v3/projects => generated 387 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:36:24.543884 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2719b96-f415-4dea-8e7b-1d6fbd5071ff None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:24.555376 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2719b96-f415-4dea-8e7b-1d6fbd5071ff None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:24.620108 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2545ca7-9b07-435d-bf20-5a4e7eab1682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:24.620795 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2545ca7-9b07-435d-bf20-5a4e7eab1682 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:24.621085 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2545ca7-9b07-435d-bf20-5a4e7eab1682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:24.621366 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2545ca7-9b07-435d-bf20-5a4e7eab1682 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:24.622114 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2545ca7-9b07-435d-bf20-5a4e7eab1682 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:24.624045 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2545ca7-9b07-435d-bf20-5a4e7eab1682 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:24.709556 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1381/2784] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:36:24 2022] POST /identity/v3/users => generated 300 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:36:24.710897 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d6c31-d63a-48f8-a0ba-43c9fca34a60 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:24.721484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d6c31-d63a-48f8-a0ba-43c9fca34a60 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:24.727591 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b17a0-ed63-4e52-8d92-0689f0d3688c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:24.728405 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b17a0-ed63-4e52-8d92-0689f0d3688c admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:24.728869 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b17a0-ed63-4e52-8d92-0689f0d3688c admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:24.729152 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b17a0-ed63-4e52-8d92-0689f0d3688c admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:24.730051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b17a0-ed63-4e52-8d92-0689f0d3688c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:24.731742 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b17a0-ed63-4e52-8d92-0689f0d3688c admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:24.745510 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1404/2785] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:36:24.756521 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2545ca7-9b07-435d-bf20-5a4e7eab1682 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:24.770300 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2545ca7-9b07-435d-bf20-5a4e7eab1682 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:24.777069 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777645c2-4010-4e78-8045-e3ff7dd08647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:24.777234 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777645c2-4010-4e78-8045-e3ff7dd08647 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:24.777441 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777645c2-4010-4e78-8045-e3ff7dd08647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:24.777712 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777645c2-4010-4e78-8045-e3ff7dd08647 admin admin] PATH_INFO: `/v3/projects/f2918e1d86804533bfeb5332fad5181f/users/6c6e7d82643949588ca750f24fec9a10/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:24.800410 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777645c2-4010-4e78-8045-e3ff7dd08647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2918e1d86804533bfeb5332fad5181f, user_id=6c6e7d82643949588ca750f24fec9a10, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:24.804065 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777645c2-4010-4e78-8045-e3ff7dd08647 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:24.911646 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1382/2786] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:36:24 2022] PUT /identity/v3/projects/f2918e1d86804533bfeb5332fad5181f/users/6c6e7d82643949588ca750f24fec9a10/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:36:24.915671 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b17a0-ed63-4e52-8d92-0689f0d3688c admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:24.927435 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b17a0-ed63-4e52-8d92-0689f0d3688c admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:24.989360 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0a94e-c3f9-46ae-a764-ec507709bad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:24.990609 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0a94e-c3f9-46ae-a764-ec507709bad5 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:24.990896 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0a94e-c3f9-46ae-a764-ec507709bad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:24.991173 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0a94e-c3f9-46ae-a764-ec507709bad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:24.991909 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0a94e-c3f9-46ae-a764-ec507709bad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:24.993637 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0a94e-c3f9-46ae-a764-ec507709bad5 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:25.006124 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1405/2787] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:36:25.012668 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777645c2-4010-4e78-8045-e3ff7dd08647 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:25.025371 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777645c2-4010-4e78-8045-e3ff7dd08647 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:25.033852 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625989f-5e46-47e0-a60b-9fa65e62b9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:25.034879 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625989f-5e46-47e0-a60b-9fa65e62b9cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:25.035448 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625989f-5e46-47e0-a60b-9fa65e62b9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:25.036591 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625989f-5e46-47e0-a60b-9fa65e62b9cf admin admin] PATH_INFO: `/v3/projects/f2918e1d86804533bfeb5332fad5181f/users/6c6e7d82643949588ca750f24fec9a10/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:25.038983 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625989f-5e46-47e0-a60b-9fa65e62b9cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2918e1d86804533bfeb5332fad5181f, user_id=6c6e7d82643949588ca750f24fec9a10, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:25.041711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625989f-5e46-47e0-a60b-9fa65e62b9cf admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:25.054412 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1383/2788] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:36:25 2022] PUT /identity/v3/projects/f2918e1d86804533bfeb5332fad5181f/users/6c6e7d82643949588ca750f24fec9a10/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:36:25.065654 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d0bd9-54e6-489c-af36-c1d3b56e2c8e None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:25.066074 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d0bd9-54e6-489c-af36-c1d3b56e2c8e None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:25.066478 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d0bd9-54e6-489c-af36-c1d3b56e2c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:25.100598 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-439d0bd9-54e6-489c-af36-c1d3b56e2c8e None None] MFA Rules not processed for user `6c6e7d82643949588ca750f24fec9a10`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:25.101978 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-439d0bd9-54e6-489c-af36-c1d3b56e2c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:25.170466 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:25.179841 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1406/2789] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:36:25.190689 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625989f-5e46-47e0-a60b-9fa65e62b9cf admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:25.192751 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3625989f-5e46-47e0-a60b-9fa65e62b9cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:25.255591 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625989f-5e46-47e0-a60b-9fa65e62b9cf admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:25.260322 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f35ac-917f-44db-83f8-24686c590c5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:25.261119 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f35ac-917f-44db-83f8-24686c590c5f service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:25.261473 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f35ac-917f-44db-83f8-24686c590c5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:25.261858 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f35ac-917f-44db-83f8-24686c590c5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:25.273683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f35ac-917f-44db-83f8-24686c590c5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:25.275284 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f35ac-917f-44db-83f8-24686c590c5f service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:25.287319 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1384/2790] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:36:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:36:26.603841 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d0bd9-54e6-489c-af36-c1d3b56e2c8e None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:26.673999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d0bd9-54e6-489c-af36-c1d3b56e2c8e None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:26.679216 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdae92-5bfe-4c09-b131-6a85030c7308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:26.680099 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdae92-5bfe-4c09-b131-6a85030c7308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:26.680387 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdae92-5bfe-4c09-b131-6a85030c7308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:26.680675 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdae92-5bfe-4c09-b131-6a85030c7308 admin admin] PATH_INFO: `/v3/users/c3b0fccc658d43ed8d906e1ba0f9dc95` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:26.681895 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdae92-5bfe-4c09-b131-6a85030c7308 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3b0fccc658d43ed8d906e1ba0f9dc95)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:26.683825 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdae92-5bfe-4c09-b131-6a85030c7308 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:26.924083 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-61fdae92-5bfe-4c09-b131-6a85030c7308 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3b0fccc658d43ed8d906e1ba0f9dc95'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:26.994137 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-61fdae92-5bfe-4c09-b131-6a85030c7308 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3b0fccc658d43ed8d906e1ba0f9dc95'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:27.001756 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-61fdae92-5bfe-4c09-b131-6a85030c7308 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3b0fccc658d43ed8d906e1ba0f9dc95'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:27.002511 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-61fdae92-5bfe-4c09-b131-6a85030c7308 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3b0fccc658d43ed8d906e1ba0f9dc95'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:27.003122 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-61fdae92-5bfe-4c09-b131-6a85030c7308 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3b0fccc658d43ed8d906e1ba0f9dc95'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:27.020943 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1407/2791] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:36:26 2022] DELETE /identity/v3/users/c3b0fccc658d43ed8d906e1ba0f9dc95 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:36:27.025457 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecea13-fbc7-440f-b1dd-f8abbddac741 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:27.025984 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecea13-fbc7-440f-b1dd-f8abbddac741 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:27.026087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecea13-fbc7-440f-b1dd-f8abbddac741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:27.044584 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-91ecea13-fbc7-440f-b1dd-f8abbddac741 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:27.045939 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-91ecea13-fbc7-440f-b1dd-f8abbddac741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:27.080613 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:27.108202 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1385/2792] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:36:27.119185 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdae92-5bfe-4c09-b131-6a85030c7308 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:27.120684 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-61fdae92-5bfe-4c09-b131-6a85030c7308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:27.179943 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdae92-5bfe-4c09-b131-6a85030c7308 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:27.183634 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e5a0b-9df6-40f1-9e97-17b8e28b477e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:27.184277 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e5a0b-9df6-40f1-9e97-17b8e28b477e service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:27.184565 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e5a0b-9df6-40f1-9e97-17b8e28b477e service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:27.184846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e5a0b-9df6-40f1-9e97-17b8e28b477e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:27.194193 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e5a0b-9df6-40f1-9e97-17b8e28b477e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:27.195617 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e5a0b-9df6-40f1-9e97-17b8e28b477e service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:27.205135 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1408/2793] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:36:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:36:27.665332 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ecea13-fbc7-440f-b1dd-f8abbddac741 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:27.666856 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-91ecea13-fbc7-440f-b1dd-f8abbddac741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:27.680407 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ecea13-fbc7-440f-b1dd-f8abbddac741 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:27.685686 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f96bb-fb9f-4754-86a5-6f61bef2f350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:27.686778 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f96bb-fb9f-4754-86a5-6f61bef2f350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:27.689271 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f96bb-fb9f-4754-86a5-6f61bef2f350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:27.689271 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f96bb-fb9f-4754-86a5-6f61bef2f350 admin admin] PATH_INFO: `/v3/projects/f9741502a0934a1c803933ef5dfcdd92` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:27.689271 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f96bb-fb9f-4754-86a5-6f61bef2f350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9741502a0934a1c803933ef5dfcdd92)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:27.690761 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f96bb-fb9f-4754-86a5-6f61bef2f350 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:27.872143 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-db4f96bb-fb9f-4754-86a5-6f61bef2f350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9741502a0934a1c803933ef5dfcdd92', 'request_id': 'req-db4f96bb-fb9f-4754-86a5-6f61bef2f350'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:27.878163 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-db4f96bb-fb9f-4754-86a5-6f61bef2f350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9741502a0934a1c803933ef5dfcdd92', 'request_id': 'req-db4f96bb-fb9f-4754-86a5-6f61bef2f350'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:28.024664 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-db4f96bb-fb9f-4754-86a5-6f61bef2f350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9741502a0934a1c803933ef5dfcdd92', 'request_id': 'req-db4f96bb-fb9f-4754-86a5-6f61bef2f350'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:28.037035 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-db4f96bb-fb9f-4754-86a5-6f61bef2f350 admin admin] The token cache is being invalidate because project f9741502a0934a1c803933ef5dfcdd92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:36:28.037609 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-db4f96bb-fb9f-4754-86a5-6f61bef2f350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:28.038010 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-db4f96bb-fb9f-4754-86a5-6f61bef2f350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:28.039567 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1386/2794] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:36:27 2022] DELETE /identity/v3/projects/f9741502a0934a1c803933ef5dfcdd92 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:36:28.043626 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e5a0b-9df6-40f1-9e97-17b8e28b477e service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:28.053711 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e5a0b-9df6-40f1-9e97-17b8e28b477e service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:28.066001 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:28.110790 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e43b8-5aa4-4145-96ba-432bc3fde354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:28.111697 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e43b8-5aa4-4145-96ba-432bc3fde354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:28.111985 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e43b8-5aa4-4145-96ba-432bc3fde354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:28.112268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e43b8-5aa4-4145-96ba-432bc3fde354 admin admin] PATH_INFO: `/v3/users/6c6e7d82643949588ca750f24fec9a10` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:28.113461 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e43b8-5aa4-4145-96ba-432bc3fde354 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c6e7d82643949588ca750f24fec9a10)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:28.115854 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e43b8-5aa4-4145-96ba-432bc3fde354 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:28.350895 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-cc7e43b8-5aa4-4145-96ba-432bc3fde354 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c6e7d82643949588ca750f24fec9a10'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:28.422704 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-cc7e43b8-5aa4-4145-96ba-432bc3fde354 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c6e7d82643949588ca750f24fec9a10'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:28.430548 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-cc7e43b8-5aa4-4145-96ba-432bc3fde354 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c6e7d82643949588ca750f24fec9a10'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:28.433025 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-cc7e43b8-5aa4-4145-96ba-432bc3fde354 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c6e7d82643949588ca750f24fec9a10'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:28.433025 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-cc7e43b8-5aa4-4145-96ba-432bc3fde354 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c6e7d82643949588ca750f24fec9a10'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:28.453719 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1409/2795] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:36:28 2022] DELETE /identity/v3/users/6c6e7d82643949588ca750f24fec9a10 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:36:28.909951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f96bb-fb9f-4754-86a5-6f61bef2f350 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:28.911538 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-db4f96bb-fb9f-4754-86a5-6f61bef2f350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:28.942494 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f96bb-fb9f-4754-86a5-6f61bef2f350 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:29.002143 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46a865-159a-48f9-8a5f-1337208db671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:29.003024 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46a865-159a-48f9-8a5f-1337208db671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:29.003306 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46a865-159a-48f9-8a5f-1337208db671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:29.003578 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46a865-159a-48f9-8a5f-1337208db671 admin admin] PATH_INFO: `/v3/projects/f2918e1d86804533bfeb5332fad5181f` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:29.005601 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46a865-159a-48f9-8a5f-1337208db671 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2918e1d86804533bfeb5332fad5181f)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:29.007424 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46a865-159a-48f9-8a5f-1337208db671 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:29.182161 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-fe46a865-159a-48f9-8a5f-1337208db671 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2918e1d86804533bfeb5332fad5181f', 'request_id': 'req-fe46a865-159a-48f9-8a5f-1337208db671'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:29.188320 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-fe46a865-159a-48f9-8a5f-1337208db671 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2918e1d86804533bfeb5332fad5181f', 'request_id': 'req-fe46a865-159a-48f9-8a5f-1337208db671'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:29.192765 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:29.247579 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-fe46a865-159a-48f9-8a5f-1337208db671 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2918e1d86804533bfeb5332fad5181f', 'request_id': 'req-fe46a865-159a-48f9-8a5f-1337208db671'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:29.259812 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-fe46a865-159a-48f9-8a5f-1337208db671 admin admin] The token cache is being invalidate because project f2918e1d86804533bfeb5332fad5181f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:36:29.260132 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-fe46a865-159a-48f9-8a5f-1337208db671 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:29.260771 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-fe46a865-159a-48f9-8a5f-1337208db671 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:29.262349 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1387/2796] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:36:28 2022] DELETE /identity/v3/projects/f2918e1d86804533bfeb5332fad5181f => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:36:29.267140 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44c839-0201-4fa2-80d6-1db4062471b6 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:29.267571 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44c839-0201-4fa2-80d6-1db4062471b6 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:29.267684 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44c839-0201-4fa2-80d6-1db4062471b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:29.286865 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-6a44c839-0201-4fa2-80d6-1db4062471b6 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:29.288068 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-6a44c839-0201-4fa2-80d6-1db4062471b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:29.349867 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1410/2797] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:36:29.357484 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6a8b2-1cef-47a6-9dd3-395e3b05d3bf None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:29.357789 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6a8b2-1cef-47a6-9dd3-395e3b05d3bf None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:29.358075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6a8b2-1cef-47a6-9dd3-395e3b05d3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:29.377730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-a4b6a8b2-1cef-47a6-9dd3-395e3b05d3bf None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:29.379516 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a4b6a8b2-1cef-47a6-9dd3-395e3b05d3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:29.391560 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1388/2798] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:36:29.392490 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44c839-0201-4fa2-80d6-1db4062471b6 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:29.404951 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44c839-0201-4fa2-80d6-1db4062471b6 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:29.410216 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e5d18-991a-4aa7-b5ee-b3f64d368b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:29.411644 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e5d18-991a-4aa7-b5ee-b3f64d368b80 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:29.417387 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e5d18-991a-4aa7-b5ee-b3f64d368b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:29.417387 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e5d18-991a-4aa7-b5ee-b3f64d368b80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:29.417387 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e5d18-991a-4aa7-b5ee-b3f64d368b80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:36:29.417387 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e5d18-991a-4aa7-b5ee-b3f64d368b80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:29.417387 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e5d18-991a-4aa7-b5ee-b3f64d368b80 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:29.436064 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1411/2799] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:36:29.436193 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6a8b2-1cef-47a6-9dd3-395e3b05d3bf None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:29.443694 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6a8b2-1cef-47a6-9dd3-395e3b05d3bf None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:29.451466 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb63c65-57a0-415b-be33-e8872605b25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:29.451466 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb63c65-57a0-415b-be33-e8872605b25e admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:29.451466 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb63c65-57a0-415b-be33-e8872605b25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:29.451466 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb63c65-57a0-415b-be33-e8872605b25e admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:29.451867 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb63c65-57a0-415b-be33-e8872605b25e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:29.453299 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb63c65-57a0-415b-be33-e8872605b25e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:29.552910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1389/2800] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:36:29 2022] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:36:29.556783 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e5d18-991a-4aa7-b5ee-b3f64d368b80 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:29.568325 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e5d18-991a-4aa7-b5ee-b3f64d368b80 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:29.591455 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:29.639603 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04910a4-cbb0-49fc-9b41-00ba3d205b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:29.640306 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04910a4-cbb0-49fc-9b41-00ba3d205b87 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:29.640577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04910a4-cbb0-49fc-9b41-00ba3d205b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:29.640857 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04910a4-cbb0-49fc-9b41-00ba3d205b87 admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:29.641566 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04910a4-cbb0-49fc-9b41-00ba3d205b87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:29.643512 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04910a4-cbb0-49fc-9b41-00ba3d205b87 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:29.749280 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1412/2801] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:36:29 2022] POST /identity/v3/users => generated 286 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:36:29.753097 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb63c65-57a0-415b-be33-e8872605b25e admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:29.764142 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb63c65-57a0-415b-be33-e8872605b25e admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:29.769713 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37b509-ee11-4e07-9352-1c8d35cdcf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:29.771200 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37b509-ee11-4e07-9352-1c8d35cdcf12 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:29.771780 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37b509-ee11-4e07-9352-1c8d35cdcf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:29.772230 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37b509-ee11-4e07-9352-1c8d35cdcf12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:29.773143 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37b509-ee11-4e07-9352-1c8d35cdcf12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:29.774785 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37b509-ee11-4e07-9352-1c8d35cdcf12 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:29.789810 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1390/2802] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:36:29.791458 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04910a4-cbb0-49fc-9b41-00ba3d205b87 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:29.809414 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04910a4-cbb0-49fc-9b41-00ba3d205b87 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:29.809414 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768c0b8-ee66-426b-851f-20bdb850e5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:29.809414 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768c0b8-ee66-426b-851f-20bdb850e5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:29.809414 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768c0b8-ee66-426b-851f-20bdb850e5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:29.809818 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768c0b8-ee66-426b-851f-20bdb850e5b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:29.809818 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768c0b8-ee66-426b-851f-20bdb850e5b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:29.810395 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768c0b8-ee66-426b-851f-20bdb850e5b1 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:29.820781 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1413/2803] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:36:29.825183 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37b509-ee11-4e07-9352-1c8d35cdcf12 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:29.840002 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37b509-ee11-4e07-9352-1c8d35cdcf12 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:29.845514 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cead8e-b891-4e3a-869c-228d25d4f64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:29.846600 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cead8e-b891-4e3a-869c-228d25d4f64c admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:29.846955 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cead8e-b891-4e3a-869c-228d25d4f64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:29.847307 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cead8e-b891-4e3a-869c-228d25d4f64c admin admin] PATH_INFO: `/v3/projects/c8d69b17697442af8aaccb9ad77bbdcf/users/121cce017bc8453e9fa17d22dacfe21d/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:29.865945 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cead8e-b891-4e3a-869c-228d25d4f64c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d69b17697442af8aaccb9ad77bbdcf, user_id=121cce017bc8453e9fa17d22dacfe21d, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:29.868993 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cead8e-b891-4e3a-869c-228d25d4f64c admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:29.985745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1391/2804] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:36:29 2022] PUT /identity/v3/projects/c8d69b17697442af8aaccb9ad77bbdcf/users/121cce017bc8453e9fa17d22dacfe21d/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:36:29.998180 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949a3eb-f362-4f51-86f9-bb21bc2dda42 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:29.998484 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949a3eb-f362-4f51-86f9-bb21bc2dda42 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:29.998773 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949a3eb-f362-4f51-86f9-bb21bc2dda42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:30.025396 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55d3e1-34bc-43de-ab13-48b3fff4f8d6 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:30.025690 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55d3e1-34bc-43de-ab13-48b3fff4f8d6 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:30.026006 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55d3e1-34bc-43de-ab13-48b3fff4f8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:30.028243 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-d949a3eb-f362-4f51-86f9-bb21bc2dda42 None None] MFA Rules not processed for user `121cce017bc8453e9fa17d22dacfe21d`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:30.033939 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-d949a3eb-f362-4f51-86f9-bb21bc2dda42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:30.048990 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-ad55d3e1-34bc-43de-ab13-48b3fff4f8d6 None None] MFA Rules not processed for user `b25d1df6e9a643ad8482e3632a99917e`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:30.050318 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ad55d3e1-34bc-43de-ab13-48b3fff4f8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:30.107606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1414/2805] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:36:30.119567 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1392/2806] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:36:30.131650 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949a3eb-f362-4f51-86f9-bb21bc2dda42 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:30.135866 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-d949a3eb-f362-4f51-86f9-bb21bc2dda42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:30.198366 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949a3eb-f362-4f51-86f9-bb21bc2dda42 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:30.202081 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28667ec-42cb-4865-a35c-c1855ea1ffba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:30.202795 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28667ec-42cb-4865-a35c-c1855ea1ffba service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:30.203168 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28667ec-42cb-4865-a35c-c1855ea1ffba service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:30.203509 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28667ec-42cb-4865-a35c-c1855ea1ffba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:30.213247 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28667ec-42cb-4865-a35c-c1855ea1ffba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:30.214824 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28667ec-42cb-4865-a35c-c1855ea1ffba service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:30.223961 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1415/2807] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:36:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:36:30.880202 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55d3e1-34bc-43de-ab13-48b3fff4f8d6 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:30.881711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ad55d3e1-34bc-43de-ab13-48b3fff4f8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:30.951914 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55d3e1-34bc-43de-ab13-48b3fff4f8d6 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:30.957076 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee9984-06e0-4a2c-8429-438e61c8daf5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b7c9264495433985185332778dbc8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:30.958034 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee9984-06e0-4a2c-8429-438e61c8daf5 service placement] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:30.958297 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee9984-06e0-4a2c-8429-438e61c8daf5 service placement] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:30.958833 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee9984-06e0-4a2c-8429-438e61c8daf5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:30.960676 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-55ee9984-06e0-4a2c-8429-438e61c8daf5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:30.972028 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee9984-06e0-4a2c-8429-438e61c8daf5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:30.974215 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee9984-06e0-4a2c-8429-438e61c8daf5 service placement] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:30.984291 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1393/2808] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:36:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:36:33.935557 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28667ec-42cb-4865-a35c-c1855ea1ffba service cinder] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:33.937138 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-d28667ec-42cb-4865-a35c-c1855ea1ffba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:33.981824 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:34.000795 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28667ec-42cb-4865-a35c-c1855ea1ffba service cinder] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:34.005460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15114e3-5d78-4980-bae7-7aa26810ff1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:34.006186 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15114e3-5d78-4980-bae7-7aa26810ff1d service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:34.006477 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15114e3-5d78-4980-bae7-7aa26810ff1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:34.006759 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15114e3-5d78-4980-bae7-7aa26810ff1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:34.008608 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-b15114e3-5d78-4980-bae7-7aa26810ff1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:34.018700 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15114e3-5d78-4980-bae7-7aa26810ff1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:34.020219 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15114e3-5d78-4980-bae7-7aa26810ff1d service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:34.028820 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1416/2809] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:36:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:36:34.922353 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee9984-06e0-4a2c-8429-438e61c8daf5 service placement] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:34.923856 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-55ee9984-06e0-4a2c-8429-438e61c8daf5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:34.951514 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:35.002058 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee9984-06e0-4a2c-8429-438e61c8daf5 service placement] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:35.008280 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40714c0-b44b-4bef-a109-c7576329a41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:35.009190 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40714c0-b44b-4bef-a109-c7576329a41a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:35.009747 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40714c0-b44b-4bef-a109-c7576329a41a admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:35.010225 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40714c0-b44b-4bef-a109-c7576329a41a admin admin] PATH_INFO: `/v3/users/a63f43f9821540989d0ca06505f8deec` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:35.014810 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40714c0-b44b-4bef-a109-c7576329a41a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a63f43f9821540989d0ca06505f8deec)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:35.015634 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40714c0-b44b-4bef-a109-c7576329a41a admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:35.224210 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f40714c0-b44b-4bef-a109-c7576329a41a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a63f43f9821540989d0ca06505f8deec'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:35.224947 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f40714c0-b44b-4bef-a109-c7576329a41a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a63f43f9821540989d0ca06505f8deec'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:35.232590 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f40714c0-b44b-4bef-a109-c7576329a41a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a63f43f9821540989d0ca06505f8deec'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:35.299459 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f40714c0-b44b-4bef-a109-c7576329a41a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a63f43f9821540989d0ca06505f8deec'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:35.313478 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f40714c0-b44b-4bef-a109-c7576329a41a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a63f43f9821540989d0ca06505f8deec'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:35.320079 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1394/2810] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:36:34 2022] DELETE /identity/v3/users/a63f43f9821540989d0ca06505f8deec => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:36:35.324547 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4294137-5f95-41b9-bd60-5e6c6b7d8358 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:35.325109 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4294137-5f95-41b9-bd60-5e6c6b7d8358 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:35.325448 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4294137-5f95-41b9-bd60-5e6c6b7d8358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:35.344139 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-e4294137-5f95-41b9-bd60-5e6c6b7d8358 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:35.345565 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-e4294137-5f95-41b9-bd60-5e6c6b7d8358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:35.411465 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1417/2811] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:36:35.433135 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40714c0-b44b-4bef-a109-c7576329a41a admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:35.434706 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f40714c0-b44b-4bef-a109-c7576329a41a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:35.506951 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40714c0-b44b-4bef-a109-c7576329a41a admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:35.510736 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8983570-7e9a-41ea-9725-963804a650ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:35.511393 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8983570-7e9a-41ea-9725-963804a650ab service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:35.511682 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8983570-7e9a-41ea-9725-963804a650ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:35.511962 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8983570-7e9a-41ea-9725-963804a650ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:35.524178 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8983570-7e9a-41ea-9725-963804a650ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:35.525820 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8983570-7e9a-41ea-9725-963804a650ab service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:35.537732 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1395/2812] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:36:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:36:36.066138 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4294137-5f95-41b9-bd60-5e6c6b7d8358 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:36.068131 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-e4294137-5f95-41b9-bd60-5e6c6b7d8358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:36.087268 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4294137-5f95-41b9-bd60-5e6c6b7d8358 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:36.092047 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e75eff-e549-4288-a92a-76de83f63a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:36.096035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e75eff-e549-4288-a92a-76de83f63a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:36.096035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e75eff-e549-4288-a92a-76de83f63a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:36.096035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e75eff-e549-4288-a92a-76de83f63a9f admin admin] PATH_INFO: `/v3/projects/7f9d48e13dda45cca179ed69487e83a8` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:36.096035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e75eff-e549-4288-a92a-76de83f63a9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f9d48e13dda45cca179ed69487e83a8)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:36.096928 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e75eff-e549-4288-a92a-76de83f63a9f admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:36.219104 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-73e75eff-e549-4288-a92a-76de83f63a9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f9d48e13dda45cca179ed69487e83a8', 'request_id': 'req-73e75eff-e549-4288-a92a-76de83f63a9f'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:36.281642 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-73e75eff-e549-4288-a92a-76de83f63a9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f9d48e13dda45cca179ed69487e83a8', 'request_id': 'req-73e75eff-e549-4288-a92a-76de83f63a9f'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:36.289420 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-73e75eff-e549-4288-a92a-76de83f63a9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f9d48e13dda45cca179ed69487e83a8', 'request_id': 'req-73e75eff-e549-4288-a92a-76de83f63a9f'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:36.300288 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-73e75eff-e549-4288-a92a-76de83f63a9f admin admin] The token cache is being invalidate because project 7f9d48e13dda45cca179ed69487e83a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:36:36.300586 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-73e75eff-e549-4288-a92a-76de83f63a9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:36.301374 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-73e75eff-e549-4288-a92a-76de83f63a9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:36.302979 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1418/2813] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:36:36 2022] DELETE /identity/v3/projects/7f9d48e13dda45cca179ed69487e83a8 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:36:41.588548 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8983570-7e9a-41ea-9725-963804a650ab service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:41.590027 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f8983570-7e9a-41ea-9725-963804a650ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:41.603342 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8983570-7e9a-41ea-9725-963804a650ab service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:41.646714 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:41.664376 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b18a3-9220-43fc-ae69-f52668766fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:41.665310 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b18a3-9220-43fc-ae69-f52668766fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:41.665601 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b18a3-9220-43fc-ae69-f52668766fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:41.665924 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b18a3-9220-43fc-ae69-f52668766fb7 admin admin] PATH_INFO: `/v3/users/121cce017bc8453e9fa17d22dacfe21d` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:41.667190 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b18a3-9220-43fc-ae69-f52668766fb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=121cce017bc8453e9fa17d22dacfe21d)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:41.669151 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b18a3-9220-43fc-ae69-f52668766fb7 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:41.852829 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-522b18a3-9220-43fc-ae69-f52668766fb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '121cce017bc8453e9fa17d22dacfe21d'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:41.853488 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-522b18a3-9220-43fc-ae69-f52668766fb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '121cce017bc8453e9fa17d22dacfe21d'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:41.860065 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-522b18a3-9220-43fc-ae69-f52668766fb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '121cce017bc8453e9fa17d22dacfe21d'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:41.953707 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-522b18a3-9220-43fc-ae69-f52668766fb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '121cce017bc8453e9fa17d22dacfe21d'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:41.967075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-522b18a3-9220-43fc-ae69-f52668766fb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '121cce017bc8453e9fa17d22dacfe21d'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:41.973087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1396/2814] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:36:41 2022] DELETE /identity/v3/users/121cce017bc8453e9fa17d22dacfe21d => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:36:41.978063 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b88eb2-81c8-43ef-867b-2adeeb4916c1 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:41.978544 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b88eb2-81c8-43ef-867b-2adeeb4916c1 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:41.978652 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b88eb2-81c8-43ef-867b-2adeeb4916c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:41.996343 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-11b88eb2-81c8-43ef-867b-2adeeb4916c1 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:36:41.997528 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-11b88eb2-81c8-43ef-867b-2adeeb4916c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:42.055214 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1419/2815] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:36:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:36:42.064957 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b18a3-9220-43fc-ae69-f52668766fb7 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:42.066471 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-522b18a3-9220-43fc-ae69-f52668766fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:42.123518 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b18a3-9220-43fc-ae69-f52668766fb7 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:42.127098 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a85e5-8660-45ec-9e93-a07cdb8286e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:42.127813 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a85e5-8660-45ec-9e93-a07cdb8286e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:42.128129 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a85e5-8660-45ec-9e93-a07cdb8286e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:42.128435 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a85e5-8660-45ec-9e93-a07cdb8286e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:42.139007 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a85e5-8660-45ec-9e93-a07cdb8286e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:42.141422 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a85e5-8660-45ec-9e93-a07cdb8286e0 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:42.150485 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1397/2816] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:36:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:36:42.654520 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b88eb2-81c8-43ef-867b-2adeeb4916c1 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:36:42.659760 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-11b88eb2-81c8-43ef-867b-2adeeb4916c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:36:42.664769 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:42.670119 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b88eb2-81c8-43ef-867b-2adeeb4916c1 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:36:42.675600 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c515395-7e4f-4eb9-b581-97064a11b9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:36:42.676953 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c515395-7e4f-4eb9-b581-97064a11b9d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:36:42.678216 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c515395-7e4f-4eb9-b581-97064a11b9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:36:42.678445 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c515395-7e4f-4eb9-b581-97064a11b9d8 admin admin] PATH_INFO: `/v3/projects/c8d69b17697442af8aaccb9ad77bbdcf` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:36:42.679695 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c515395-7e4f-4eb9-b581-97064a11b9d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8d69b17697442af8aaccb9ad77bbdcf)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:36:42.681632 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c515395-7e4f-4eb9-b581-97064a11b9d8 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:36:42.782934 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6c515395-7e4f-4eb9-b581-97064a11b9d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8d69b17697442af8aaccb9ad77bbdcf', 'request_id': 'req-6c515395-7e4f-4eb9-b581-97064a11b9d8'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:42.874002 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6c515395-7e4f-4eb9-b581-97064a11b9d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8d69b17697442af8aaccb9ad77bbdcf', 'request_id': 'req-6c515395-7e4f-4eb9-b581-97064a11b9d8'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:42.881489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6c515395-7e4f-4eb9-b581-97064a11b9d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8d69b17697442af8aaccb9ad77bbdcf', 'request_id': 'req-6c515395-7e4f-4eb9-b581-97064a11b9d8'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:42.891781 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6c515395-7e4f-4eb9-b581-97064a11b9d8 admin admin] The token cache is being invalidate because project c8d69b17697442af8aaccb9ad77bbdcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:36:42.892069 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6c515395-7e4f-4eb9-b581-97064a11b9d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:42.892719 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6c515395-7e4f-4eb9-b581-97064a11b9d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:36:42.894304 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1420/2817] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:36:42 2022] DELETE /identity/v3/projects/c8d69b17697442af8aaccb9ad77bbdcf => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:36:52.145603 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=59,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:53.026108 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=26,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:37:49.464842 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a85e5-8660-45ec-9e93-a07cdb8286e0 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:37:49.468494 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-554a85e5-8660-45ec-9e93-a07cdb8286e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:37:49.537704 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a85e5-8660-45ec-9e93-a07cdb8286e0 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:37:49.599099 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad539ae-d71e-4a7a-b0cc-200902a815a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:37:49.599753 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad539ae-d71e-4a7a-b0cc-200902a815a1 service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:37:49.600037 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad539ae-d71e-4a7a-b0cc-200902a815a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:37:49.600314 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad539ae-d71e-4a7a-b0cc-200902a815a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:37:49.602642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9ad539ae-d71e-4a7a-b0cc-200902a815a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:37:49.658232 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad539ae-d71e-4a7a-b0cc-200902a815a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:37:49.659825 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad539ae-d71e-4a7a-b0cc-200902a815a1 service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:37:49.669374 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1398/2818] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:37:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:37:59.664594 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=84 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:37:59.671357 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c515395-7e4f-4eb9-b581-97064a11b9d8 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:37:59.676429 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-6c515395-7e4f-4eb9-b581-97064a11b9d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:37:59.689529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c515395-7e4f-4eb9-b581-97064a11b9d8 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:37:59.695140 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e52982-51b2-4def-b1fc-063b005e2e80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:37:59.696367 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e52982-51b2-4def-b1fc-063b005e2e80 service nova] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:37:59.696659 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e52982-51b2-4def-b1fc-063b005e2e80 service nova] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:37:59.696943 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e52982-51b2-4def-b1fc-063b005e2e80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:37:59.698783 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-74e52982-51b2-4def-b1fc-063b005e2e80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:37:59.713053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e52982-51b2-4def-b1fc-063b005e2e80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:37:59.714757 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e52982-51b2-4def-b1fc-063b005e2e80 service nova] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:37:59.727110 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1421/2819] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:37:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:38:04.587943 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166fa6e-ce31-4a01-9510-f9781bae9266 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:38:04.592390 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166fa6e-ce31-4a01-9510-f9781bae9266 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:38:04.592390 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166fa6e-ce31-4a01-9510-f9781bae9266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:38:04.606420 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-c166fa6e-ce31-4a01-9510-f9781bae9266 None None] MFA Rules not processed for user `b25d1df6e9a643ad8482e3632a99917e`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:38:04.607636 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c166fa6e-ce31-4a01-9510-f9781bae9266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:38:04.614697 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1399/2820] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:38:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:38:04.918703 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e52982-51b2-4def-b1fc-063b005e2e80 service nova] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:38:04.920067 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-74e52982-51b2-4def-b1fc-063b005e2e80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:38:04.976990 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e52982-51b2-4def-b1fc-063b005e2e80 service nova] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:38:04.980729 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7a49e-4b8e-48f7-be86-451b8bacaddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:38:04.981362 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7a49e-4b8e-48f7-be86-451b8bacaddd service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:38:04.981644 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7a49e-4b8e-48f7-be86-451b8bacaddd service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:38:04.981957 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7a49e-4b8e-48f7-be86-451b8bacaddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:38:04.983974 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-31e7a49e-4b8e-48f7-be86-451b8bacaddd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:38:04.994271 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7a49e-4b8e-48f7-be86-451b8bacaddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:38:04.999467 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7a49e-4b8e-48f7-be86-451b8bacaddd service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:38:05.003962 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1422/2821] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:38:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:38:14.600910 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:38:15.000298 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=32 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:38:15.798748 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166fa6e-ce31-4a01-9510-f9781bae9266 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:38:15.811882 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166fa6e-ce31-4a01-9510-f9781bae9266 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:38:15.817315 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e1be9-19fc-497f-86d8-491c63427f29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:38:15.817994 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e1be9-19fc-497f-86d8-491c63427f29 service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:38:15.818288 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e1be9-19fc-497f-86d8-491c63427f29 service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:38:15.818569 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e1be9-19fc-497f-86d8-491c63427f29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:38:15.820388 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-aa7e1be9-19fc-497f-86d8-491c63427f29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:38:15.833265 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e1be9-19fc-497f-86d8-491c63427f29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:38:15.834884 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e1be9-19fc-497f-86d8-491c63427f29 service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:38:15.846445 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1400/2822] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:38:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:38:19.649882 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7a49e-4b8e-48f7-be86-451b8bacaddd service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:38:19.651425 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-31e7a49e-4b8e-48f7-be86-451b8bacaddd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:38:19.667785 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7a49e-4b8e-48f7-be86-451b8bacaddd service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:38:19.673335 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360700c9-3940-43a4-9bec-f12921cea29e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:38:19.674004 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360700c9-3940-43a4-9bec-f12921cea29e service nova] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:38:19.674293 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360700c9-3940-43a4-9bec-f12921cea29e service nova] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:38:19.674573 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360700c9-3940-43a4-9bec-f12921cea29e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:38:19.676321 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-360700c9-3940-43a4-9bec-f12921cea29e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:38:19.689177 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360700c9-3940-43a4-9bec-f12921cea29e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:38:19.690787 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360700c9-3940-43a4-9bec-f12921cea29e service nova] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:38:19.701407 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1423/2823] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:38:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:38:25.842101 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=6 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:38:29.696831 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=6 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:38:48.532396 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e1be9-19fc-497f-86d8-491c63427f29 service nova] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:38:48.533931 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-aa7e1be9-19fc-497f-86d8-491c63427f29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:38:48.545854 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e1be9-19fc-497f-86d8-491c63427f29 service nova] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:38:48.550164 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1046b-8172-4fb0-989a-af37569650e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:38:48.558023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1046b-8172-4fb0-989a-af37569650e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:38:48.558023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1046b-8172-4fb0-989a-af37569650e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:38:48.558023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1046b-8172-4fb0-989a-af37569650e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:38:48.558023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-53e1046b-8172-4fb0-989a-af37569650e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:38:48.565126 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1046b-8172-4fb0-989a-af37569650e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:38:48.566852 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1046b-8172-4fb0-989a-af37569650e5 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:38:48.576413 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1401/2824] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:38:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:38:48.654468 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360700c9-3940-43a4-9bec-f12921cea29e service nova] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:38:48.663837 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360700c9-3940-43a4-9bec-f12921cea29e service nova] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:38:48.667535 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a6503-bd03-4611-8349-1964c2f2ae88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:38:48.668711 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a6503-bd03-4611-8349-1964c2f2ae88 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:38:48.668999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a6503-bd03-4611-8349-1964c2f2ae88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:38:48.669278 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a6503-bd03-4611-8349-1964c2f2ae88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:38:48.671079 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-434a6503-bd03-4611-8349-1964c2f2ae88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:38:48.684429 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a6503-bd03-4611-8349-1964c2f2ae88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:38:48.685816 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a6503-bd03-4611-8349-1964c2f2ae88 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:38:48.696781 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1424/2825] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:38:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:38:58.572323 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=6 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:38:58.691898 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=6 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:39:07.529105 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1046b-8172-4fb0-989a-af37569650e5 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:39:07.531348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-53e1046b-8172-4fb0-989a-af37569650e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:39:07.603912 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1046b-8172-4fb0-989a-af37569650e5 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:39:07.609040 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702cfef-abf4-4b23-baf8-bcce7694b383 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b7c9264495433985185332778dbc8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:39:07.609685 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702cfef-abf4-4b23-baf8-bcce7694b383 service placement] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:39:07.609994 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702cfef-abf4-4b23-baf8-bcce7694b383 service placement] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:39:07.610269 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702cfef-abf4-4b23-baf8-bcce7694b383 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:39:07.612021 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1702cfef-abf4-4b23-baf8-bcce7694b383 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:39:07.623488 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702cfef-abf4-4b23-baf8-bcce7694b383 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:39:07.625143 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702cfef-abf4-4b23-baf8-bcce7694b383 service placement] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:39:07.635318 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1402/2826] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:39:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:39:17.630852 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=32 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:39:53.114235 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a6503-bd03-4611-8349-1964c2f2ae88 service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:39:53.122930 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a6503-bd03-4611-8349-1964c2f2ae88 service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:39:53.126529 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0747d0-f2f5-427f-83b0-7c330d483645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:39:53.127159 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0747d0-f2f5-427f-83b0-7c330d483645 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:39:53.127443 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0747d0-f2f5-427f-83b0-7c330d483645 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:39:53.127716 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0747d0-f2f5-427f-83b0-7c330d483645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:39:53.129501 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-3e0747d0-f2f5-427f-83b0-7c330d483645 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:39:53.191567 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0747d0-f2f5-427f-83b0-7c330d483645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:39:53.192996 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0747d0-f2f5-427f-83b0-7c330d483645 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:39:53.202626 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1425/2827] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:39:56.745180 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702cfef-abf4-4b23-baf8-bcce7694b383 service placement] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:39:56.746904 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1702cfef-abf4-4b23-baf8-bcce7694b383 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:39:56.764959 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702cfef-abf4-4b23-baf8-bcce7694b383 service placement] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:39:56.770598 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63128cd0-28c4-4aa6-8ed1-2646856a85db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:39:56.771489 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63128cd0-28c4-4aa6-8ed1-2646856a85db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:39:56.771774 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63128cd0-28c4-4aa6-8ed1-2646856a85db admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:39:56.772054 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63128cd0-28c4-4aa6-8ed1-2646856a85db admin admin] PATH_INFO: `/v3/users/b25d1df6e9a643ad8482e3632a99917e` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:39:56.773293 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63128cd0-28c4-4aa6-8ed1-2646856a85db admin admin] RBAC: Authorizing `identity:delete_user(user_id=b25d1df6e9a643ad8482e3632a99917e)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:39:56.775344 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63128cd0-28c4-4aa6-8ed1-2646856a85db admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:39:56.962353 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-63128cd0-28c4-4aa6-8ed1-2646856a85db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b25d1df6e9a643ad8482e3632a99917e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:39:56.962942 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-63128cd0-28c4-4aa6-8ed1-2646856a85db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b25d1df6e9a643ad8482e3632a99917e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:39:56.969895 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-63128cd0-28c4-4aa6-8ed1-2646856a85db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b25d1df6e9a643ad8482e3632a99917e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:39:57.034434 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-63128cd0-28c4-4aa6-8ed1-2646856a85db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b25d1df6e9a643ad8482e3632a99917e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:39:57.046641 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-63128cd0-28c4-4aa6-8ed1-2646856a85db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b25d1df6e9a643ad8482e3632a99917e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:39:57.053616 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1403/2828] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:39:56 2022] DELETE /identity/v3/users/b25d1df6e9a643ad8482e3632a99917e => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:39:57.297640 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0747d0-f2f5-427f-83b0-7c330d483645 service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:39:57.307266 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0747d0-f2f5-427f-83b0-7c330d483645 service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:39:57.365826 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f237e25-5790-442d-aa03-d19126b6057b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:39:57.366749 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f237e25-5790-442d-aa03-d19126b6057b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:39:57.367041 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f237e25-5790-442d-aa03-d19126b6057b admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:39:57.367347 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f237e25-5790-442d-aa03-d19126b6057b admin admin] PATH_INFO: `/v3/projects/0f607b6f4faa4d1db8f5d153a4ef13a6` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:39:57.368543 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f237e25-5790-442d-aa03-d19126b6057b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f607b6f4faa4d1db8f5d153a4ef13a6)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:39:57.370489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f237e25-5790-442d-aa03-d19126b6057b admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:39:57.481019 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-7f237e25-5790-442d-aa03-d19126b6057b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f607b6f4faa4d1db8f5d153a4ef13a6', 'request_id': 'req-7f237e25-5790-442d-aa03-d19126b6057b'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:39:57.560854 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-7f237e25-5790-442d-aa03-d19126b6057b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f607b6f4faa4d1db8f5d153a4ef13a6', 'request_id': 'req-7f237e25-5790-442d-aa03-d19126b6057b'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:39:57.567448 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-7f237e25-5790-442d-aa03-d19126b6057b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f607b6f4faa4d1db8f5d153a4ef13a6', 'request_id': 'req-7f237e25-5790-442d-aa03-d19126b6057b'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:39:57.577663 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-7f237e25-5790-442d-aa03-d19126b6057b admin admin] The token cache is being invalidate because project 0f607b6f4faa4d1db8f5d153a4ef13a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:39:57.578700 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-7f237e25-5790-442d-aa03-d19126b6057b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:39:57.578700 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-7f237e25-5790-442d-aa03-d19126b6057b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:39:57.580272 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1426/2829] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:39:57 2022] DELETE /identity/v3/projects/0f607b6f4faa4d1db8f5d153a4ef13a6 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:39:57.585808 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1b0cc-3b01-465b-8da7-f86231d14c0f None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:39:57.586107 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1b0cc-3b01-465b-8da7-f86231d14c0f None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:39:57.586640 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1b0cc-3b01-465b-8da7-f86231d14c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:39:57.604587 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-c8f1b0cc-3b01-465b-8da7-f86231d14c0f None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:39:57.605799 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c8f1b0cc-3b01-465b-8da7-f86231d14c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:39:57.663884 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1404/2830] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:39:57.671489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771149fa-c49a-43cb-b046-1e7860273cc6 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:39:57.679518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771149fa-c49a-43cb-b046-1e7860273cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:39:57.679518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771149fa-c49a-43cb-b046-1e7860273cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:39:57.690430 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-771149fa-c49a-43cb-b046-1e7860273cc6 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:39:57.692241 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-771149fa-c49a-43cb-b046-1e7860273cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:39:57.700026 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1427/2831] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:39:57.704176 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1b0cc-3b01-465b-8da7-f86231d14c0f None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:39:57.714507 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1b0cc-3b01-465b-8da7-f86231d14c0f None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:39:57.719175 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ed674-c1d9-442c-aee2-af387b271b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:39:57.719838 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ed674-c1d9-442c-aee2-af387b271b4d admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:39:57.720126 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ed674-c1d9-442c-aee2-af387b271b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:39:57.720406 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ed674-c1d9-442c-aee2-af387b271b4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:39:57.721131 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ed674-c1d9-442c-aee2-af387b271b4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:39:57.721443 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ed674-c1d9-442c-aee2-af387b271b4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:39:57.723151 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ed674-c1d9-442c-aee2-af387b271b4d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:39:57.734699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1405/2832] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:39:57.739674 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771149fa-c49a-43cb-b046-1e7860273cc6 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:39:57.748840 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771149fa-c49a-43cb-b046-1e7860273cc6 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:39:57.753399 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad26cea3-0e88-4c65-b593-619587f4bb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:39:57.754729 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26cea3-0e88-4c65-b593-619587f4bb58 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:39:57.755027 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26cea3-0e88-4c65-b593-619587f4bb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:39:57.755293 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26cea3-0e88-4c65-b593-619587f4bb58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:39:57.756018 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad26cea3-0e88-4c65-b593-619587f4bb58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:39:57.757952 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad26cea3-0e88-4c65-b593-619587f4bb58 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:39:57.772500 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:39:57.848318 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1428/2833] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:39:57 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:39:57.852577 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ed674-c1d9-442c-aee2-af387b271b4d admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:39:57.862607 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ed674-c1d9-442c-aee2-af387b271b4d admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:39:57.918809 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419e1a4-2b52-4c9b-9501-8664ecdf6a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:39:57.919479 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419e1a4-2b52-4c9b-9501-8664ecdf6a2d admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:39:57.919770 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419e1a4-2b52-4c9b-9501-8664ecdf6a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:39:57.920050 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419e1a4-2b52-4c9b-9501-8664ecdf6a2d admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:39:57.920740 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2419e1a4-2b52-4c9b-9501-8664ecdf6a2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:39:57.922698 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2419e1a4-2b52-4c9b-9501-8664ecdf6a2d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:39:57.929869 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:39:58.042382 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1406/2834] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:39:57 2022] POST /identity/v3/users => generated 287 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:39:58.046542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad26cea3-0e88-4c65-b593-619587f4bb58 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:39:58.057481 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad26cea3-0e88-4c65-b593-619587f4bb58 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:39:58.062134 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd15aa-408a-4669-9cb8-44dfbf3ef4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:39:58.062907 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd15aa-408a-4669-9cb8-44dfbf3ef4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:39:58.063195 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd15aa-408a-4669-9cb8-44dfbf3ef4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:39:58.063474 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd15aa-408a-4669-9cb8-44dfbf3ef4a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:39:58.064206 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd15aa-408a-4669-9cb8-44dfbf3ef4a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:39:58.065815 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd15aa-408a-4669-9cb8-44dfbf3ef4a4 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:39:58.076338 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1429/2835] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:39:58.080344 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419e1a4-2b52-4c9b-9501-8664ecdf6a2d admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:39:58.090746 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419e1a4-2b52-4c9b-9501-8664ecdf6a2d admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:39:58.095548 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7716c79-3e17-4f45-9f98-ddb58c1cea6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:39:58.096239 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7716c79-3e17-4f45-9f98-ddb58c1cea6a admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:39:58.096520 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7716c79-3e17-4f45-9f98-ddb58c1cea6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:39:58.096795 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7716c79-3e17-4f45-9f98-ddb58c1cea6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:39:58.098115 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7716c79-3e17-4f45-9f98-ddb58c1cea6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:39:58.099743 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7716c79-3e17-4f45-9f98-ddb58c1cea6a admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:39:58.110680 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1407/2836] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:39:58.116627 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd15aa-408a-4669-9cb8-44dfbf3ef4a4 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:39:58.126624 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd15aa-408a-4669-9cb8-44dfbf3ef4a4 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:39:58.131553 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f854d63-c726-48e3-afac-70d54f5e5ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:39:58.132640 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f854d63-c726-48e3-afac-70d54f5e5ed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:39:58.133133 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f854d63-c726-48e3-afac-70d54f5e5ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:39:58.133423 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f854d63-c726-48e3-afac-70d54f5e5ed9 admin admin] PATH_INFO: `/v3/projects/67bb55891a0f4b54afe3f2a11d168526/users/eb66425d9ec14842947c2f27ece67e75/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:39:58.148255 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f854d63-c726-48e3-afac-70d54f5e5ed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67bb55891a0f4b54afe3f2a11d168526, user_id=eb66425d9ec14842947c2f27ece67e75, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:39:58.150915 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f854d63-c726-48e3-afac-70d54f5e5ed9 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:39:58.236012 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1430/2837] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:39:58 2022] PUT /identity/v3/projects/67bb55891a0f4b54afe3f2a11d168526/users/eb66425d9ec14842947c2f27ece67e75/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:39:58.247396 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501e72a-655c-4e22-9227-5f352000ca3b None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:39:58.247918 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501e72a-655c-4e22-9227-5f352000ca3b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:39:58.248208 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501e72a-655c-4e22-9227-5f352000ca3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:39:58.274228 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-3501e72a-655c-4e22-9227-5f352000ca3b None None] MFA Rules not processed for user `eb66425d9ec14842947c2f27ece67e75`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:39:58.275475 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3501e72a-655c-4e22-9227-5f352000ca3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:39:58.341074 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1408/2838] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:39:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:39:58.353271 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f854d63-c726-48e3-afac-70d54f5e5ed9 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:39:58.355249 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-2f854d63-c726-48e3-afac-70d54f5e5ed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:39:58.427446 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f854d63-c726-48e3-afac-70d54f5e5ed9 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:39:58.432948 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff48a65-30d0-4aa9-ab32-3af31c11e5bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b9e7594afc346e593ef3e6c579e237b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:39:58.433589 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff48a65-30d0-4aa9-ab32-3af31c11e5bc service nova] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:39:58.433915 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff48a65-30d0-4aa9-ab32-3af31c11e5bc service nova] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:39:58.434194 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff48a65-30d0-4aa9-ab32-3af31c11e5bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:39:58.441916 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff48a65-30d0-4aa9-ab32-3af31c11e5bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:39:58.443482 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff48a65-30d0-4aa9-ab32-3af31c11e5bc service nova] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:39:58.452084 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1431/2839] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:39:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:40:01.583374 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501e72a-655c-4e22-9227-5f352000ca3b None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:01.643117 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501e72a-655c-4e22-9227-5f352000ca3b None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:01.648063 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc0d19-485e-47cb-ae84-d17572082c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:01.648934 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc0d19-485e-47cb-ae84-d17572082c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:01.649227 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc0d19-485e-47cb-ae84-d17572082c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:01.649510 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc0d19-485e-47cb-ae84-d17572082c2e admin admin] PATH_INFO: `/v3/users/eb66425d9ec14842947c2f27ece67e75` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:01.650735 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc0d19-485e-47cb-ae84-d17572082c2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb66425d9ec14842947c2f27ece67e75)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:01.652999 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc0d19-485e-47cb-ae84-d17572082c2e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:01.854150 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-78cc0d19-485e-47cb-ae84-d17572082c2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb66425d9ec14842947c2f27ece67e75'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:01.854808 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-78cc0d19-485e-47cb-ae84-d17572082c2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb66425d9ec14842947c2f27ece67e75'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:01.861543 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-78cc0d19-485e-47cb-ae84-d17572082c2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb66425d9ec14842947c2f27ece67e75'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:01.927230 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-78cc0d19-485e-47cb-ae84-d17572082c2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb66425d9ec14842947c2f27ece67e75'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:01.932398 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:01.939306 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-78cc0d19-485e-47cb-ae84-d17572082c2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb66425d9ec14842947c2f27ece67e75'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:01.945455 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1409/2840] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:40:01 2022] DELETE /identity/v3/users/eb66425d9ec14842947c2f27ece67e75 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:40:01.949999 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c967465-1670-4235-8e32-be9e4ac19c0e None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:01.950491 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c967465-1670-4235-8e32-be9e4ac19c0e None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:01.950603 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c967465-1670-4235-8e32-be9e4ac19c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:01.967963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-9c967465-1670-4235-8e32-be9e4ac19c0e None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:40:01.969147 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-9c967465-1670-4235-8e32-be9e4ac19c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:02.027145 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1432/2841] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:40:02.037499 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc0d19-485e-47cb-ae84-d17572082c2e admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:02.038948 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-78cc0d19-485e-47cb-ae84-d17572082c2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:02.095748 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc0d19-485e-47cb-ae84-d17572082c2e admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:02.099971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dbae69-0ddf-4824-955a-5481891e2778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:02.100613 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbae69-0ddf-4824-955a-5481891e2778 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:02.100896 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbae69-0ddf-4824-955a-5481891e2778 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:02.101175 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbae69-0ddf-4824-955a-5481891e2778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:02.110014 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dbae69-0ddf-4824-955a-5481891e2778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:02.111420 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dbae69-0ddf-4824-955a-5481891e2778 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:02.120723 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1410/2842] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:40:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:40:02.494023 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c967465-1670-4235-8e32-be9e4ac19c0e None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:02.495503 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-9c967465-1670-4235-8e32-be9e4ac19c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:02.508198 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c967465-1670-4235-8e32-be9e4ac19c0e None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:02.512870 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a1967-cc70-42f7-bb3d-735315d72e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:02.513825 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a1967-cc70-42f7-bb3d-735315d72e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:02.514124 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a1967-cc70-42f7-bb3d-735315d72e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:02.514407 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a1967-cc70-42f7-bb3d-735315d72e4f admin admin] PATH_INFO: `/v3/projects/67bb55891a0f4b54afe3f2a11d168526` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:02.515667 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a1967-cc70-42f7-bb3d-735315d72e4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=67bb55891a0f4b54afe3f2a11d168526)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:02.517580 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a1967-cc70-42f7-bb3d-735315d72e4f admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:02.629973 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:02.635776 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-cc0a1967-cc70-42f7-bb3d-735315d72e4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67bb55891a0f4b54afe3f2a11d168526', 'request_id': 'req-cc0a1967-cc70-42f7-bb3d-735315d72e4f'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:02.709190 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-cc0a1967-cc70-42f7-bb3d-735315d72e4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67bb55891a0f4b54afe3f2a11d168526', 'request_id': 'req-cc0a1967-cc70-42f7-bb3d-735315d72e4f'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:02.716057 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-cc0a1967-cc70-42f7-bb3d-735315d72e4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67bb55891a0f4b54afe3f2a11d168526', 'request_id': 'req-cc0a1967-cc70-42f7-bb3d-735315d72e4f'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:02.726587 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-cc0a1967-cc70-42f7-bb3d-735315d72e4f admin admin] The token cache is being invalidate because project 67bb55891a0f4b54afe3f2a11d168526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:40:02.726879 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-cc0a1967-cc70-42f7-bb3d-735315d72e4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:02.727518 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-cc0a1967-cc70-42f7-bb3d-735315d72e4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:02.729098 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1433/2843] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:40:02 2022] DELETE /identity/v3/projects/67bb55891a0f4b54afe3f2a11d168526 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:40:02.734140 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ec03e-e027-452c-8b05-da0d0dc258e8 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:02.734606 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ec03e-e027-452c-8b05-da0d0dc258e8 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:02.734738 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ec03e-e027-452c-8b05-da0d0dc258e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:02.752506 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-597ec03e-e027-452c-8b05-da0d0dc258e8 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:40:02.754394 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-597ec03e-e027-452c-8b05-da0d0dc258e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:02.814990 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1411/2844] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:40:02.823477 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7570d-044f-4be9-9cd8-dff5d35d9ff7 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:02.823772 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7570d-044f-4be9-9cd8-dff5d35d9ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:02.824054 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7570d-044f-4be9-9cd8-dff5d35d9ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:02.842625 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-66a7570d-044f-4be9-9cd8-dff5d35d9ff7 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:40:02.843824 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-66a7570d-044f-4be9-9cd8-dff5d35d9ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:02.851904 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1434/2845] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:40:02.856204 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ec03e-e027-452c-8b05-da0d0dc258e8 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:02.866409 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ec03e-e027-452c-8b05-da0d0dc258e8 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:02.870932 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd0565-8f40-4da4-8726-696bb9013f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:02.871596 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd0565-8f40-4da4-8726-696bb9013f2b admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:02.871867 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd0565-8f40-4da4-8726-696bb9013f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:02.872146 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd0565-8f40-4da4-8726-696bb9013f2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:02.872862 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd0565-8f40-4da4-8726-696bb9013f2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:40:02.873171 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd0565-8f40-4da4-8726-696bb9013f2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:02.874786 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd0565-8f40-4da4-8726-696bb9013f2b admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:02.886686 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1412/2846] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:40:02.891345 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7570d-044f-4be9-9cd8-dff5d35d9ff7 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:02.900584 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7570d-044f-4be9-9cd8-dff5d35d9ff7 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:02.905226 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e4c1d-7751-4a3e-927a-07e7e150d590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:02.905916 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e4c1d-7751-4a3e-927a-07e7e150d590 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:02.906206 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e4c1d-7751-4a3e-927a-07e7e150d590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:02.906482 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e4c1d-7751-4a3e-927a-07e7e150d590 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:02.907167 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e4c1d-7751-4a3e-927a-07e7e150d590 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:02.909106 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e4c1d-7751-4a3e-927a-07e7e150d590 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:02.990704 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1435/2847] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:40:02 2022] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:40:02.994757 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd0565-8f40-4da4-8726-696bb9013f2b admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:03.005326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd0565-8f40-4da4-8726-696bb9013f2b admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:03.060445 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64dd44-d14a-4297-97d6-6e73599c26d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:03.061113 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64dd44-d14a-4297-97d6-6e73599c26d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:03.061402 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64dd44-d14a-4297-97d6-6e73599c26d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:03.061680 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64dd44-d14a-4297-97d6-6e73599c26d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:03.062442 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64dd44-d14a-4297-97d6-6e73599c26d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:03.064402 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64dd44-d14a-4297-97d6-6e73599c26d5 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:03.167012 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1413/2848] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:40:02 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:40:03.171174 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e4c1d-7751-4a3e-927a-07e7e150d590 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:03.183423 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e4c1d-7751-4a3e-927a-07e7e150d590 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:03.188741 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ca2e9-5e01-48fe-86a8-f51b7b38454a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:03.189885 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ca2e9-5e01-48fe-86a8-f51b7b38454a admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:03.190188 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ca2e9-5e01-48fe-86a8-f51b7b38454a admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:03.190466 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ca2e9-5e01-48fe-86a8-f51b7b38454a admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:03.191396 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ca2e9-5e01-48fe-86a8-f51b7b38454a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:03.192996 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ca2e9-5e01-48fe-86a8-f51b7b38454a admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:03.203861 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1436/2849] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:40:03.208011 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64dd44-d14a-4297-97d6-6e73599c26d5 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:03.218237 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64dd44-d14a-4297-97d6-6e73599c26d5 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:03.223372 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399d085-ad0f-482a-92b7-82b8d90cb2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:03.224157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399d085-ad0f-482a-92b7-82b8d90cb2ad admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:03.224543 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399d085-ad0f-482a-92b7-82b8d90cb2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:03.224879 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399d085-ad0f-482a-92b7-82b8d90cb2ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:03.225607 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399d085-ad0f-482a-92b7-82b8d90cb2ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:03.227284 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399d085-ad0f-482a-92b7-82b8d90cb2ad admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:03.228525 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:03.240634 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1414/2850] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:40:03.244645 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ca2e9-5e01-48fe-86a8-f51b7b38454a admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:03.255250 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ca2e9-5e01-48fe-86a8-f51b7b38454a admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:03.260253 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ad5f6-b26c-4d13-b954-a92d75608657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:03.261201 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ad5f6-b26c-4d13-b954-a92d75608657 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:03.261487 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ad5f6-b26c-4d13-b954-a92d75608657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:03.261814 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ad5f6-b26c-4d13-b954-a92d75608657 admin admin] PATH_INFO: `/v3/projects/ef88fa2e0bfb4a0abdd7206329a75396/users/855780fbe7be46e7baf0589dde5ae739/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:03.276696 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ad5f6-b26c-4d13-b954-a92d75608657 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef88fa2e0bfb4a0abdd7206329a75396, user_id=855780fbe7be46e7baf0589dde5ae739, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:03.279395 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ad5f6-b26c-4d13-b954-a92d75608657 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:03.344023 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1437/2851] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:40:03 2022] PUT /identity/v3/projects/ef88fa2e0bfb4a0abdd7206329a75396/users/855780fbe7be46e7baf0589dde5ae739/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:40:03.354895 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c84146-3a1a-4a8f-826a-1eb2bc96d4da None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:03.355378 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c84146-3a1a-4a8f-826a-1eb2bc96d4da None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:03.355493 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c84146-3a1a-4a8f-826a-1eb2bc96d4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:03.381850 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-06c84146-3a1a-4a8f-826a-1eb2bc96d4da None None] MFA Rules not processed for user `855780fbe7be46e7baf0589dde5ae739`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:40:03.383030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-06c84146-3a1a-4a8f-826a-1eb2bc96d4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:03.446459 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1415/2852] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:40:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:40:03.450667 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ad5f6-b26c-4d13-b954-a92d75608657 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:03.511950 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ad5f6-b26c-4d13-b954-a92d75608657 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:03.516473 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b8057-255b-4778-8bea-9c167be41cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:03.517116 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b8057-255b-4778-8bea-9c167be41cfd admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:03.517403 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b8057-255b-4778-8bea-9c167be41cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:03.517683 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b8057-255b-4778-8bea-9c167be41cfd admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:03.518392 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b8057-255b-4778-8bea-9c167be41cfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:03.520927 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b8057-255b-4778-8bea-9c167be41cfd admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:03.620896 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1438/2853] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:40:03 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:40:03.624926 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c84146-3a1a-4a8f-826a-1eb2bc96d4da None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:03.636542 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c84146-3a1a-4a8f-826a-1eb2bc96d4da None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:03.692177 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1e37a-4fc3-4362-87e5-2bf4cf938b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:03.692841 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1e37a-4fc3-4362-87e5-2bf4cf938b2d admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:03.693125 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1e37a-4fc3-4362-87e5-2bf4cf938b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:03.693403 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1e37a-4fc3-4362-87e5-2bf4cf938b2d admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:03.694119 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f1e37a-4fc3-4362-87e5-2bf4cf938b2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:03.696089 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f1e37a-4fc3-4362-87e5-2bf4cf938b2d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:03.774806 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1416/2854] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:40:03 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:40:03.778876 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b8057-255b-4778-8bea-9c167be41cfd admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:03.790047 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b8057-255b-4778-8bea-9c167be41cfd admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:03.794666 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f09e60-0399-48ca-a9ed-61b38d714f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:03.795307 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f09e60-0399-48ca-a9ed-61b38d714f6b admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:03.795592 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f09e60-0399-48ca-a9ed-61b38d714f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:03.795868 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f09e60-0399-48ca-a9ed-61b38d714f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:03.796621 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f09e60-0399-48ca-a9ed-61b38d714f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:03.798320 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f09e60-0399-48ca-a9ed-61b38d714f6b admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:03.810170 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1439/2855] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:40:03.814296 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1e37a-4fc3-4362-87e5-2bf4cf938b2d admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:03.824414 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1e37a-4fc3-4362-87e5-2bf4cf938b2d admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:03.829157 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994eb9ca-d7e6-42ae-b06b-9e951a574b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:03.830071 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994eb9ca-d7e6-42ae-b06b-9e951a574b49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:03.830354 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994eb9ca-d7e6-42ae-b06b-9e951a574b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:03.830631 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994eb9ca-d7e6-42ae-b06b-9e951a574b49 admin admin] PATH_INFO: `/v3/projects/5230321ad52c4674bca4df57f974eb6a/users/d9f032259b6e4116911901220e5f2e1b/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:03.845980 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994eb9ca-d7e6-42ae-b06b-9e951a574b49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5230321ad52c4674bca4df57f974eb6a, user_id=d9f032259b6e4116911901220e5f2e1b, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:03.849284 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994eb9ca-d7e6-42ae-b06b-9e951a574b49 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:03.938876 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1417/2856] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:40:03 2022] PUT /identity/v3/projects/5230321ad52c4674bca4df57f974eb6a/users/d9f032259b6e4116911901220e5f2e1b/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:40:03.943467 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f09e60-0399-48ca-a9ed-61b38d714f6b admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:03.956657 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f09e60-0399-48ca-a9ed-61b38d714f6b admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:03.994567 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:04.012346 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b44be-97b4-4d13-884d-a89d44c380a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:04.013019 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b44be-97b4-4d13-884d-a89d44c380a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:04.013287 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b44be-97b4-4d13-884d-a89d44c380a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:04.013614 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b44be-97b4-4d13-884d-a89d44c380a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:04.014314 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b44be-97b4-4d13-884d-a89d44c380a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:04.015898 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b44be-97b4-4d13-884d-a89d44c380a1 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:04.026161 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1440/2857] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:40:04.030315 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994eb9ca-d7e6-42ae-b06b-9e951a574b49 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:04.045451 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994eb9ca-d7e6-42ae-b06b-9e951a574b49 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:04.050117 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e36c34-70d3-4197-9f5e-f9409cee52d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:04.051029 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e36c34-70d3-4197-9f5e-f9409cee52d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:04.051427 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e36c34-70d3-4197-9f5e-f9409cee52d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:04.051711 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e36c34-70d3-4197-9f5e-f9409cee52d3 admin admin] PATH_INFO: `/v3/projects/5230321ad52c4674bca4df57f974eb6a/users/d9f032259b6e4116911901220e5f2e1b/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:04.053687 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e36c34-70d3-4197-9f5e-f9409cee52d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5230321ad52c4674bca4df57f974eb6a, user_id=d9f032259b6e4116911901220e5f2e1b, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:04.056330 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e36c34-70d3-4197-9f5e-f9409cee52d3 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:04.066552 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1418/2858] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:40:04 2022] PUT /identity/v3/projects/5230321ad52c4674bca4df57f974eb6a/users/d9f032259b6e4116911901220e5f2e1b/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:40:04.078402 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8c260-0304-4941-a9ca-4051a87e2c3e None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:04.078692 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8c260-0304-4941-a9ca-4051a87e2c3e None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:04.078968 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8c260-0304-4941-a9ca-4051a87e2c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:04.105548 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-26c8c260-0304-4941-a9ca-4051a87e2c3e None None] MFA Rules not processed for user `d9f032259b6e4116911901220e5f2e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:40:04.106786 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-26c8c260-0304-4941-a9ca-4051a87e2c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:04.175216 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1441/2859] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:40:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:40:04.186921 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e36c34-70d3-4197-9f5e-f9409cee52d3 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:04.188652 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d9e36c34-70d3-4197-9f5e-f9409cee52d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:04.231308 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:04.246660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e36c34-70d3-4197-9f5e-f9409cee52d3 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:04.250321 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc00ed-879b-4596-bed5-7432cc47b969 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:04.250979 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc00ed-879b-4596-bed5-7432cc47b969 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:04.251296 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc00ed-879b-4596-bed5-7432cc47b969 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:04.251564 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc00ed-879b-4596-bed5-7432cc47b969 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:04.262421 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc00ed-879b-4596-bed5-7432cc47b969 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:04.263937 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc00ed-879b-4596-bed5-7432cc47b969 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:04.274509 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1419/2860] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:40:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:40:05.224607 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8c260-0304-4941-a9ca-4051a87e2c3e None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:05.288239 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8c260-0304-4941-a9ca-4051a87e2c3e None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:05.292880 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215a013-777f-4e9f-b481-9f928012d19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:05.293739 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215a013-777f-4e9f-b481-9f928012d19e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:05.294055 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215a013-777f-4e9f-b481-9f928012d19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:05.294335 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215a013-777f-4e9f-b481-9f928012d19e admin admin] PATH_INFO: `/v3/users/855780fbe7be46e7baf0589dde5ae739` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:05.295542 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215a013-777f-4e9f-b481-9f928012d19e admin admin] RBAC: Authorizing `identity:delete_user(user_id=855780fbe7be46e7baf0589dde5ae739)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:05.297486 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215a013-777f-4e9f-b481-9f928012d19e admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:05.466460 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-9215a013-777f-4e9f-b481-9f928012d19e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '855780fbe7be46e7baf0589dde5ae739'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:05.561135 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-9215a013-777f-4e9f-b481-9f928012d19e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '855780fbe7be46e7baf0589dde5ae739'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:05.568892 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-9215a013-777f-4e9f-b481-9f928012d19e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '855780fbe7be46e7baf0589dde5ae739'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:05.569562 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-9215a013-777f-4e9f-b481-9f928012d19e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '855780fbe7be46e7baf0589dde5ae739'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:05.570210 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-9215a013-777f-4e9f-b481-9f928012d19e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '855780fbe7be46e7baf0589dde5ae739'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:05.571352 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:05.592865 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1442/2861] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:40:05 2022] DELETE /identity/v3/users/855780fbe7be46e7baf0589dde5ae739 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:40:05.597336 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964b7ad-df7a-44b1-a9bc-1f92d5a35626 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:05.597835 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964b7ad-df7a-44b1-a9bc-1f92d5a35626 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:05.598283 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964b7ad-df7a-44b1-a9bc-1f92d5a35626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:05.615780 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-b964b7ad-df7a-44b1-a9bc-1f92d5a35626 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:40:05.617020 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b964b7ad-df7a-44b1-a9bc-1f92d5a35626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:05.675583 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1420/2862] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:40:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 11:40:05.685232 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215a013-777f-4e9f-b481-9f928012d19e admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:05.686687 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-9215a013-777f-4e9f-b481-9f928012d19e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:05.743997 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215a013-777f-4e9f-b481-9f928012d19e admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:05.747524 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff3daa-32ad-483f-8013-f06388f9e912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:05.748160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff3daa-32ad-483f-8013-f06388f9e912 service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:05.748448 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff3daa-32ad-483f-8013-f06388f9e912 service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:05.748725 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff3daa-32ad-483f-8013-f06388f9e912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:05.758225 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff3daa-32ad-483f-8013-f06388f9e912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:05.759654 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff3daa-32ad-483f-8013-f06388f9e912 service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:05.770840 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1443/2863] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:40:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:40:06.145498 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964b7ad-df7a-44b1-a9bc-1f92d5a35626 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:06.147081 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b964b7ad-df7a-44b1-a9bc-1f92d5a35626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:06.161940 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964b7ad-df7a-44b1-a9bc-1f92d5a35626 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:06.167127 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea439fb-0327-49aa-a7da-d64e509856d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:06.168211 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea439fb-0327-49aa-a7da-d64e509856d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:06.168558 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea439fb-0327-49aa-a7da-d64e509856d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:06.168749 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea439fb-0327-49aa-a7da-d64e509856d2 admin admin] PATH_INFO: `/v3/projects/ef88fa2e0bfb4a0abdd7206329a75396` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:06.169980 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea439fb-0327-49aa-a7da-d64e509856d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef88fa2e0bfb4a0abdd7206329a75396)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:06.171976 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea439fb-0327-49aa-a7da-d64e509856d2 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:06.287896 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bea439fb-0327-49aa-a7da-d64e509856d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef88fa2e0bfb4a0abdd7206329a75396', 'request_id': 'req-bea439fb-0327-49aa-a7da-d64e509856d2'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:06.293391 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bea439fb-0327-49aa-a7da-d64e509856d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef88fa2e0bfb4a0abdd7206329a75396', 'request_id': 'req-bea439fb-0327-49aa-a7da-d64e509856d2'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:06.366533 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bea439fb-0327-49aa-a7da-d64e509856d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef88fa2e0bfb4a0abdd7206329a75396', 'request_id': 'req-bea439fb-0327-49aa-a7da-d64e509856d2'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:06.378075 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bea439fb-0327-49aa-a7da-d64e509856d2 admin admin] The token cache is being invalidate because project ef88fa2e0bfb4a0abdd7206329a75396 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:40:06.378388 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bea439fb-0327-49aa-a7da-d64e509856d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:06.379038 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bea439fb-0327-49aa-a7da-d64e509856d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:06.380769 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1421/2864] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:40:06 2022] DELETE /identity/v3/projects/ef88fa2e0bfb4a0abdd7206329a75396 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:40:06.384738 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff3daa-32ad-483f-8013-f06388f9e912 service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:06.394748 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff3daa-32ad-483f-8013-f06388f9e912 service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:06.450029 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efa63b-32d0-49b0-99d3-e48c6d343bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:06.450898 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efa63b-32d0-49b0-99d3-e48c6d343bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:06.451180 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efa63b-32d0-49b0-99d3-e48c6d343bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:06.451455 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efa63b-32d0-49b0-99d3-e48c6d343bd2 admin admin] PATH_INFO: `/v3/users/d9f032259b6e4116911901220e5f2e1b` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:06.452633 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55efa63b-32d0-49b0-99d3-e48c6d343bd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9f032259b6e4116911901220e5f2e1b)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:06.454583 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55efa63b-32d0-49b0-99d3-e48c6d343bd2 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:06.620560 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-55efa63b-32d0-49b0-99d3-e48c6d343bd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9f032259b6e4116911901220e5f2e1b'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:06.692644 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-55efa63b-32d0-49b0-99d3-e48c6d343bd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9f032259b6e4116911901220e5f2e1b'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:06.699932 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-55efa63b-32d0-49b0-99d3-e48c6d343bd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9f032259b6e4116911901220e5f2e1b'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:06.700558 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-55efa63b-32d0-49b0-99d3-e48c6d343bd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9f032259b6e4116911901220e5f2e1b'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:06.701158 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-55efa63b-32d0-49b0-99d3-e48c6d343bd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9f032259b6e4116911901220e5f2e1b'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:06.719128 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1444/2865] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:40:06 2022] DELETE /identity/v3/users/d9f032259b6e4116911901220e5f2e1b => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:40:07.174794 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea439fb-0327-49aa-a7da-d64e509856d2 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:07.176428 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-bea439fb-0327-49aa-a7da-d64e509856d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:07.192268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea439fb-0327-49aa-a7da-d64e509856d2 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:07.259682 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203088a5-bf2d-45d1-a8d8-a4484b6d89af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:07.260636 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203088a5-bf2d-45d1-a8d8-a4484b6d89af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:07.260919 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203088a5-bf2d-45d1-a8d8-a4484b6d89af admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:07.261197 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203088a5-bf2d-45d1-a8d8-a4484b6d89af admin admin] PATH_INFO: `/v3/projects/5230321ad52c4674bca4df57f974eb6a` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:07.262441 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203088a5-bf2d-45d1-a8d8-a4484b6d89af admin admin] RBAC: Authorizing `identity:delete_project(project_id=5230321ad52c4674bca4df57f974eb6a)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:07.264329 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203088a5-bf2d-45d1-a8d8-a4484b6d89af admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:07.272114 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:07.377249 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-203088a5-bf2d-45d1-a8d8-a4484b6d89af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5230321ad52c4674bca4df57f974eb6a', 'request_id': 'req-203088a5-bf2d-45d1-a8d8-a4484b6d89af'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:07.383660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-203088a5-bf2d-45d1-a8d8-a4484b6d89af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5230321ad52c4674bca4df57f974eb6a', 'request_id': 'req-203088a5-bf2d-45d1-a8d8-a4484b6d89af'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:07.452903 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-203088a5-bf2d-45d1-a8d8-a4484b6d89af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5230321ad52c4674bca4df57f974eb6a', 'request_id': 'req-203088a5-bf2d-45d1-a8d8-a4484b6d89af'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:07.466436 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-203088a5-bf2d-45d1-a8d8-a4484b6d89af admin admin] The token cache is being invalidate because project 5230321ad52c4674bca4df57f974eb6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:40:07.468088 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-203088a5-bf2d-45d1-a8d8-a4484b6d89af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:07.468756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-203088a5-bf2d-45d1-a8d8-a4484b6d89af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:07.470366 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1422/2866] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:40:07 2022] DELETE /identity/v3/projects/5230321ad52c4674bca4df57f974eb6a => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:40:07.476050 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2830f8-7164-4d7e-b207-2c1e790adf5f None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:07.476554 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2830f8-7164-4d7e-b207-2c1e790adf5f None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:07.477265 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2830f8-7164-4d7e-b207-2c1e790adf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:07.485267 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:07.502162 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-ec2830f8-7164-4d7e-b207-2c1e790adf5f None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:40:07.503581 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-ec2830f8-7164-4d7e-b207-2c1e790adf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:07.570705 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1445/2867] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:40:07.579276 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbc7c9-a75b-4f1d-908c-874abbc7bc04 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:07.579575 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbc7c9-a75b-4f1d-908c-874abbc7bc04 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:07.579888 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbc7c9-a75b-4f1d-908c-874abbc7bc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:07.602006 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-fdcbc7c9-a75b-4f1d-908c-874abbc7bc04 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:40:07.603505 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-fdcbc7c9-a75b-4f1d-908c-874abbc7bc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:07.611730 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1423/2868] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:40:07.616614 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2830f8-7164-4d7e-b207-2c1e790adf5f None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:07.626761 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2830f8-7164-4d7e-b207-2c1e790adf5f None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:07.632311 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04914bf3-5d5a-442c-8f92-f85b0859938b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:07.632972 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04914bf3-5d5a-442c-8f92-f85b0859938b admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:07.633278 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04914bf3-5d5a-442c-8f92-f85b0859938b admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:07.633558 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04914bf3-5d5a-442c-8f92-f85b0859938b admin admin] PATH_INFO: `/v3/domains` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:07.634337 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04914bf3-5d5a-442c-8f92-f85b0859938b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:40:07.634645 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04914bf3-5d5a-442c-8f92-f85b0859938b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:07.636245 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04914bf3-5d5a-442c-8f92-f85b0859938b admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:07.648238 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1446/2869] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:40:07.652596 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbc7c9-a75b-4f1d-908c-874abbc7bc04 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:07.662580 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbc7c9-a75b-4f1d-908c-874abbc7bc04 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:07.667367 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b1fb3-6562-458a-8294-fac62024bd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:07.668025 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b1fb3-6562-458a-8294-fac62024bd30 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:07.668333 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b1fb3-6562-458a-8294-fac62024bd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:07.668613 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b1fb3-6562-458a-8294-fac62024bd30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:07.669319 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b1fb3-6562-458a-8294-fac62024bd30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:07.671220 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b1fb3-6562-458a-8294-fac62024bd30 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:07.757466 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1424/2870] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:40:07 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:40:07.761588 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04914bf3-5d5a-442c-8f92-f85b0859938b admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:07.772251 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04914bf3-5d5a-442c-8f92-f85b0859938b admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:07.831225 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5982f79-0129-4ed4-91e5-61565ca2332a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:07.831896 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5982f79-0129-4ed4-91e5-61565ca2332a admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:07.832178 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5982f79-0129-4ed4-91e5-61565ca2332a admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:07.832450 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5982f79-0129-4ed4-91e5-61565ca2332a admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:07.833204 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5982f79-0129-4ed4-91e5-61565ca2332a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:07.835221 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5982f79-0129-4ed4-91e5-61565ca2332a admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:07.916439 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1447/2871] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:40:07 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:40:07.920723 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b1fb3-6562-458a-8294-fac62024bd30 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:07.931639 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b1fb3-6562-458a-8294-fac62024bd30 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:07.936116 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b645b-9888-4737-910f-e9f293b1366d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:07.936789 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b645b-9888-4737-910f-e9f293b1366d admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:07.937073 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b645b-9888-4737-910f-e9f293b1366d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:07.937348 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b645b-9888-4737-910f-e9f293b1366d admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:07.938107 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b645b-9888-4737-910f-e9f293b1366d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:07.939688 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b645b-9888-4737-910f-e9f293b1366d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:07.951285 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1425/2872] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:40:07.955308 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5982f79-0129-4ed4-91e5-61565ca2332a admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:07.965471 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5982f79-0129-4ed4-91e5-61565ca2332a admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:07.970117 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c505384-f8d7-464e-910b-889958e50d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:07.970805 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c505384-f8d7-464e-910b-889958e50d62 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:07.971093 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c505384-f8d7-464e-910b-889958e50d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:07.971369 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c505384-f8d7-464e-910b-889958e50d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:07.972101 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c505384-f8d7-464e-910b-889958e50d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:07.974248 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c505384-f8d7-464e-910b-889958e50d62 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:07.984328 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1448/2873] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:40:07.988372 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b645b-9888-4737-910f-e9f293b1366d admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:07.998835 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b645b-9888-4737-910f-e9f293b1366d admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:08.003453 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ebcff-36e1-4d80-894b-7b508775ec1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:08.004325 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ebcff-36e1-4d80-894b-7b508775ec1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:08.004607 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ebcff-36e1-4d80-894b-7b508775ec1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:08.004971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ebcff-36e1-4d80-894b-7b508775ec1d admin admin] PATH_INFO: `/v3/projects/190b06b27b9e4cabb27c4029e6fe2bba/users/406a28def4244af3836edd17cacdab36/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:08.019520 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ebcff-36e1-4d80-894b-7b508775ec1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=190b06b27b9e4cabb27c4029e6fe2bba, user_id=406a28def4244af3836edd17cacdab36, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:08.022686 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ebcff-36e1-4d80-894b-7b508775ec1d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:08.093086 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1426/2874] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:40:07 2022] PUT /identity/v3/projects/190b06b27b9e4cabb27c4029e6fe2bba/users/406a28def4244af3836edd17cacdab36/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:40:08.104070 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cefeb-1269-4610-9b79-9c263307ce6e None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:08.104362 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cefeb-1269-4610-9b79-9c263307ce6e None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:08.104643 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cefeb-1269-4610-9b79-9c263307ce6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:08.130301 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-f18cefeb-1269-4610-9b79-9c263307ce6e None None] MFA Rules not processed for user `406a28def4244af3836edd17cacdab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:40:08.131509 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-f18cefeb-1269-4610-9b79-9c263307ce6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:08.189630 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:08.195013 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1449/2875] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:40:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:40:08.203087 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ebcff-36e1-4d80-894b-7b508775ec1d admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:08.264918 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ebcff-36e1-4d80-894b-7b508775ec1d admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:08.269624 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb93f7-1da6-4aa8-9046-0aaf75eb66fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:08.270965 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb93f7-1da6-4aa8-9046-0aaf75eb66fa admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:08.271239 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb93f7-1da6-4aa8-9046-0aaf75eb66fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:08.271536 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb93f7-1da6-4aa8-9046-0aaf75eb66fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:08.272221 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb93f7-1da6-4aa8-9046-0aaf75eb66fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:08.274271 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb93f7-1da6-4aa8-9046-0aaf75eb66fa admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:08.385977 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1427/2876] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:40:08 2022] POST /identity/v3/projects => generated 387 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:40:08.390027 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cefeb-1269-4610-9b79-9c263307ce6e None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:08.401623 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cefeb-1269-4610-9b79-9c263307ce6e None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:08.459372 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdfbab-7c64-41ec-815f-01558ccef615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:08.460115 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdfbab-7c64-41ec-815f-01558ccef615 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:08.460406 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdfbab-7c64-41ec-815f-01558ccef615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:08.460682 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdfbab-7c64-41ec-815f-01558ccef615 admin admin] PATH_INFO: `/v3/users` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:08.461379 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdfbab-7c64-41ec-815f-01558ccef615 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:08.463594 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdfbab-7c64-41ec-815f-01558ccef615 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:08.573098 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1450/2877] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:40:08 2022] POST /identity/v3/users => generated 300 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:40:08.577023 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb93f7-1da6-4aa8-9046-0aaf75eb66fa admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:08.588518 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb93f7-1da6-4aa8-9046-0aaf75eb66fa admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:08.593270 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68327875-3f21-4059-98f5-68a203722da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:08.594020 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68327875-3f21-4059-98f5-68a203722da9 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:08.594302 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68327875-3f21-4059-98f5-68a203722da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:08.594585 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68327875-3f21-4059-98f5-68a203722da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:08.595313 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68327875-3f21-4059-98f5-68a203722da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:08.596926 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68327875-3f21-4059-98f5-68a203722da9 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:08.607727 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1428/2878] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:40:08.611885 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdfbab-7c64-41ec-815f-01558ccef615 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:08.622141 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdfbab-7c64-41ec-815f-01558ccef615 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:08.626671 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ffbe33-ec38-484e-9861-6e6f5d577e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:08.633183 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ffbe33-ec38-484e-9861-6e6f5d577e29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:08.633183 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ffbe33-ec38-484e-9861-6e6f5d577e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:08.633183 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ffbe33-ec38-484e-9861-6e6f5d577e29 admin admin] PATH_INFO: `/v3/projects/569e8f9688af4f03ae20844d90836831/users/9d8287e9ba124854afa071ced01c6082/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:08.643389 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ffbe33-ec38-484e-9861-6e6f5d577e29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=569e8f9688af4f03ae20844d90836831, user_id=9d8287e9ba124854afa071ced01c6082, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:08.646957 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ffbe33-ec38-484e-9861-6e6f5d577e29 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:08.720584 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1451/2879] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:40:08 2022] PUT /identity/v3/projects/569e8f9688af4f03ae20844d90836831/users/9d8287e9ba124854afa071ced01c6082/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:40:08.724522 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68327875-3f21-4059-98f5-68a203722da9 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:08.731064 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:08.734767 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68327875-3f21-4059-98f5-68a203722da9 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:08.791171 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479ff05-8cb9-45a9-b0c2-dab380560c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:08.791841 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479ff05-8cb9-45a9-b0c2-dab380560c76 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:08.792153 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479ff05-8cb9-45a9-b0c2-dab380560c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:08.792431 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479ff05-8cb9-45a9-b0c2-dab380560c76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:08.793156 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3479ff05-8cb9-45a9-b0c2-dab380560c76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:08.794781 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3479ff05-8cb9-45a9-b0c2-dab380560c76 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:08.805686 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1429/2880] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:40:08.809927 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ffbe33-ec38-484e-9861-6e6f5d577e29 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:08.820980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ffbe33-ec38-484e-9861-6e6f5d577e29 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:08.825599 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679e405-002f-488f-8026-23065ef26536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:08.826449 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679e405-002f-488f-8026-23065ef26536 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:08.826733 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679e405-002f-488f-8026-23065ef26536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:08.827012 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679e405-002f-488f-8026-23065ef26536 admin admin] PATH_INFO: `/v3/projects/569e8f9688af4f03ae20844d90836831/users/9d8287e9ba124854afa071ced01c6082/roles/736e70deba004b9289c2fed43eb107f7` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:08.828963 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679e405-002f-488f-8026-23065ef26536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=569e8f9688af4f03ae20844d90836831, user_id=9d8287e9ba124854afa071ced01c6082, role_id=736e70deba004b9289c2fed43eb107f7)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:08.831607 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679e405-002f-488f-8026-23065ef26536 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:08.842180 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1452/2881] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:40:08 2022] PUT /identity/v3/projects/569e8f9688af4f03ae20844d90836831/users/9d8287e9ba124854afa071ced01c6082/roles/736e70deba004b9289c2fed43eb107f7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:40:08.904907 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f600d-e34b-4304-bdaf-befda6b02673 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:08.905212 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f600d-e34b-4304-bdaf-befda6b02673 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:08.905471 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f600d-e34b-4304-bdaf-befda6b02673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:08.931972 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-cd1f600d-e34b-4304-bdaf-befda6b02673 None None] MFA Rules not processed for user `9d8287e9ba124854afa071ced01c6082`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:40:08.933172 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-cd1f600d-e34b-4304-bdaf-befda6b02673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:09.001371 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1430/2882] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:40:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:40:09.013395 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679e405-002f-488f-8026-23065ef26536 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:09.015150 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-8679e405-002f-488f-8026-23065ef26536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:09.073101 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679e405-002f-488f-8026-23065ef26536 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:09.076714 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a933174-124a-4153-8609-51fd98a44548 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:09.077297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a933174-124a-4153-8609-51fd98a44548 service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:09.077582 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a933174-124a-4153-8609-51fd98a44548 service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:09.077892 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a933174-124a-4153-8609-51fd98a44548 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:09.086926 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a933174-124a-4153-8609-51fd98a44548 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:09.088337 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a933174-124a-4153-8609-51fd98a44548 service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:09.097531 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1453/2883] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:40:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:40:09.159496 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f600d-e34b-4304-bdaf-befda6b02673 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:09.220279 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f600d-e34b-4304-bdaf-befda6b02673 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:09.225310 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b3393-4600-4c80-9ede-2359bbd9ff4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:09.226211 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b3393-4600-4c80-9ede-2359bbd9ff4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:09.226494 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b3393-4600-4c80-9ede-2359bbd9ff4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:09.226764 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b3393-4600-4c80-9ede-2359bbd9ff4e admin admin] PATH_INFO: `/v3/users/406a28def4244af3836edd17cacdab36` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:09.227971 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b3393-4600-4c80-9ede-2359bbd9ff4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=406a28def4244af3836edd17cacdab36)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:09.229895 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b3393-4600-4c80-9ede-2359bbd9ff4e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:09.353100 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:09.425752 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-df6b3393-4600-4c80-9ede-2359bbd9ff4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '406a28def4244af3836edd17cacdab36'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:09.427188 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-df6b3393-4600-4c80-9ede-2359bbd9ff4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '406a28def4244af3836edd17cacdab36'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:09.434577 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-df6b3393-4600-4c80-9ede-2359bbd9ff4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '406a28def4244af3836edd17cacdab36'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:09.492378 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-df6b3393-4600-4c80-9ede-2359bbd9ff4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '406a28def4244af3836edd17cacdab36'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:09.504707 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-df6b3393-4600-4c80-9ede-2359bbd9ff4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '406a28def4244af3836edd17cacdab36'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:09.510684 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1431/2884] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:40:09 2022] DELETE /identity/v3/users/406a28def4244af3836edd17cacdab36 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:40:09.515230 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3008b1-ca19-4de0-9027-e7d86a1ca254 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:09.515532 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3008b1-ca19-4de0-9027-e7d86a1ca254 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:09.515816 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3008b1-ca19-4de0-9027-e7d86a1ca254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:09.533464 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-6b3008b1-ca19-4de0-9027-e7d86a1ca254 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:40:09.534706 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-6b3008b1-ca19-4de0-9027-e7d86a1ca254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:09.580642 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:09.594157 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1454/2885] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:40:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:40:09.604472 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b3393-4600-4c80-9ede-2359bbd9ff4e admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:09.605918 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-df6b3393-4600-4c80-9ede-2359bbd9ff4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:09.663374 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b3393-4600-4c80-9ede-2359bbd9ff4e admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:09.667144 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e445c-f85e-4c90-b0c1-a9fa351e9301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:09.667802 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e445c-f85e-4c90-b0c1-a9fa351e9301 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:09.668161 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e445c-f85e-4c90-b0c1-a9fa351e9301 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:09.668447 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e445c-f85e-4c90-b0c1-a9fa351e9301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:09.677699 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e445c-f85e-4c90-b0c1-a9fa351e9301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:09.679241 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e445c-f85e-4c90-b0c1-a9fa351e9301 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:09.688784 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1432/2886] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:40:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:40:10.156688 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3008b1-ca19-4de0-9027-e7d86a1ca254 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:10.158141 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-6b3008b1-ca19-4de0-9027-e7d86a1ca254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:10.170197 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3008b1-ca19-4de0-9027-e7d86a1ca254 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:10.174731 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6b3a8-128c-4343-adcd-8aa243fc31cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:10.175599 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6b3a8-128c-4343-adcd-8aa243fc31cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:10.176009 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6b3a8-128c-4343-adcd-8aa243fc31cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:10.176427 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6b3a8-128c-4343-adcd-8aa243fc31cc admin admin] PATH_INFO: `/v3/projects/190b06b27b9e4cabb27c4029e6fe2bba` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:10.177685 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6b3a8-128c-4343-adcd-8aa243fc31cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=190b06b27b9e4cabb27c4029e6fe2bba)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:10.179673 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6b3a8-128c-4343-adcd-8aa243fc31cc admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:10.274335 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-47f6b3a8-128c-4343-adcd-8aa243fc31cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '190b06b27b9e4cabb27c4029e6fe2bba', 'request_id': 'req-47f6b3a8-128c-4343-adcd-8aa243fc31cc'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:10.348523 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-47f6b3a8-128c-4343-adcd-8aa243fc31cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '190b06b27b9e4cabb27c4029e6fe2bba', 'request_id': 'req-47f6b3a8-128c-4343-adcd-8aa243fc31cc'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:10.355006 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-47f6b3a8-128c-4343-adcd-8aa243fc31cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '190b06b27b9e4cabb27c4029e6fe2bba', 'request_id': 'req-47f6b3a8-128c-4343-adcd-8aa243fc31cc'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:10.365872 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-47f6b3a8-128c-4343-adcd-8aa243fc31cc admin admin] The token cache is being invalidate because project 190b06b27b9e4cabb27c4029e6fe2bba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:40:10.369245 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-47f6b3a8-128c-4343-adcd-8aa243fc31cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:10.369245 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-47f6b3a8-128c-4343-adcd-8aa243fc31cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:10.369245 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1455/2887] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:40:10 2022] DELETE /identity/v3/projects/190b06b27b9e4cabb27c4029e6fe2bba => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:40:10.372316 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e445c-f85e-4c90-b0c1-a9fa351e9301 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:10.382844 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e445c-f85e-4c90-b0c1-a9fa351e9301 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:10.438033 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826a3ba-c9a4-4f65-a45f-496311509998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:10.438829 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826a3ba-c9a4-4f65-a45f-496311509998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:10.439115 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826a3ba-c9a4-4f65-a45f-496311509998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:10.439393 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826a3ba-c9a4-4f65-a45f-496311509998 admin admin] PATH_INFO: `/v3/users/9d8287e9ba124854afa071ced01c6082` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:10.440584 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826a3ba-c9a4-4f65-a45f-496311509998 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d8287e9ba124854afa071ced01c6082)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:10.443206 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826a3ba-c9a4-4f65-a45f-496311509998 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:10.642596 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3826a3ba-c9a4-4f65-a45f-496311509998 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d8287e9ba124854afa071ced01c6082'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:10.643245 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3826a3ba-c9a4-4f65-a45f-496311509998 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d8287e9ba124854afa071ced01c6082'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:10.645780 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:10.650983 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3826a3ba-c9a4-4f65-a45f-496311509998 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d8287e9ba124854afa071ced01c6082'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:10.749804 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3826a3ba-c9a4-4f65-a45f-496311509998 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d8287e9ba124854afa071ced01c6082'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:10.766100 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3826a3ba-c9a4-4f65-a45f-496311509998 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d8287e9ba124854afa071ced01c6082'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:10.769970 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1433/2888] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:40:10 2022] DELETE /identity/v3/users/9d8287e9ba124854afa071ced01c6082 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:40:11.167944 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6b3a8-128c-4343-adcd-8aa243fc31cc admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:11.169411 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-47f6b3a8-128c-4343-adcd-8aa243fc31cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:11.184803 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6b3a8-128c-4343-adcd-8aa243fc31cc admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:11.243389 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1942e-a89b-40a6-bdaa-d6fc7f654489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:11.244263 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1942e-a89b-40a6-bdaa-d6fc7f654489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:11.244551 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1942e-a89b-40a6-bdaa-d6fc7f654489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:11.244830 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1942e-a89b-40a6-bdaa-d6fc7f654489 admin admin] PATH_INFO: `/v3/projects/569e8f9688af4f03ae20844d90836831` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:11.246135 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1942e-a89b-40a6-bdaa-d6fc7f654489 admin admin] RBAC: Authorizing `identity:delete_project(project_id=569e8f9688af4f03ae20844d90836831)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:11.248046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1942e-a89b-40a6-bdaa-d6fc7f654489 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:11.378246 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6cf1942e-a89b-40a6-bdaa-d6fc7f654489 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '569e8f9688af4f03ae20844d90836831', 'request_id': 'req-6cf1942e-a89b-40a6-bdaa-d6fc7f654489'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:11.446520 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6cf1942e-a89b-40a6-bdaa-d6fc7f654489 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '569e8f9688af4f03ae20844d90836831', 'request_id': 'req-6cf1942e-a89b-40a6-bdaa-d6fc7f654489'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:11.453021 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6cf1942e-a89b-40a6-bdaa-d6fc7f654489 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '569e8f9688af4f03ae20844d90836831', 'request_id': 'req-6cf1942e-a89b-40a6-bdaa-d6fc7f654489'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:11.464386 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6cf1942e-a89b-40a6-bdaa-d6fc7f654489 admin admin] The token cache is being invalidate because project 569e8f9688af4f03ae20844d90836831 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:40:11.464678 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6cf1942e-a89b-40a6-bdaa-d6fc7f654489 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:11.465332 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-6cf1942e-a89b-40a6-bdaa-d6fc7f654489 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:11.467046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1456/2889] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:40:11 2022] DELETE /identity/v3/projects/569e8f9688af4f03ae20844d90836831 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:40:11.472996 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e004e91-7101-41a5-8dac-eb74f90c63e1 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:11.473480 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e004e91-7101-41a5-8dac-eb74f90c63e1 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:11.473590 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e004e91-7101-41a5-8dac-eb74f90c63e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:11.493328 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-1e004e91-7101-41a5-8dac-eb74f90c63e1 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:40:11.494571 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1e004e91-7101-41a5-8dac-eb74f90c63e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:11.682216 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1434/2890] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:40:11.689859 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3344fc-5dd2-4aff-a077-de7f5c9de22d None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:11.690197 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3344fc-5dd2-4aff-a077-de7f5c9de22d None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:11.690483 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3344fc-5dd2-4aff-a077-de7f5c9de22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:11.705252 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:11.711216 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-ee3344fc-5dd2-4aff-a077-de7f5c9de22d None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:40:11.712683 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-ee3344fc-5dd2-4aff-a077-de7f5c9de22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:11.720830 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1457/2891] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:40:11.725162 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e004e91-7101-41a5-8dac-eb74f90c63e1 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:11.734799 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e004e91-7101-41a5-8dac-eb74f90c63e1 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:11.739391 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59d6f0-60ed-4ac9-8067-ff5bc284e1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:11.740046 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59d6f0-60ed-4ac9-8067-ff5bc284e1ae admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:11.742015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59d6f0-60ed-4ac9-8067-ff5bc284e1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:11.742015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59d6f0-60ed-4ac9-8067-ff5bc284e1ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:11.742015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59d6f0-60ed-4ac9-8067-ff5bc284e1ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:40:11.742015 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59d6f0-60ed-4ac9-8067-ff5bc284e1ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:11.743383 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59d6f0-60ed-4ac9-8067-ff5bc284e1ae admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:11.755432 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1435/2892] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:40:11.759929 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3344fc-5dd2-4aff-a077-de7f5c9de22d None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:11.769350 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3344fc-5dd2-4aff-a077-de7f5c9de22d None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:11.774637 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1680de4-61c1-4bb6-906e-f753ed7fe6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:11.775316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1680de4-61c1-4bb6-906e-f753ed7fe6b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:11.775606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1680de4-61c1-4bb6-906e-f753ed7fe6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:11.775877 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1680de4-61c1-4bb6-906e-f753ed7fe6b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:11.776565 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1680de4-61c1-4bb6-906e-f753ed7fe6b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:11.778491 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1680de4-61c1-4bb6-906e-f753ed7fe6b8 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:11.876455 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1458/2893] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:40:11 2022] POST /identity/v3/projects => generated 361 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:40:11.881467 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59d6f0-60ed-4ac9-8067-ff5bc284e1ae admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:11.891301 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59d6f0-60ed-4ac9-8067-ff5bc284e1ae admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:11.946320 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae295a-d5b0-43be-9fe8-6ea96d090ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:11.946908 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae295a-d5b0-43be-9fe8-6ea96d090ab8 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:11.947195 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae295a-d5b0-43be-9fe8-6ea96d090ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:11.947474 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae295a-d5b0-43be-9fe8-6ea96d090ab8 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:11.948159 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae295a-d5b0-43be-9fe8-6ea96d090ab8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:11.950061 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae295a-d5b0-43be-9fe8-6ea96d090ab8 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:12.063492 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1436/2894] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:40:11 2022] POST /identity/v3/users => generated 281 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:40:12.068149 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1680de4-61c1-4bb6-906e-f753ed7fe6b8 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:12.078308 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1680de4-61c1-4bb6-906e-f753ed7fe6b8 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:12.082929 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654859de-4487-4368-98d2-0cb60ea4d0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:12.083559 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654859de-4487-4368-98d2-0cb60ea4d0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:12.083842 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654859de-4487-4368-98d2-0cb60ea4d0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:12.084117 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654859de-4487-4368-98d2-0cb60ea4d0a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:12.084955 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654859de-4487-4368-98d2-0cb60ea4d0a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:12.086836 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654859de-4487-4368-98d2-0cb60ea4d0a9 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:12.097003 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1459/2895] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 11:40:12.101097 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae295a-d5b0-43be-9fe8-6ea96d090ab8 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:12.111076 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae295a-d5b0-43be-9fe8-6ea96d090ab8 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:12.116334 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf43cb-b887-47bc-82eb-97e1532405ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:12.116983 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf43cb-b887-47bc-82eb-97e1532405ae admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:12.117267 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf43cb-b887-47bc-82eb-97e1532405ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:12.117545 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf43cb-b887-47bc-82eb-97e1532405ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:12.118302 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf43cb-b887-47bc-82eb-97e1532405ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:12.119861 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf43cb-b887-47bc-82eb-97e1532405ae admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:12.130359 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1437/2896] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:40:12.134240 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654859de-4487-4368-98d2-0cb60ea4d0a9 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:12.143907 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654859de-4487-4368-98d2-0cb60ea4d0a9 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:12.148482 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37eec2-e0b6-4bda-8c1e-f21fb09b5823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:12.149343 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37eec2-e0b6-4bda-8c1e-f21fb09b5823 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:12.149627 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37eec2-e0b6-4bda-8c1e-f21fb09b5823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:12.149937 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37eec2-e0b6-4bda-8c1e-f21fb09b5823 admin admin] PATH_INFO: `/v3/projects/959157edb8a7473080ef11a371e1e4c1/users/a9ad724cab134d7393f65618949b7397/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:12.164409 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a37eec2-e0b6-4bda-8c1e-f21fb09b5823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=959157edb8a7473080ef11a371e1e4c1, user_id=a9ad724cab134d7393f65618949b7397, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:12.167065 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a37eec2-e0b6-4bda-8c1e-f21fb09b5823 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:12.269197 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1460/2897] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:40:12 2022] PUT /identity/v3/projects/959157edb8a7473080ef11a371e1e4c1/users/a9ad724cab134d7393f65618949b7397/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:40:12.279465 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf210ab-bd59-45e3-ad92-87debae35963 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:12.279761 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf210ab-bd59-45e3-ad92-87debae35963 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:12.280041 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf210ab-bd59-45e3-ad92-87debae35963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:12.307230 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-ebf210ab-bd59-45e3-ad92-87debae35963 None None] MFA Rules not processed for user `a9ad724cab134d7393f65618949b7397`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:40:12.308435 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ebf210ab-bd59-45e3-ad92-87debae35963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:12.327632 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:12.371139 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1438/2898] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:40:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:40:12.413729 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37eec2-e0b6-4bda-8c1e-f21fb09b5823 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:12.415495 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-0a37eec2-e0b6-4bda-8c1e-f21fb09b5823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:12.471323 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37eec2-e0b6-4bda-8c1e-f21fb09b5823 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:12.475675 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8026d9-4f63-43b7-bbfc-0f69bf4ff0c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:12.476256 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8026d9-4f63-43b7-bbfc-0f69bf4ff0c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:12.476543 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8026d9-4f63-43b7-bbfc-0f69bf4ff0c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:12.476824 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8026d9-4f63-43b7-bbfc-0f69bf4ff0c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:12.485120 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8026d9-4f63-43b7-bbfc-0f69bf4ff0c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:12.486577 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8026d9-4f63-43b7-bbfc-0f69bf4ff0c2 service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:12.496175 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1461/2899] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:40:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:40:12.510067 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf210ab-bd59-45e3-ad92-87debae35963 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:12.571344 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf210ab-bd59-45e3-ad92-87debae35963 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:12.575905 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3d065-255b-437c-86e5-2a3247ea298a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:12.576772 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3d065-255b-437c-86e5-2a3247ea298a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:12.577059 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3d065-255b-437c-86e5-2a3247ea298a admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:12.577340 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3d065-255b-437c-86e5-2a3247ea298a admin admin] PATH_INFO: `/v3/users/a9ad724cab134d7393f65618949b7397` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:12.578558 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3d065-255b-437c-86e5-2a3247ea298a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9ad724cab134d7393f65618949b7397)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:12.580452 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3d065-255b-437c-86e5-2a3247ea298a admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:12.776171 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-88d3d065-255b-437c-86e5-2a3247ea298a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9ad724cab134d7393f65618949b7397'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:12.776870 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-88d3d065-255b-437c-86e5-2a3247ea298a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9ad724cab134d7393f65618949b7397'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:12.783809 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-88d3d065-255b-437c-86e5-2a3247ea298a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9ad724cab134d7393f65618949b7397'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:12.873798 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-88d3d065-255b-437c-86e5-2a3247ea298a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9ad724cab134d7393f65618949b7397'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:12.886646 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-88d3d065-255b-437c-86e5-2a3247ea298a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9ad724cab134d7393f65618949b7397'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:12.892622 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1439/2900] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:40:12 2022] DELETE /identity/v3/users/a9ad724cab134d7393f65618949b7397 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:40:12.898158 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23d1ec-359f-439c-9664-cddb7edd6d2c None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:12.898475 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23d1ec-359f-439c-9664-cddb7edd6d2c None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:12.898756 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23d1ec-359f-439c-9664-cddb7edd6d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:12.916205 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-0f23d1ec-359f-439c-9664-cddb7edd6d2c None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:40:12.917398 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-0f23d1ec-359f-439c-9664-cddb7edd6d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:12.974918 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1462/2901] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:40:12.984545 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3d065-255b-437c-86e5-2a3247ea298a admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:12.986021 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-88d3d065-255b-437c-86e5-2a3247ea298a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:13.031149 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:13.042511 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3d065-255b-437c-86e5-2a3247ea298a admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:13.046131 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97897434-be6e-4576-88db-ba1b3cc3f50b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:13.046775 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97897434-be6e-4576-88db-ba1b3cc3f50b service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:13.054106 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97897434-be6e-4576-88db-ba1b3cc3f50b service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:13.054106 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97897434-be6e-4576-88db-ba1b3cc3f50b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:13.056116 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97897434-be6e-4576-88db-ba1b3cc3f50b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:13.057540 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97897434-be6e-4576-88db-ba1b3cc3f50b service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:13.067930 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1440/2902] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:40:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:40:13.556965 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23d1ec-359f-439c-9664-cddb7edd6d2c None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:13.558464 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-0f23d1ec-359f-439c-9664-cddb7edd6d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:13.573086 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23d1ec-359f-439c-9664-cddb7edd6d2c None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:13.577840 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958532db-c3b1-473a-b1ad-b9f0b953a01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:13.578698 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958532db-c3b1-473a-b1ad-b9f0b953a01d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:13.578993 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958532db-c3b1-473a-b1ad-b9f0b953a01d admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:13.579259 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958532db-c3b1-473a-b1ad-b9f0b953a01d admin admin] PATH_INFO: `/v3/projects/959157edb8a7473080ef11a371e1e4c1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:13.580961 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958532db-c3b1-473a-b1ad-b9f0b953a01d admin admin] RBAC: Authorizing `identity:delete_project(project_id=959157edb8a7473080ef11a371e1e4c1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:13.583331 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958532db-c3b1-473a-b1ad-b9f0b953a01d admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:13.704305 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:13.710567 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-958532db-c3b1-473a-b1ad-b9f0b953a01d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '959157edb8a7473080ef11a371e1e4c1', 'request_id': 'req-958532db-c3b1-473a-b1ad-b9f0b953a01d'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:13.772210 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-958532db-c3b1-473a-b1ad-b9f0b953a01d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '959157edb8a7473080ef11a371e1e4c1', 'request_id': 'req-958532db-c3b1-473a-b1ad-b9f0b953a01d'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:13.779316 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-958532db-c3b1-473a-b1ad-b9f0b953a01d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '959157edb8a7473080ef11a371e1e4c1', 'request_id': 'req-958532db-c3b1-473a-b1ad-b9f0b953a01d'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:13.790693 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-958532db-c3b1-473a-b1ad-b9f0b953a01d admin admin] The token cache is being invalidate because project 959157edb8a7473080ef11a371e1e4c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:40:13.790989 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-958532db-c3b1-473a-b1ad-b9f0b953a01d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:13.791674 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-958532db-c3b1-473a-b1ad-b9f0b953a01d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:13.793236 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1463/2903] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:40:13 2022] DELETE /identity/v3/projects/959157edb8a7473080ef11a371e1e4c1 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:40:13.798137 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e6540-4793-4a56-8b47-87fcf61ee3af None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:13.798635 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e6540-4793-4a56-8b47-87fcf61ee3af None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:13.798745 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e6540-4793-4a56-8b47-87fcf61ee3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:13.817326 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-7f3e6540-4793-4a56-8b47-87fcf61ee3af None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:40:13.818487 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7f3e6540-4793-4a56-8b47-87fcf61ee3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:13.876122 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1441/2904] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:40:13.884918 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74430c-6d7e-4e2f-817a-3ae6ec4fb557 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:13.885429 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74430c-6d7e-4e2f-817a-3ae6ec4fb557 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:13.886035 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74430c-6d7e-4e2f-817a-3ae6ec4fb557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:13.906940 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-1b74430c-6d7e-4e2f-817a-3ae6ec4fb557 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:40:13.908566 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-1b74430c-6d7e-4e2f-817a-3ae6ec4fb557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:13.918649 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1464/2905] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:40:13.922790 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e6540-4793-4a56-8b47-87fcf61ee3af None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:13.933095 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e6540-4793-4a56-8b47-87fcf61ee3af None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:13.937642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7b717-c06f-4887-9f1e-96fefadebdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:13.938328 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7b717-c06f-4887-9f1e-96fefadebdb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:13.938613 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7b717-c06f-4887-9f1e-96fefadebdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:13.938892 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7b717-c06f-4887-9f1e-96fefadebdb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:13.939614 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7b717-c06f-4887-9f1e-96fefadebdb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:40:13.939926 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7b717-c06f-4887-9f1e-96fefadebdb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:13.941506 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7b717-c06f-4887-9f1e-96fefadebdb7 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:13.952819 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1442/2906] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jul 11 11:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:40:13.956880 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74430c-6d7e-4e2f-817a-3ae6ec4fb557 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:13.966744 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74430c-6d7e-4e2f-817a-3ae6ec4fb557 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:13.971305 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06226ffb-74fc-4c28-9ca3-5777d1f738ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:13.971944 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06226ffb-74fc-4c28-9ca3-5777d1f738ff admin admin] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:13.972228 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06226ffb-74fc-4c28-9ca3-5777d1f738ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:13.972503 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06226ffb-74fc-4c28-9ca3-5777d1f738ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:13.973191 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06226ffb-74fc-4c28-9ca3-5777d1f738ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:13.975644 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06226ffb-74fc-4c28-9ca3-5777d1f738ff admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:14.065562 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1465/2907] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jul 11 11:40:13 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:40:14.069593 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7b717-c06f-4887-9f1e-96fefadebdb7 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:14.079361 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7b717-c06f-4887-9f1e-96fefadebdb7 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:14.135563 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b6a16-1a30-4947-804c-a6f44e186981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:14.136228 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b6a16-1a30-4947-804c-a6f44e186981 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:14.136513 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b6a16-1a30-4947-804c-a6f44e186981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:14.136791 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b6a16-1a30-4947-804c-a6f44e186981 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:14.137470 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b6a16-1a30-4947-804c-a6f44e186981 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:14.139394 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b6a16-1a30-4947-804c-a6f44e186981 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:14.226410 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1443/2908] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jul 11 11:40:14 2022] POST /identity/v3/users => generated 283 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:40:14.229076 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06226ffb-74fc-4c28-9ca3-5777d1f738ff admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:14.239436 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06226ffb-74fc-4c28-9ca3-5777d1f738ff admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:14.244374 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0634ac-a67e-4273-a4e9-dbdd24c0d1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:14.245031 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0634ac-a67e-4273-a4e9-dbdd24c0d1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:14.245381 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0634ac-a67e-4273-a4e9-dbdd24c0d1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:14.245722 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0634ac-a67e-4273-a4e9-dbdd24c0d1a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:14.246490 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0634ac-a67e-4273-a4e9-dbdd24c0d1a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:14.248085 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0634ac-a67e-4273-a4e9-dbdd24c0d1a3 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:14.258562 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1466/2909] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:40:14.262526 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b6a16-1a30-4947-804c-a6f44e186981 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:14.273397 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b6a16-1a30-4947-804c-a6f44e186981 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:14.278030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be6db4-d2ba-468c-aad8-8f4a63f53952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:14.278683 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be6db4-d2ba-468c-aad8-8f4a63f53952 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:14.278968 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be6db4-d2ba-468c-aad8-8f4a63f53952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:14.279247 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be6db4-d2ba-468c-aad8-8f4a63f53952 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:14.280014 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be6db4-d2ba-468c-aad8-8f4a63f53952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:14.281577 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be6db4-d2ba-468c-aad8-8f4a63f53952 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:14.293325 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1444/2910] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jul 11 11:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:40:14.297387 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0634ac-a67e-4273-a4e9-dbdd24c0d1a3 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:14.307559 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0634ac-a67e-4273-a4e9-dbdd24c0d1a3 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:14.312162 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf724be-dde0-4415-b6c9-2ff4c9619a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:14.313030 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf724be-dde0-4415-b6c9-2ff4c9619a58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:14.313318 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf724be-dde0-4415-b6c9-2ff4c9619a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:14.313596 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf724be-dde0-4415-b6c9-2ff4c9619a58 admin admin] PATH_INFO: `/v3/projects/b7b471e70a9b4216bcee88edeee5a1ca/users/6904fb9e1c8f4e468afaba5e0870975a/roles/16b11a05b5da4287bdd74d219dde5fb1` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:14.331369 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf724be-dde0-4415-b6c9-2ff4c9619a58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7b471e70a9b4216bcee88edeee5a1ca, user_id=6904fb9e1c8f4e468afaba5e0870975a, role_id=16b11a05b5da4287bdd74d219dde5fb1)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:14.331586 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf724be-dde0-4415-b6c9-2ff4c9619a58 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:14.400696 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1467/2911] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jul 11 11:40:14 2022] PUT /identity/v3/projects/b7b471e70a9b4216bcee88edeee5a1ca/users/6904fb9e1c8f4e468afaba5e0870975a/roles/16b11a05b5da4287bdd74d219dde5fb1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:40:14.411055 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c860555-c185-4f4d-8c00-9f3ae502147e None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:14.411354 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c860555-c185-4f4d-8c00-9f3ae502147e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:14.411642 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c860555-c185-4f4d-8c00-9f3ae502147e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:14.438833 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-2c860555-c185-4f4d-8c00-9f3ae502147e None None] MFA Rules not processed for user `6904fb9e1c8f4e468afaba5e0870975a`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:40:14.440061 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2c860555-c185-4f4d-8c00-9f3ae502147e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:14.480143 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:14.508447 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1445/2912] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:40:14 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:40:14.519599 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf724be-dde0-4415-b6c9-2ff4c9619a58 admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:14.521980 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-3cf724be-dde0-4415-b6c9-2ff4c9619a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:14.586922 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf724be-dde0-4415-b6c9-2ff4c9619a58 admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:14.590828 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaace14d-6d23-4297-84c4-e3c650f43ce6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3096077887344140805ec8a23fe72f48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:14.592835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaace14d-6d23-4297-84c4-e3c650f43ce6 service cinder] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:14.592835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaace14d-6d23-4297-84c4-e3c650f43ce6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:14.592835 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaace14d-6d23-4297-84c4-e3c650f43ce6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:14.600809 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaace14d-6d23-4297-84c4-e3c650f43ce6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:14.602324 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaace14d-6d23-4297-84c4-e3c650f43ce6 service cinder] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:14.611331 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1468/2913] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:40:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:40:24.583628 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=9 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:24.607061 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=62,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:32.912241 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c860555-c185-4f4d-8c00-9f3ae502147e None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:32.913670 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2c860555-c185-4f4d-8c00-9f3ae502147e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:32.970649 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c860555-c185-4f4d-8c00-9f3ae502147e None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:32.974864 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b533f-64fd-4f55-a78e-e5f2619ad025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:32.975571 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b533f-64fd-4f55-a78e-e5f2619ad025 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:32.975855 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b533f-64fd-4f55-a78e-e5f2619ad025 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:32.976220 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b533f-64fd-4f55-a78e-e5f2619ad025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:32.979042 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-979b533f-64fd-4f55-a78e-e5f2619ad025 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:33.038751 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b533f-64fd-4f55-a78e-e5f2619ad025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:33.040799 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b533f-64fd-4f55-a78e-e5f2619ad025 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:33.049856 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1446/2914] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:40:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:40:40.350522 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaace14d-6d23-4297-84c4-e3c650f43ce6 service cinder] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:40.360137 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaace14d-6d23-4297-84c4-e3c650f43ce6 service cinder] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:40.363827 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90d54a-3fee-4a59-98d1-a40134cd385b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:40.364489 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90d54a-3fee-4a59-98d1-a40134cd385b service neutron] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:40.364777 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90d54a-3fee-4a59-98d1-a40134cd385b service neutron] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:40.365053 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90d54a-3fee-4a59-98d1-a40134cd385b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:40.366846 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-5c90d54a-3fee-4a59-98d1-a40134cd385b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:40.428874 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90d54a-3fee-4a59-98d1-a40134cd385b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:40.430375 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90d54a-3fee-4a59-98d1-a40134cd385b service neutron] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:40.440025 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1469/2915] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:40:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:40:43.045717 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=48 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:43.939258 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b533f-64fd-4f55-a78e-e5f2619ad025 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:43.940929 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-979b533f-64fd-4f55-a78e-e5f2619ad025 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:44.014388 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b533f-64fd-4f55-a78e-e5f2619ad025 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:44.019675 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821146a-a324-4d2e-aab2-4aed5ba38aec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b7c9264495433985185332778dbc8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:44.020334 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821146a-a324-4d2e-aab2-4aed5ba38aec service placement] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:44.020616 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821146a-a324-4d2e-aab2-4aed5ba38aec service placement] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:44.020893 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821146a-a324-4d2e-aab2-4aed5ba38aec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:44.022989 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a821146a-a324-4d2e-aab2-4aed5ba38aec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:44.037146 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821146a-a324-4d2e-aab2-4aed5ba38aec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:44.039030 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821146a-a324-4d2e-aab2-4aed5ba38aec service placement] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:44.050583 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1447/2916] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:40:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:40:47.651041 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90d54a-3fee-4a59-98d1-a40134cd385b service neutron] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:47.662630 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90d54a-3fee-4a59-98d1-a40134cd385b service neutron] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:47.668227 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ae792-5aa3-4be6-814b-08b7368043eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b7c9264495433985185332778dbc8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:47.668876 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ae792-5aa3-4be6-814b-08b7368043eb service placement] REQUEST_METHOD: `GET` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:47.669160 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ae792-5aa3-4be6-814b-08b7368043eb service placement] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:47.669436 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ae792-5aa3-4be6-814b-08b7368043eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:47.671242 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-0f5ae792-5aa3-4be6-814b-08b7368043eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:47.683799 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ae792-5aa3-4be6-814b-08b7368043eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:47.685361 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ae792-5aa3-4be6-814b-08b7368043eb service placement] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:47.698151 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1470/2917] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:40:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:40:47.784585 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821146a-a324-4d2e-aab2-4aed5ba38aec service placement] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:47.786219 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a821146a-a324-4d2e-aab2-4aed5ba38aec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:47.800756 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821146a-a324-4d2e-aab2-4aed5ba38aec service placement] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:47.805374 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117da6c-4cd9-49e9-9764-08adb3cfcef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:47.806281 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117da6c-4cd9-49e9-9764-08adb3cfcef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:47.806568 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117da6c-4cd9-49e9-9764-08adb3cfcef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:47.806848 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117da6c-4cd9-49e9-9764-08adb3cfcef7 admin admin] PATH_INFO: `/v3/users/9450c339800248feb9f487804473a59b` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:47.809026 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117da6c-4cd9-49e9-9764-08adb3cfcef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9450c339800248feb9f487804473a59b)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:47.810954 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117da6c-4cd9-49e9-9764-08adb3cfcef7 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:47.969129 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-9117da6c-4cd9-49e9-9764-08adb3cfcef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9450c339800248feb9f487804473a59b'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:47.969718 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-9117da6c-4cd9-49e9-9764-08adb3cfcef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9450c339800248feb9f487804473a59b'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:47.976697 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-9117da6c-4cd9-49e9-9764-08adb3cfcef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9450c339800248feb9f487804473a59b'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:48.023344 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-9117da6c-4cd9-49e9-9764-08adb3cfcef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9450c339800248feb9f487804473a59b'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:48.037049 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-9117da6c-4cd9-49e9-9764-08adb3cfcef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9450c339800248feb9f487804473a59b'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:48.044071 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1448/2918] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:40:47 2022] DELETE /identity/v3/users/9450c339800248feb9f487804473a59b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:40:48.288347 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ae792-5aa3-4be6-814b-08b7368043eb service placement] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:48.301631 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ae792-5aa3-4be6-814b-08b7368043eb service placement] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:48.372404 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c523a9a-8ee2-410b-9da1-2906cbab37be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:48.375894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c523a9a-8ee2-410b-9da1-2906cbab37be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:48.375894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c523a9a-8ee2-410b-9da1-2906cbab37be admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:48.375894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c523a9a-8ee2-410b-9da1-2906cbab37be admin admin] PATH_INFO: `/v3/projects/199db26c275d489699bb2c2afee9a50f` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:48.375894 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c523a9a-8ee2-410b-9da1-2906cbab37be admin admin] RBAC: Authorizing `identity:delete_project(project_id=199db26c275d489699bb2c2afee9a50f)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:48.377010 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c523a9a-8ee2-410b-9da1-2906cbab37be admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:48.480840 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-9c523a9a-8ee2-410b-9da1-2906cbab37be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '199db26c275d489699bb2c2afee9a50f', 'request_id': 'req-9c523a9a-8ee2-410b-9da1-2906cbab37be'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:48.542297 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-9c523a9a-8ee2-410b-9da1-2906cbab37be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '199db26c275d489699bb2c2afee9a50f', 'request_id': 'req-9c523a9a-8ee2-410b-9da1-2906cbab37be'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:48.549317 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-9c523a9a-8ee2-410b-9da1-2906cbab37be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '199db26c275d489699bb2c2afee9a50f', 'request_id': 'req-9c523a9a-8ee2-410b-9da1-2906cbab37be'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:48.560113 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-9c523a9a-8ee2-410b-9da1-2906cbab37be admin admin] The token cache is being invalidate because project 199db26c275d489699bb2c2afee9a50f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:40:48.560402 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-9c523a9a-8ee2-410b-9da1-2906cbab37be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:48.561036 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-9c523a9a-8ee2-410b-9da1-2906cbab37be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:48.562602 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1471/2919] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:40:48 2022] DELETE /identity/v3/projects/199db26c275d489699bb2c2afee9a50f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:40:48.566547 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117da6c-4cd9-49e9-9764-08adb3cfcef7 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:48.567935 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9117da6c-4cd9-49e9-9764-08adb3cfcef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:48.581656 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117da6c-4cd9-49e9-9764-08adb3cfcef7 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:48.638377 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07359e0-1895-4554-bff4-c3595eac60ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:48.639268 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07359e0-1895-4554-bff4-c3595eac60ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:48.639556 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07359e0-1895-4554-bff4-c3595eac60ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:48.639836 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07359e0-1895-4554-bff4-c3595eac60ed admin admin] PATH_INFO: `/v3/users/2733d9f38efb4e848ea47a40d080ddf1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:48.641048 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07359e0-1895-4554-bff4-c3595eac60ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=2733d9f38efb4e848ea47a40d080ddf1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:48.643048 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07359e0-1895-4554-bff4-c3595eac60ed admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:48.647541 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:48.809360 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f07359e0-1895-4554-bff4-c3595eac60ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2733d9f38efb4e848ea47a40d080ddf1'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:48.809972 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f07359e0-1895-4554-bff4-c3595eac60ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2733d9f38efb4e848ea47a40d080ddf1'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:48.816937 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f07359e0-1895-4554-bff4-c3595eac60ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2733d9f38efb4e848ea47a40d080ddf1'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:48.874512 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f07359e0-1895-4554-bff4-c3595eac60ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2733d9f38efb4e848ea47a40d080ddf1'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:48.886583 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f07359e0-1895-4554-bff4-c3595eac60ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2733d9f38efb4e848ea47a40d080ddf1'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:48.893278 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1449/2920] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:40:48 2022] DELETE /identity/v3/users/2733d9f38efb4e848ea47a40d080ddf1 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:40:49.150564 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c523a9a-8ee2-410b-9da1-2906cbab37be admin admin] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:49.152066 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-9c523a9a-8ee2-410b-9da1-2906cbab37be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:49.164880 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c523a9a-8ee2-410b-9da1-2906cbab37be admin admin] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:49.174017 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:49.223187 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15576992-016f-4e3d-83cd-6fe8f289e8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:49.224046 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15576992-016f-4e3d-83cd-6fe8f289e8d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:49.224328 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15576992-016f-4e3d-83cd-6fe8f289e8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:49.224598 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15576992-016f-4e3d-83cd-6fe8f289e8d3 admin admin] PATH_INFO: `/v3/projects/567f027f33374edb9c8bb4f5501e65bc` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:49.225848 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15576992-016f-4e3d-83cd-6fe8f289e8d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=567f027f33374edb9c8bb4f5501e65bc)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:49.227729 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15576992-016f-4e3d-83cd-6fe8f289e8d3 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:49.356523 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-15576992-016f-4e3d-83cd-6fe8f289e8d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '567f027f33374edb9c8bb4f5501e65bc', 'request_id': 'req-15576992-016f-4e3d-83cd-6fe8f289e8d3'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:49.417195 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-15576992-016f-4e3d-83cd-6fe8f289e8d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '567f027f33374edb9c8bb4f5501e65bc', 'request_id': 'req-15576992-016f-4e3d-83cd-6fe8f289e8d3'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:49.424229 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-15576992-016f-4e3d-83cd-6fe8f289e8d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '567f027f33374edb9c8bb4f5501e65bc', 'request_id': 'req-15576992-016f-4e3d-83cd-6fe8f289e8d3'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:49.435719 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-15576992-016f-4e3d-83cd-6fe8f289e8d3 admin admin] The token cache is being invalidate because project 567f027f33374edb9c8bb4f5501e65bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:40:49.436005 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-15576992-016f-4e3d-83cd-6fe8f289e8d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:49.436638 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-15576992-016f-4e3d-83cd-6fe8f289e8d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:49.438220 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1472/2921] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:40:49 2022] DELETE /identity/v3/projects/567f027f33374edb9c8bb4f5501e65bc => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:40:51.564782 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07359e0-1895-4554-bff4-c3595eac60ed admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:51.566334 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f07359e0-1895-4554-bff4-c3595eac60ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:51.579806 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07359e0-1895-4554-bff4-c3595eac60ed admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:51.635312 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38cb3fc-caab-4a3d-949d-4b51cacc81fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:51.636186 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cb3fc-caab-4a3d-949d-4b51cacc81fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:51.636473 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cb3fc-caab-4a3d-949d-4b51cacc81fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:51.636752 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cb3fc-caab-4a3d-949d-4b51cacc81fe admin admin] PATH_INFO: `/v3/users/6904fb9e1c8f4e468afaba5e0870975a` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:51.638445 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38cb3fc-caab-4a3d-949d-4b51cacc81fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=6904fb9e1c8f4e468afaba5e0870975a)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:51.640356 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38cb3fc-caab-4a3d-949d-4b51cacc81fe admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:51.849152 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-d38cb3fc-caab-4a3d-949d-4b51cacc81fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6904fb9e1c8f4e468afaba5e0870975a'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:51.849747 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-d38cb3fc-caab-4a3d-949d-4b51cacc81fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6904fb9e1c8f4e468afaba5e0870975a'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:51.856640 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-d38cb3fc-caab-4a3d-949d-4b51cacc81fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6904fb9e1c8f4e468afaba5e0870975a'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:51.925156 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-d38cb3fc-caab-4a3d-949d-4b51cacc81fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6904fb9e1c8f4e468afaba5e0870975a'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:51.937811 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-d38cb3fc-caab-4a3d-949d-4b51cacc81fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6904fb9e1c8f4e468afaba5e0870975a'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:51.939902 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:51.944174 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1450/2922] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jul 11 11:40:51 2022] DELETE /identity/v3/users/6904fb9e1c8f4e468afaba5e0870975a => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:40:51.948802 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750235ae-7006-45db-a4ef-2d753f3d6373 None None] REQUEST_METHOD: `POST` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:51.949283 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750235ae-7006-45db-a4ef-2d753f3d6373 None None] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:51.949482 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750235ae-7006-45db-a4ef-2d753f3d6373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:51.968153 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.auth.core [None req-750235ae-7006-45db-a4ef-2d753f3d6373 None None] MFA Rules not processed for user `d07257ebe5bd4aaa947d43762dac11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:40:51.969362 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-750235ae-7006-45db-a4ef-2d753f3d6373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:52.029002 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1473/2923] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jul 11 11:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 11:40:52.039471 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38cb3fc-caab-4a3d-949d-4b51cacc81fe admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:52.040859 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d38cb3fc-caab-4a3d-949d-4b51cacc81fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:52.098524 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38cb3fc-caab-4a3d-949d-4b51cacc81fe admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:52.102235 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fe6dc-aee6-460b-a294-6007b686e0c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b8c08920b0417097bebd23344ffe64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:52.102870 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fe6dc-aee6-460b-a294-6007b686e0c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:52.103159 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fe6dc-aee6-460b-a294-6007b686e0c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:52.103439 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fe6dc-aee6-460b-a294-6007b686e0c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:52.113311 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fe6dc-aee6-460b-a294-6007b686e0c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:52.114767 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fe6dc-aee6-460b-a294-6007b686e0c1 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:52.124859 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1451/2924] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:40:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 11:40:52.521239 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750235ae-7006-45db-a4ef-2d753f3d6373 None None] Authenticating user token {{(pid=80522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:40:52.522807 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.fernet_utils [None req-750235ae-7006-45db-a4ef-2d753f3d6373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:40:52.535870 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750235ae-7006-45db-a4ef-2d753f3d6373 None None] Validating token access rules against request {{(pid=80522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:40:52.540512 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfa010-b318-4ffc-a717-fee07e8c4797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd07257ebe5bd4aaa947d43762dac11d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f214658e46461082860991a2c6d4f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:40:52.541378 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfa010-b318-4ffc-a717-fee07e8c4797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:40:52.541745 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfa010-b318-4ffc-a717-fee07e8c4797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:40:52.541996 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfa010-b318-4ffc-a717-fee07e8c4797 admin admin] PATH_INFO: `/v3/projects/b7b471e70a9b4216bcee88edeee5a1ca` {{(pid=80522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:40:52.543267 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfa010-b318-4ffc-a717-fee07e8c4797 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7b471e70a9b4216bcee88edeee5a1ca)` {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:40:52.546051 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfa010-b318-4ffc-a717-fee07e8c4797 admin admin] RBAC: Authorization granted {{(pid=80522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:40:52.648948 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:52.658067 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-11bfa010-b318-4ffc-a717-fee07e8c4797 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7b471e70a9b4216bcee88edeee5a1ca', 'request_id': 'req-11bfa010-b318-4ffc-a717-fee07e8c4797'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:52.766085 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-11bfa010-b318-4ffc-a717-fee07e8c4797 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7b471e70a9b4216bcee88edeee5a1ca', 'request_id': 'req-11bfa010-b318-4ffc-a717-fee07e8c4797'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:52.772844 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-11bfa010-b318-4ffc-a717-fee07e8c4797 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7b471e70a9b4216bcee88edeee5a1ca', 'request_id': 'req-11bfa010-b318-4ffc-a717-fee07e8c4797'} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:52.783972 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-11bfa010-b318-4ffc-a717-fee07e8c4797 admin admin] The token cache is being invalidate because project b7b471e70a9b4216bcee88edeee5a1ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 11:40:52.784266 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-11bfa010-b318-4ffc-a717-fee07e8c4797 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:52.784897 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG keystone.notifications [None req-11bfa010-b318-4ffc-a717-fee07e8c4797 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 11:40:52.786505 dv-cinder-848429-2-smb devstack@keystone.service[80522]: [pid: 80522|app: 0|req: 1474/2925] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jul 11 11:40:52 2022] DELETE /identity/v3/projects/b7b471e70a9b4216bcee88edeee5a1ca => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:41:02.119975 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=26 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:41:02.885606 dv-cinder-848429-2-smb devstack@keystone.service[80522]: DEBUG dbcounter [-] [80522] Writing DB stats keystone:SELECT=11,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:44:09.431660 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fe6dc-aee6-460b-a294-6007b686e0c1 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:44:09.433255 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2b7fe6dc-aee6-460b-a294-6007b686e0c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:44:09.577873 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fe6dc-aee6-460b-a294-6007b686e0c1 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:44:09.635985 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab95f8-4d01-4ccc-8396-764aac5e93d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b7c9264495433985185332778dbc8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38ed7416526e473b816330e24acf7a04', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:44:09.636780 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab95f8-4d01-4ccc-8396-764aac5e93d0 service placement] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:44:09.637108 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab95f8-4d01-4ccc-8396-764aac5e93d0 service placement] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:44:09.637426 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab95f8-4d01-4ccc-8396-764aac5e93d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:44:09.639309 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-aaab95f8-4d01-4ccc-8396-764aac5e93d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:44:09.650504 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab95f8-4d01-4ccc-8396-764aac5e93d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:44:09.652057 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab95f8-4d01-4ccc-8396-764aac5e93d0 service placement] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:44:09.661713 dv-cinder-848429-2-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1452/2926] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jul 11 11:44:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 11:44:19.657511 dv-cinder-848429-2-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}